Dagit failed to start with mysql (clustered with 3 nodes)

Dagster version

0.15.7

What’s the issue?

The following error happens when we use mysql cluster as storage:

[SQL: INSERT INTO instance_info (run_storage_id) VALUES (%(run_storage_id)s)]
 sqlalchemy.exc.DatabaseError: (mysql.connector.errors.DatabaseError) 3098 (HY000): The table does not comply with the requirements by an external plugin.

Because the instance_info table does not have primary key, simply adding a primary will fix the issue:

ALTER TABLE instance_info ADD PRIMARY KEY (run_storage_id(255));

What did you expect to happen?

Dagit should start successfully.

How to reproduce?

Just run dagit with mysql cluster (more than 1 node)

Deployment type

No response

Deployment details

No response

Additional information

No response

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

[phuongdinh1411]

I 'm using 8.0.28

[dpeng817]

As @phuongdinh1411 mentioned - solution here is to add a primary key column to the instance info. This entails an alembic schema migration, but it would never be a forced migration (as we never read that primary key field)