[SUPPORT]How to auto sync "add column" by flink ?

To Reproduce

Steps to reproduce the behavior:

1. Create a mysql-cdc table A_cdc to capture mysql table A by flink sql
2. Create a hudi table B_hudi to write data to hive table B by flink sql
3. Execute flink sql insert into B_hudi select * from A_cdc
4. Add a column to table A

It seems that if you want to add columns, you must redefine the schema and restart the task.

How to sync “add column” event without restart?

Expected behavior

A clear and concise description of what you expected to happen.

Environment Description

• Hudi version : 0.10.0-SNAPSHOT

• Spark version :

• Hive version :

• Hadoop version :

• Storage (HDFS/S3/GCS…) :

• Running on Docker? (yes/no) : no

[lsyldliu]

IMO, this requires the flink can support schema evolution, current community flink doesn’t support it, you can consider use aliyun enterprise flink, we are support it.

[codope]

Closing this issue. As per @danny0405 this is hard to do w/o making changes in te flink engine in the flink community version. Please log an issue in flink.