flink-cdc [FLINK-36581][cli] Allow passing Flink configuration by yaml job file

At present, FlinkCDC only supports reading Flink configurations from Flink con files, but this approach is not user-friendly for multiple jobs that require different configurations. Allow passing Flink configuration by yaml job file such as :

source:
  type: mysql
  ...

sink:
  type: value

pipeline:
  name: MySQL to Kafka Pipeline
  parallelism: 1
  flink-conf:
    execution.checkpointing.interval: 6min

Feb 12 '25 03:02 MOBIN-F

@lvyanquan @yuxiqian PTAL~

Feb 14 '25 05:02 MOBIN-F

Could you clarify the configuration priority hierarchy here?

Mar 26 '25 06:03 joyCurry30

Could you clarify the configuration priority hierarchy here?

Please add this to document since we can add configuration through config.yaml/flink-cdc.sh/job.yaml.

Mar 26 '25 07:03 lvyanquan

Please help review again @lvyanquan @joyCurry30

Mar 31 '25 10:03 MOBIN-F

Do we have plans to merge this PR in 3.4? I want to merge this PR in 3.4, WDYT?@lvyanquan

Apr 23 '25 01:04 MOBIN-F

This pull request has been automatically marked as stale because it has not had recent activity for 120 days. It will be closed in 60 days if no further activity occurs.

Aug 22 '25 00:08 github-actions[bot]

This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encouraged to continue work on this pull request.

Oct 22 '25 00:10 github-actions[bot]

@MOBIN-F Would you like to continue working on this PR?

Oct 29 '25 09:10 yuxiqian

@MOBIN-F Would you like to continue working on this PR?

yes,I will finish the remaining work next week~

Oct 29 '25 10:10 MOBIN-F