Tianzhu Wen

Refer to #2854 Add 'flink-config' for pipeline yaml, which will overwrite the config from 'flink-conf.yaml'. cc @lvyanquan @PatrickRen

### Purpose [core] AddColumn move support before and last. Linked issue: close #3316 ### Tests Add test case: org.apache.paimon.schema.SchemaManagerTest#testApplyMove ### API and Format ### Documentation

[FLINK-35325][cdc-connector][paimon]Support for specifying column order.

1

Refer to jira: https://issues.apache.org/jira/browse/FLINK-35325 Adding support for specifying column order when adding new columns to a table.

Refer to [FLINK-35430](https://issues.apache.org/jira/browse/FLINK-35430) Passed the zoneId to JsonSerializationSchema.

[FLINK-35467][cdc-dist][bin] Respect externally set FLINK_CONF_DIR for CDC task configuration.

2

Refer to: https://issues.apache.org/jira/browse/FLINK-35467 Respect externally set FLINK_CONF_DIR for CDC task configuration The script has been modified to check if the FLINK_CONF_DIR environment variable is set externally before defaulting to $FLINK_HOME/conf....

[FLINK-35589][cdc-common] Support MemorySize type in FlinkCDC ConfigOptions.

1

Refer to: https://issues.apache.org/jira/browse/FLINK-35589 Support MemorySize type in FlinkCDC ConfigOptions.

[FLINK-37676][cdc-common] Add caching mechanism to Selectors for improved performance

4

Refer to https://issues.apache.org/jira/browse/FLINK-37676 Adding a cache for better performance.

[improve] Remove repeated dependency.

1

Remove repeated dependency of maxcompute, and change the phase of "download-flink-release" in pipeline-e2e-test.

### Rationale for this change ### What changes are included in this PR? ### Are these changes tested? ### Are there any user-facing changes?