yuxiqian

[FLINK-35072][cdc][doris] Support applying compatible `AlterColumnTypeEvent` to Doris sink

2

According to [Doris documentation](https://doris.apache.org/docs/sql-manual/sql-reference/Data-Definition-Statements/Alter/ALTER-TABLE-COLUMN/), altering column types dynamically is supported (via `ALTER TABLE ... MODIFY COLUMN` statement) when lossless conversion is available. However, now Doris pipeline connector has no support...

[FLINK-35272][cdc][runtime] Pipeline Transform job supports omitting / renaming calculation column

6

This closes [FLINK-35272](https://issues.apache.org/jira/browse/FLINK-35272). Currently, pipeline jobs with transform (including projection and filtering) are constructed with the following topology: ``` SchemaTransformOp --> DataTransformOp --> SchemaOp ``` where schema projections are applied...

enhancement: support alter modify columns' type and position

1

## What type of PR is this： - [ ] BugFix - [ ] Feature - [x] Enhancement - [ ] Refactor - [ ] UT - [ ] Doc...

Cherry-picked from #3310, #3314.

Cherry-picked from #3310, #3314.

[hotfix][tests] Fix occasional pipeline E2e testcases failure

3

Currently, `MySqlE2eITCase`'s result verification strategy is as follows: First, it keeps waiting until the last expected record received, then fetch all outputs at once and check if all expected records...

[BP-3.1][FLINK-35323][runtime] Fix transform failure when one rule matches multiple schemas

2

This closes FLINK-35323. Currently, Transform module doesn’t support handling multiple tables with different schema within one projection / filtering rule. This is not intended and turns out to be related...

[FLINK-35323][runtime] Fix transform failure when one rule matches multiple tables with incompatible schema

1

This closes [FLINK-35323](https://issues.apache.org/jira/browse/FLINK-35323). Currently, Transform module doesn’t support handling multiple tables with different schema within one projection / filtering rule. A minimum reproducible example is: ```yaml transform: - source-table: DB.TABLE\.*...

[FLINK-35243][cdc] Supports more schema change event types & backfill pre-schema payload for sink

3

This PR closes [FLINK-35243](https://issues.apache.org/jira/browse/FLINK-35243): * Supports `AlterColumnCommentEvent`, `AlterTableCommentEvent`, `DropTableEvent`, `RenameTableEvent`, and `TruncateTableEvent` in pipeline framework * Adds `SchemaChangeEventWithPreSchema` interface, allowing SchemaRegistry backfilling schema before change payload * Fixed MySQL pipeline...

[FLINK-35317][cli] Supports submitting multiple pipeline jobs at once

2

This closes [FLINK-35317](https://issues.apache.org/jira/browse/FLINK-35317). Currently, Flink CDC CLI only allows submitting one YAML pipeline job each time. This PR allows submitting multiple .yml files at once like this: `./bin/flink-cdc.sh job1.yml job2.yml...