[Feature]: Support insert part of columns of mixed-format table with flink in streaming mode

[zhoujinsong]

Description

Support insert part of columns of arctic table with flink in streaming mode

Use case/motivation

Arctic only support insert all table columns with flink in streaming mode now. If souce table DOES NOT have all columns which sink table need, user must join multiple source table, which will cause a big state problem. If Arctic support insert part of columns, user can start multiple flink job and each job insert part of columns(including join column) into arctic table to avoid problem mentioned above.

Describe the solution

• Support insert part of columns of arctic table with flink in streaming mode
• Merge all columns together when optiming

Related issues

No response

Are you willing to submit a PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

[shidayang]

Design doc:https://docs.google.com/document/d/1CwvXGt--MZG9XcqN-Q4scqoLerGcY6seIgAOhPVv2BM/edit?usp=sharing

[shidayang]

Discussed in https://github.com/NetEase/arctic/discussions/494

[zhoujinsong]

Closed due to a change in plans.

[github-actions[bot]]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions[bot]]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'