[Feature] Support bucket commit in paimon

[FangYongs]

Search before asking

• [X] I searched in the issues and found nothing similar.

Motivation

Currently Paimon will create a global commit operator for flink job which makes all operators in the job as one region. When a task failed, it causes global failover. I'd like to support bucket commit in paimon, then we can build commit operator for each sink and support region failover in flink jobs

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

• [ ] I'm willing to submit a PR!

[FangYongs]

@JingsongLi What do you think of this issue

[microbearz]

@FangYongs any update here?

[FangYongs]

@microbearz I have created a pip https://cwiki.apache.org/confluence/display/PAIMON/PIP-30%3A+Improvement+For+Paimon+Committer+In+Flink for this issue and started a thread, please feel free to discuss there, THX