[SUPPORT] now hudi use 1st api of flink sink, and flink suggest 2nd of api "org.apache.flink.api.connector.sink2.Sink", would hudi support it?

[lschampion]

Describe the problem you faced now hudi use 1st api of flink sink, and flink suggest 2nd of api "org.apache.flink.api.connector.sink2.Sink", would hudi support it? yeach i wanta hudi to support it, to make a connnector of hudi pipeline.

[lschampion]

to be precise, i wanta a flink-cdc-pipeline-hudi sink.

[danny0405]

yes, we are planning to support it recently, @voonhous is on duty for it.

[lschampion]

thanks a lot, hope it to be achived earlier,may i ask where could i get the newest code for this feature?

[danny0405]

we are investigating and writing the design doc now, there is no code yet, because @voonhous would be occupied by other things now, the development would start 1 month later.

[lschampion]

i appreciate that, is would be a big job.

[lschampion]

aha, flink pipeline new connector:

Flink CDC 3.4.0 introduces 1 new pipeline connector:

Iceberg sink. Iceberg is a high-performance format for huge analytic tables. Iceberg brings the reliability and simplicity of SQL tables to big data, while making it possible for engines like Spark, Trino, Flink, Presto, Hive and Impala to safely work with the same tables, at the same time. In this version, Iceberg is supported to be the downstream for Pipeline jobs.

[danny0405]

@lschampion yes, we are on the way to support it.