seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

Published 20 hours ago • verified publisher icon apache

[Feature][Connector-v2] Support iceberg sink

Open hailin0 opened this issue 3 years ago • 18 comments
trafficstars

Search before asking

  • [X] I had searched in the feature and found no similar feature requirement.

Description

Support iceberg sink #1946

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • [x] Yes I am willing to submit a PR!

Code of Conduct

hailin0 avatar Sep 05 '22 03:09 hailin0

@2013650523

hailin0 avatar Sep 05 '22 04:09 hailin0

hi,I am working on the Sink Iceberg.

2013650523 avatar Sep 05 '22 04:09 2013650523

link #2495

hailin0 avatar Sep 14 '22 03:09 hailin0

i can work for it

s7monk avatar Oct 06 '22 07:10 s7monk

i can work for it

You are welcome.

EricJoy2048 avatar Oct 06 '22 07:10 EricJoy2048

file compression reference： https://iceberg.apache.org/docs/latest/flink/#rewrite-files-action https://github.com/apache/iceberg/blob/master/flink/v1.15/flink/src/test/java/org/apache/iceberg/flink/actions/TestRewriteDataFilesAction.java#L168

hailin0 avatar Oct 07 '22 05:10 hailin0

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

github-actions[bot] avatar Nov 27 '22 00:11 github-actions[bot]

@s7monk is this pr in progress?

cswangzheng avatar Dec 08 '22 02:12 cswangzheng

I have worked on it in recent one week, and in testing progress

bing-h avatar Jan 30 '23 13:01 bing-h

hi,I am working on the Sink Iceberg.

hi，is Sink Iceberg feature is finish？

zengqinchris avatar Feb 07 '23 08:02 zengqinchris

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

github-actions[bot] avatar Mar 22 '23 00:03 github-actions[bot]

@liugddx plz assign it to me. thx

molsionmo avatar Mar 22 '23 12:03 molsionmo

hi，is Sink Iceberg feature is finish？When can it be used normally

jonsey888 avatar Apr 07 '23 05:04 jonsey888

Is there any progress? @molsionmo

hailin0 avatar Apr 20 '23 02:04 hailin0

@hailin0 hi, do you have the V2 connectors Development Guide? I want to develop my own connector based on seatunnel

jonsey888 avatar Apr 24 '23 07:04 jonsey888

I have finished two connector, sqs source connector and iceberg sink connector

bing-h avatar Apr 24 '23 08:04 bing-h

when can we see this feature?

shuitao avatar May 26 '23 02:05 shuitao

when do we can see this feature?

@molsionmo Any progress yet?

liugddx avatar May 26 '23 02:05 liugddx

how can find the iceberg sink connector v2?

vcommon avatar Jun 27 '23 03:06 vcommon

support yet?

DeeeFOX avatar Oct 09 '23 03:10 DeeeFOX

自动seatunnel的引擎的 sink iceberg的功能啥时候可以发布测试？

zengqinchris avatar Nov 24 '23 03:11 zengqinchris

I have finished two connector, sqs source connector and iceberg sink connector

@bing-h upload your code ?

auguszero avatar Mar 19 '24 10:03 auguszero

I have finished two connector, sqs source connector and iceberg sink connector

@bing-h upload your code ?

I'm going to submit my codes, and find someone else have completed the iceberg and sqs connectors in dev branch. You can checkout it.

bing-h avatar Mar 20 '24 08:03 bing-h