seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Discuss][Zeta] Support pekko as new distributed service framework

Open hailin0 opened this issue 11 months ago • 13 comments

Search before asking

  • [X] I had searched in the feature and found no similar feature requirement.

Description

Currently we use hazelcast as the distributed service framework, but we found some problems:

pekko

  • https://pekko.apache.org/

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

hailin0 avatar Jan 01 '25 13:01 hailin0

Do you have any suggestions? @Hisoka-X

hailin0 avatar Jan 01 '25 13:01 hailin0

+1 for pekko. cc @apache/seatunnel-committers

Hisoka-X avatar Jan 02 '25 05:01 Hisoka-X

+1. Sounds good.

liugddx avatar Jan 02 '25 05:01 liugddx

This is another option https://github.com/ray-project/ray

liugddx avatar Jan 02 '25 06:01 liugddx

+1

dailai avatar Jan 02 '25 08:01 dailai

+1

zhangshenghang avatar Jan 02 '25 13:01 zhangshenghang

+1, Based on my understanding of pekko, this is a very large project

caicancai avatar Jan 03 '25 02:01 caicancai

+1

Xuxiaotuan avatar Jan 03 '25 02:01 Xuxiaotuan

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

github-actions[bot] avatar Feb 03 '25 00:02 github-actions[bot]

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

github-actions[bot] avatar Feb 18 '25 00:02 github-actions[bot]

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

github-actions[bot] avatar Mar 02 '25 00:03 github-actions[bot]

It seems the first step is to decouple SeaTunnel from Hazelcast by extracting a small interface layer. cc @zhangshenghang @davidzollo

dybyte avatar Dec 02 '25 08:12 dybyte

It seems the first step is to decouple SeaTunnel from Hazelcast by extracting a small interface layer. cc @zhangshenghang @davidzollo

Yes, this function is a relatively major change. It needs to have a thorough plan demonstration before starting. @dybyte

zhangshenghang avatar Dec 04 '25 06:12 zhangshenghang