incubator-uniffle icon indicating copy to clipboard operation
incubator-uniffle copied to clipboard

[Improvement] Independent rust based shuffle server project

Open zuston opened this issue 1 year ago • 6 comments

Code of Conduct

Search before asking

  • [X] I have searched in the issues and found no similar issues.

What would you like to be improved?

I hope the rust based shuffle-server could be as a independent project, like the paimon-rust? I don't hope the rust CI/release blocked the master branch development. BTW, the independent project will speed up the release and development.

BTW, I think I will devote this in the next months. I'm always optimizing this in my forked branch.

How should we improve?

No response

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

zuston avatar Aug 22 '24 12:08 zuston

cc @jerqi @advancedxy .

zuston avatar Aug 22 '24 12:08 zuston

I'm slightly prefer to keep rust code in this repo but have no objection to move it to an independent project. However, if you want to move it to a independent project, I think you should sent a discuss thread to the dev mail list and go through the donation(/ip clearance) process? I'm not sure.

advancedxy avatar Aug 22 '24 13:08 advancedxy

However, if you want to move it to a independent project, I think you should sent a discuss thread to the dev mail list and go through the donation(/ip clearance) process? I'm not sure.

The rust/experimental/server folder currently exists in incubator-uniffle, so I believe we don't need the IP clearance process. What we need to discuss is whether to split it into another project. A natural choice might be incubator-uniffle-rust-server. We can discuss this on the dev list.

Xuanwo avatar Sep 13 '24 11:09 Xuanwo

However, if you want to move it to a independent project, I think you should sent a discuss thread to the dev mail list and go through the donation(/ip clearance) process? I'm not sure.

The rust/experimental/server folder currently exists in incubator-uniffle, so I believe we don't need the IP clearance process. What we need to discuss is whether to split it into another project. A natural choice might be incubator-uniffle-rust-server. We can discuss this on the dev list.

Thanks for your attension about this sub project, the initial motivation of separation is to speed up the whole development of rust-based server. WDYT about this seperation @jerqi @advancedxy .

A natural choice might be incubator-uniffle-rust-server. We can discuss this on the dev list.

The project name is OK for me. If OK for other PMCs, I think I could discuss this in the mail list

zuston avatar Sep 18 '24 08:09 zuston

However, if you want to move it to a independent project, I think you should sent a discuss thread to the dev mail list and go through the donation(/ip clearance) process? I'm not sure.

The rust/experimental/server folder currently exists in incubator-uniffle, so I believe we don't need the IP clearance process. What we need to discuss is whether to split it into another project. A natural choice might be incubator-uniffle-rust-server. We can discuss this on the dev list.

Thanks for your attension about this sub project, the initial motivation of separation is to speed up the whole development of rust-based server. WDYT about this seperation @jerqi @advancedxy .

A natural choice might be incubator-uniffle-rust-server. We can discuss this on the dev list.

The project name is OK for me. If OK for other PMCs, I think I could discuss this in the mail list

Why will the separation speed up the whole development? The other separation projects will rely different release lifecycles.

jerqi avatar Sep 18 '24 09:09 jerqi

I hope I could get the push/merge privillege for the independent sub-project, that will make me to speed up the commit/develop for me

zuston avatar Sep 18 '24 09:09 zuston