data-juicer icon indicating copy to clipboard operation
data-juicer copied to clipboard

Improve GPU utilization in ray mode

Open pan-x-c opened this issue 6 months ago • 0 comments

Search before continuing 先搜索,再继续

  • [x] I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。

Description 描述

In the current version of Data-Juicer, operators in ray mode cannot fully utilize the GPU resources of the cluster. Specifically, GPU resources are shared by all operators, resulting in each operator being unable to utilize the resources of the entire cluster during operation.

We can try to collocate the models required by multiple operators on the same GPU through Ray PlacementGroup to improve parallelism.

Use case 使用场景

No response

Additional 额外信息

No response

Are you willing to submit a PR for this feature? 您是否乐意为此功能提交一个 PR?

  • [ ] Yes I'd like to help by submitting a PR! 是的!我愿意提供帮助并提交一个PR!

pan-x-c avatar May 12 '25 09:05 pan-x-c