Add cudf-polars option to control rapidsmpf Shuffle insertion method

Open TomAugspurger opened this issue 5 months ago • 5 comments

Description

rapidsmpf's Shuffler has two methods for inserting chunks into the shuffler:

This adds a new option, shuffler_insertion_method, to the streaming executor config to control which method is used. The default behavior is unchanged (uses insert_chunks).

Aug 08 '25 16:08 TomAugspurger

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

Aug 08 '25 16:08 copy-pr-bot[bot]

/ok-to-test e4af550

Aug 08 '25 18:08 TomAugspurger

/ok-to-test 39e1864

Aug 08 '25 20:08 TomAugspurger

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Nov 14 '25 18:11 copy-pr-bot[bot]

/ok to test 7d8e21

Nov 14 '25 21:11 TomAugspurger

/merge

Dec 12 '25 20:12 TomAugspurger