Daft icon indicating copy to clipboard operation
Daft copied to clipboard

[FEAT] Assign CUDA_VISIBLE_DEVICES to actor pools in PyRunner

Open jaychia opened this issue 5 months ago • 2 comments

This PR assigns each actor that is spun up by the Python ActorPoolProject access to only certain GPUs, based on its rank.

TODO: We should handle chains of model inference as well by passing-through an offset of which device to start on.

jaychia avatar Sep 21 '24 23:09 jaychia