Specify which device to run on

Open delalamo opened this issue 2 months ago • 2 comments

Currently Boltz does not provide a way to specify which device to run on when multiple GPUs are available. This backward-compatible pull request addresses that by allowing the user to pass either an int, which is currently the default and communicates how many devices to run, or a comma-separated list, which specifies which devices to run on. A single device can be specified by passing --devices 1,.

Oct 25 '25 09:10 delalamo

Hi Diego, thank you for suggesting the change! Could you add some documentation to the inference docs to explain the updated usage of the parameter?

Oct 25 '25 14:10 gcorso

Sounds good, adding this now to prediction.md, let me know if it should go anywhere else.

Oct 26 '25 12:10 delalamo