remora
remora copied to clipboard
Multiple GPU device
Hi @marcus1487 ,
I was wondering is it possible to specify multiple GPU devices for Remora during training? like --device 0 1 2
Thanks, Vahid
This is not currently possible, but would likely not be too large a change to the code as it is simply using the pytorch backend. This is not a huge priority internally though as the models generally train very quickly (on the order to an hour or 2 a the most).
Thanks a lot @marcus1487