Vikas Pandey

icon company Senior Applied Scientist @Oracle icon location Bangalore, India icon location Senior Applied Scientist @ Oracle, NLP, Generative AI, DL, ML, Data Science | Kaggle Competitions Top 1%

Results 1 comments of Vikas Pandey

Text generation fails on --devices 2

Thanks @carmocca, with `--strategy fsdp` it is able to use both the gpus & run successfully. I notice significant degradation in the tokens/sec for the multi gpu (2 in this...