Kundan Krishna

> @008karan @Palang2014 How are you getting the model to run on a GPU? Even with a GPU available, I'm only able to run on CPU. Mostly interested in running...

I was running OPT and I got the same error. https://www.colossalai.org/docs/advanced_tutorials/opt_service/ mentions server.sh but where is the server.sh file?

I also got the same error. @jonataslaw's fix works for me. Although I am not sure what impact it would have on speed of the code.

The error also goes away for me if I use adamw_8bit instead of paged_adamw_8bit as the optimizer