BioGPT icon indicating copy to clipboard operation
BioGPT copied to clipboard
verified publisher icon microsoft

Can I run the pretrained-model with CPU only cluster

Open jianglch opened this issue 1 year ago • 1 comments

Dear BioGPT authors, Can I run the pretrained large BioGPT model with CPU only cluster? If so, how? I didn't see any relevant information. Thanks! Lichun

jianglch avatar Feb 29 '24 05:02 jianglch

By commenting out m.cuda() and Half relevant code. Large BioGPT model is running for CPU only server.

jianglch avatar Mar 12 '24 05:03 jianglch