Yilin Gao

icon indicating an email [email protected]

icon company University of Southern California icon location Los Angeles icon location Ph.D. in Computational Biology and Bioinformatics @ USC

Results 1 issues of Yilin Gao

falcon-40b out of memory

13 comment

Hi! I am trying to finetne falcon-40b with a single A100 GPU of 80GB memory. I tried with decreasing the micro batch size to be 1 however it is still...

question