Yushun Zhang

icon indicating a website link https://zyushun.github.io/

icon location PhD student at the Chinese University of Hong Kong, Shenzhen, China https://zyushun.github.io/

Results 2 comments of Yushun Zhang

A potential bug for multi-GPU training

Hi, I still encounter this issue when using **your latest code on github**. four A800-80GB GPU, AdamW, Tinyllama, all default settings. I did not change anything except the data path....

A potential bug for multi-GPU training

Hi, Thanks for your prompt reply. I think my lightning version is correct. My code is based on a fresh environment created yesterday, where I simply run " pip install...