Eros1on-Aqua

Results 2 comments of Eros1on-Aqua

> Hi, > > > When I use the command on 8 gpus: > > ``` > python3 qalora.py --model_path $llama_7b_4bit_g32 > ``` > > it will show the error:...

Has it been resolved? My loss is also like this, it has never converged.