Hyeongmin Moon

icon indicating an email [email protected]

icon company Growdle icon location Seoul, Gangnam gu, South Korea icon location POSTECH, South Korea AI Engineer at Growdle

Results 2 issues of Hyeongmin Moon

single gpu 6.7b lora CUDA OOM with A6000 48G

4 comment

I am trying to run DeepSpeed-Chat Example with single gpu, Nvidia A6000 48G. I could run all 3 steps well using 1.3b example. But when I run `single_gpu/run_6.7b_lora.sh`, I got...

question
deespeed chat

Fixed typo for --only_optimize_lora

I found a little of typo on some documetations&codes `--only_optimizer_lora` for `--only_optimize_lora`. So I fixed all the files. Thank you.