align_sd icon indicating copy to clipboard operation
align_sd copied to clipboard

Published 20 hours ago • verified publisher icon tgxs002

accelerate config

Open gcxamy opened this issue 1 year ago • 2 comments

Thanks for your excellent work! I wonder know how you set your accelerate config , like if you use deepspeed .since I tried to use it, but unfortunately I failed. I would be grateful if you could answer my question!

gcxamy avatar Jul 19 '23 07:07 gcxamy

I train the LoRA model on 4 GPUs, fp16 precision. Other options are left as default. I haven't tried libraries like deepspeed, feel free to share your experience if you find it useful!

tgxs002 avatar Jul 19 '23 08:07 tgxs002

I train the LoRA model on 4 GPUs, fp16 precision. Other options are left as default. I haven't tried libraries like deepspeed, feel free to share your experience if you find it useful!

thanks

gcxamy avatar Jul 20 '23 03:07 gcxamy