unslothai
How can I use Unsloth Pro for Multi GPU?
I want to train with 8xA100 and I want to use the Unsloth library. I wrote to the support team on the Unsloth site. I did not receive a response. Can you help?
Hi there we've been receiving a lot of tickets so apologies on the delay in responses. Yes, we will be distributing multiGPU support hopefully in early August. We'll let everyone know when this gets released! Thank you!!
Hi, is there progress for it? And does open version support multiple gpu? @shimmyshimmer
Hi there everyone. No, MultiGPU has not been released yet and it is still underway. Please be patient. Apologies for the delays!
Just to clarify, does the paid API have multiGPU support? I need to train about 100 LORAs and want to do it as quick as possible
Just to clarify, does the paid API have multiGPU support? I need to train about 100 LORAs and want to do it as quick as possible
We don't have an API as of yet but are working on it.
MultiGPU will be later available for everyone to use.
Sorry, my bad. I meant the paid version of unsloth. I have to train 100 LORAs asap and the unsloth website mentions the paid version is 10x faster.
Hey all, I was wondering when we could expect multi-gpu support? Thank you!!
+1 Will it be free? Is it paid? what's the update on multi GPU training as 1 GPU is kind of limiting for the LLMs
@alaap001 @pandayummy @CDog94 @DaddyCodesAlot @kadirnar @mahiatlinux @xudou3 @NiuBlibing
We're working on it. Should be released soon. meanwhile have you tried accelerate?
merging this thread with https://github.com/unslothai/unsloth/issues/2435 Feel free to leave your comments and follow up questions there
thank you!
