unsloth icon indicating copy to clipboard operation
unsloth copied to clipboard

Published 20 hours ago • verified publisher icon unslothai

Use of the second GPU

Open brand17 opened this issue 1 year ago • 1 comments

I tried to train Mistral with this example: https://www.kaggle.com/code/danielhanchen/kaggle-mistral-7b-unsloth-notebook

As far as I understand - it utilizes one GPU only. Is it possible to utilise the both GPUs?

brand17 avatar May 11 '24 14:05 brand17

Currently no sorry

danielhanchen avatar May 13 '24 10:05 danielhanchen

@danielhanchen Just to confirm is there no way to use multi GPU for training? It seems that there is some DDP stuff mentioned in the README but couldn't find anything else

aflah02 avatar Jun 18 '24 07:06 aflah02

@brand17 any updates ?

jhangmez avatar Oct 18 '24 07:10 jhangmez

We're on it. Wil be slated for release later this year.

shimmyshimmer avatar Oct 18 '24 07:10 shimmyshimmer