SlimTrainer icon indicating copy to clipboard operation
SlimTrainer copied to clipboard

Thanks, Colab :)

Open amrrs opened this issue 2 years ago • 1 comments

Thanks for the code,

Is there any tweak we can do to fit it in Google Colab (~15 GB Memory)

or should I just settle with QLoRA?

amrrs avatar Oct 05 '23 12:10 amrrs

You won't be able to fit a 7B model, but you might be able to fit a 3B model such as StableLM 3B

euclaise avatar Oct 05 '23 12:10 euclaise