Daniel Han

icon location San Francisco icon location Unsloth - 2x faster 70% less VRAM finetuning Llama-3.1, Mistral, Gemma-2, Phi-3

Results 781 comments of Daniel Han

What's your opinion on DoRA support in unsloth?

Oh DoRA is technically already supported in Unsloth, albeit the DoRA parts are not optimized. You will get some speedups and memory reductions