swift icon indicating copy to clipboard operation
swift copied to clipboard

Support unsloth for accelerating lora finetuning and decreasing memory consumption

Open thincal opened this issue 3 months ago • 0 comments

Describe the feature Unsloth currently supports the LLaMA, Mistral and Yi models, and can achieve 170% speed boosting (result from LLaMA-Factory)

Paste any useful information Unsloth: https://github.com/unslothai/unsloth

Additional context Add any other context or information here(其他信息可以写在这里)

thincal avatar Apr 01 '24 04:04 thincal