text-generation-webui icon indicating copy to clipboard operation
text-generation-webui copied to clipboard

Published 20 hours ago • verified publisher icon oobabooga

Any planned support for unsloth ?

Open risedangel opened this issue 1 year ago • 2 comments

Description I have seen a new tool that promises nice benefits both for the speed and memory usage. Any chance for this to be added in?

Additional Context https://github.com/unslothai/unsloth

risedangel avatar Feb 11 '24 09:02 risedangel

I was also looking forward to it. It really does speed up training, at least from my testing. They also claimed X2 inference speed. Maybe I should ask the maintainer of the training PRO repository

R3xpook avatar Mar 27 '24 09:03 R3xpook

this would be sweet

nick-tonjum avatar Apr 13 '24 01:04 nick-tonjum

This issue has been closed due to inactivity for 2 months. If you believe it is still relevant, please leave a comment below. You can tag a developer in your comment.

github-actions[bot] avatar Jun 12 '24 23:06 github-actions[bot]