axolotl icon indicating copy to clipboard operation
axolotl copied to clipboard

Published 20 hours ago • verified publisher icon OpenAccess-AI-Collective

MLX Support

Open fakerybakery opened this issue 1 year ago • 2 comments

Hi, It would be great to have MLX support in Axolotl. MLX has been shown to be able to quickly and efficiently finetune many LLMs, including 7B LLMs on consumer hardware. Thank you!

(edit: update)

fakerybakery avatar Jan 14 '24 02:01 fakerybakery

These will be helpful

https://github.com/philipturner/metal-flash-attention

https://github.com/ml-explore/mlx/issues/129

winglian avatar Jan 14 '24 14:01 winglian

Since #1264 is merged, should I close this issue or are there plans to implement MLX support in the future (since MLX can be much faster)?

fakerybakery avatar Feb 12 '24 17:02 fakerybakery