SiLLM
SiLLM copied to clipboard
armbues
SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
**Description** I am encountering a dependency conflict when trying to install `sillm-mlx` v0.1.3 in a new conda virtual environment. The library requires `protobuf>=5.26.1`, but my setup includes `protobuf` v4.25.3, which...
For now api not fully compatible with openAI one, it lacks streaming support. I would like to use it with streaming support.This one https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/SERVER.md supports it and has MIT license.
I've modified sillm.chat a lot. Let me know what you would be interested in adding to your repo and I'll put those changes in my fork and do a pull...
Hi @armbues, thank you for this great project. Please add ORPO finetuning to do SFT and DPO in one step https://arxiv.org/abs/2403.07691