mlx-examples
mlx-examples copied to clipboard
ml-explore
Examples in the MLX framework
I have been using the new Command-R+ model in 4-bit mode and consistently observe a drop in GPU utilization immediately after prompt evaluation, as it begins generation/prediction. This leads to...
The code presented here is derived from the original `lora.py` file, with minimal modifications. The primary addition is the inclusion of full fine-tuning functionality, while preserving the core structure of...
https://github.com/facebookresearch/schedule_free
https://github.com/stanfordnlp/pyreft uses flash attn and pyvene (https://github.com/stanfordnlp/pyvene) but don't see any specific kernels aside from flashattn. tried this on my cuda machine and it's neat - not sure how effective...
I would like to know if there will be support for the chatglm series of models, such as chatglm3-6b. This model is somewhat different from llama, and it would be...
I've been trying to convert Jamba into MLX for more efficient training and usability but am having a difficult time. My specialty is in the training/datasets world and not the...
Hi MLX team, Just read about a new way to Finetune, seem promising:   https://twitter.com/Rui45898440/status/1772996453557997924 Paper: https://huggingface.co/papers/2403.17919 Code: https://github.com/OptimalScale/LMFlow
