mlx-examples
mlx-examples copied to clipboard
Added code for Full fine tune
The code presented here is derived from the original lora.py
file, with minimal modifications. The primary addition is the inclusion of full fine-tuning functionality, while preserving the core structure of the original code. This revised version offers a potential starting point for testing the training process on more powerful Mac devices.
Efforts were made to avoid altering any code within the tuner/*
directory, ensuring that this update does not introduce any conflicts with the legacy codebase.
The code has been successfully tested on a Mac M2 Studio model with 192GB of memory, demonstrating its compatibility with high-performance hardware configurations.