maestro
maestro copied to clipboard
Adding Q-LoRA support for Florence-2
Description
Implements QLoRA (4-bit quantization) support for Florence-2 model fine-tuning.
List any dependencies that are required for this change.
Related Issue
Fixes #108
Type of change
Please delete options that are not relevant.
- [✅] New feature (non-breaking change which adds functionality)
How has this change been tested, please provide a testcase or example of how you tested the change?
Will be uploading the testing scripts in the next commits
Docs
- Will update in the next commits
hey @SkalskiP!
do review this PR and let me know incase of any additional things I need to take care of. I will be adding some tests and updating docs too once you approve!