Finetuning Quantized LLaMA

[Qifeng-Wu99]

Hello,

I really appreciate your work done here.

I wonder if you could also release a python script on finetuning quantized LLaMA on a customized dataset.

It is inevitable that quantization would damage performance, while finetuning could make the model perform better on a user-desired dataset.

Thank you.