litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard
verified publisher icon Lightning-AI

Plans on integrating qlora 4bit finetuning?

Open lppllppl920 opened this issue 2 years ago • 0 comments

My understanding is currently the repo provides 4bit only for inference but not finetuning. If this is the case, is there a plan for integrating QLoRA-style 4bit finetuning?

lppllppl920 avatar Jun 07 '23 17:06 lppllppl920