litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard

Published 20 hours ago • verified publisher icon Lightning-AI

Phi-3 Full finetuning uses more memory as LoRA finetuning

Open rasbt opened this issue 7 months ago • 0 comments

I observed that Phi-3 full finetuning uses less memory than LoRA (see #1553); as discussed something to look into @Andrei-Aksionov

rasbt avatar Jul 05 '24 17:07 rasbt