sergeykochetkov

[Model] LoRA with lm_head fully trained

2

FIX #4186 #2816 **Support lm_head and embed_tokens fully trained in LoRA.** We found that quality of our adapters significantly drops without fully-trained lm_head or lm_head trained in LoRA style. This...