keras-io icon indicating copy to clipboard operation
keras-io copied to clipboard

Correct LoRA weights merging

Open BastienHot opened this issue 1 year ago • 2 comments
trafficstars

Correction of the merging code between the model's original layer weights and the LoRA model weights. This respect the principle of LoRA to dispose of the LoRA layers once we don't plan on training it more bur more importantly allows us to save and load the model as a ".keras" file.

BastienHot avatar Mar 09 '24 18:03 BastienHot