pytorch-lora
pytorch-lora copied to clipboard
hkproj
LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
https://github.com/hkproj/pytorch-lora/blob/a2bdeadabd4ffcaf99b61d31579b7c8abe3f1af4/lora.ipynb#L459 When I do ``` for name, param in net.named_parameters(): print(name) ``` I got output ``` linear1.bias linear1.parametrizations.weight.original linear2.bias linear2.parametrizations.weight.original linear3.bias linear3.parametrizations.weight.original ``` So it seems that anyways the parametrization...
I really appreciate your tutorial and MNIST code that demonstrates the Lora concept. Would it be possible for you to create a next example using LoraConfig and PeftModel for your...
