huggingface
Add new method: GLoRA
Feature request
See: https://github.com/Arnav0400/ViT-Slim/tree/master/GLoRA
Motivation
See: https://github.com/Arnav0400/ViT-Slim/tree/master/GLoRA A new method for PEFT
Your contribution
Could be
Hi @HsunGong, will you be working on contributing GLoRA? I would like to work on it as well!
@younesbelkada @BenjaminBossan I would like to work towards adding this to peft.
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
This was adressed in https://github.com/huggingface/peft/pull/2568 but wasn't completed. To quote @not-lain:
imo the only good thing to retain from this pr [#2568] is the config file, other scripts are too messy and unusable.
Therefore this is now open again and contributions are welcome. I think it's a good idea to take the config file as suggested and start from there. Some other things from that PR can probably be salvaged as well.
Hey @githubnemo , I would like to take this up this weekend. Whats the closet to GLoRA peft method that i can use for reference?
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.