Add support for Pfeiffer adapters to fairseq models

[bhavitvyamalik]

🚀 Feature Request

Are there any examples or implementation of Pfeiffer Adapters in fairseq models? I'm exploring efficient ways of finetuning model and wanted to include adapters in fairseq models. How can I add them to any model? If possible I'd like to add a standalone adapter module which anyone can add to any fairseq model. Is this possible? Can someone please guide me on this? Thank you!

[VarunGumma]

Hi @bhavitvyamalik, I have a clone of fairseq that implements adapters. Feel free to use it, and if you face any issues or want more features, open a pull request, and I will merge it.