MPNET model not supported for LORA/sequence classification

[sagarneeldubey]

Hi! We are using MPNET based sentence transformer model to do sequence classification, as the model has turned out to be powerful, yet being relatively medium sized. We want to wrap it in PEFT/LORA as we typically allow users to save their own checkpoints for various downstream tasks, something that is causing us to store large models over and over. We hope that peft will greatly benefit us in this regard. Are you planning to support MPNET in near future? Happy to contribute to open source if you give me pointers on how to proceed!

Thanks for the great job!