fairseq2
fairseq2 copied to clipboard
Clean up and extend the LoRA API
The current LoRA API is not feature complete per our internal design doc. In particular, loading and saving LoRA adapters is not supported at the moment. Revise the current API with the recently-introduced helper tools (e.g. select_parameters()
) and add the missing features mentioned in the doc.