Ethan Kim

initial commit for trlx LORA support

10

Basic support for low rank adaptation.

Add LORA support to TRLX

1

### 🚀 The feature, motivation, and pitch LORA and other parameter-efficient methods can provide a number of advantages when finetuning large language models. These methods typically only update a small...

I no longer see the application available https://serverlessrepo.aws.amazon.com/applications/arn:aws:serverlessrepo:us-east-1:289559741701:applications~cw-logs-to-slack

Support and additional type of parameter efficient method from OpenDelta: One key consideration for getting dense representations from such a model is to only mean pool the hidden state representations...