OpenLLM
OpenLLM copied to clipboard
tracking: Fine-tuning support
Feature request
This ticket keeps track of implementation support for each of the adapter type for models under OpenLLM:
- OPT: Lora
- Dolly-v2: wip
- Flan-T5: wip
- Falcon: Lora, Qlora
- Starcoder: wip
- ChatGLM: wip
- stablelm: wip
This is on progress with #52
#98 provides support for Falcon fine-tuning