state-of-open-source-ai icon indicating copy to clipboard operation
state-of-open-source-ai copied to clipboard

Published 20 hours ago • verified publisher icon premAI-io

Adding Parameter efficient Fine-tuning techniques for LLM

Open Anindyadeep opened this issue 2 years ago • 0 comments

Type

new chapter

Chapter/Page

fine-tuning

Description

The contents on this chapter should be the following:

  1. What is Parameter efficient fine-tuning methods and why we do it.
  2. Different PEFT methods: a. Prompt Tuning b. LoRA c. QLoRA etc

Anindyadeep avatar Oct 30 '23 14:10 Anindyadeep