Add Late Prompt Tuning

[jackapbutler]

Overview

Late Prompt Tuning: A Late Prompt Could Be Better Than Many Prompts has shown that prompt tuning can sometimes be more effective if the prompt generation is placed closer to the output signal in the later layers of the transformer architecture.

I think this would be a nice addition to the existing techniques in peft.

Task

1. Understand Late Prompt Tuning: A Late Prompt Could Be Better Than Many Prompts
2. Integrate the method into peft
3. Benchmark and test it against other methods in the repository

(happy to consider doing this issue myself if possible)

[pacman100]

Hello @jackapbutler, PR for integrating Late Prompt Tuning is welcome. Looking forward to it 😄.

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.