Inquiry on Inserting P-Tuning Soft Prompts at Any Position in Input

[Betty1202]

System Info

None

Who can help?

No response

Information

• [X] The official example scripts
• [ ] My own modified scripts

Tasks

• [X] An officially supported task in the examples folder
• [ ] My own task or dataset (give details below)

Reproduction

None

Expected behavior

How to insert P-tuning soft prompt into the input at any position (not just the beginning). As mentioned in your document at https://huggingface.co/docs/peft/main/en/package_reference/p_tuning, "The prompt tokens can be added anywhere in the input sequence." However, I didn't find any parameters in PromptEncoderConfig or PromptEncoder that can be set for this purpose. Could you please advise on how to set this up?

[BenjaminBossan]

Ping @pacman100.

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.