How do the prefix parameters of prefix_tunning initialize?

[LRY1994]

Hello! How do the prefix parameters of prefix_tunning initialize? with random initialization ? or real words ? How could I initialize the prefix parameters on my own ?

[calpt]

Hey, the prefix tuning parameters are initialized randomly by default. You can access the parameters using model.get_adapter("prefix_tuning_name") (docs) after initialization to overwrite the initial weights on your own.

[adapter-hub-bert]

This issue has been automatically marked as stale because it has been without activity for 90 days. This issue will be closed in 14 days unless you comment or remove the stale label.

[adapter-hub-bert]

This issue was closed because it was stale for 14 days without any activity.