autoprompt icon indicating copy to clipboard operation
autoprompt copied to clipboard

Is there the code for downstream task in this project?

Open Claymore715 opened this issue 2 years ago • 2 comments

to compare the efficiency between manual prompt and autoprompt

Claymore715 avatar May 09 '22 01:05 Claymore715

for example,how to test the performance for task Sentiment Analysis

Claymore715 avatar May 09 '22 01:05 Claymore715

For evaluation of prompts for fact retrieval and relation extraction, refer to this section of the README. For the other tasks, you'll have to write some code that will load the eval dataset (SST-2 or SICK-E), append the trigger tokens, feed the full prompt into the LM, and score the results.

taylorshin avatar May 09 '22 17:05 taylorshin