OpenPrompt icon indicating copy to clipboard operation
OpenPrompt copied to clipboard

Is there any way I can reproduce the performance of the model consistently?

Open NEMOlv opened this issue 2 years ago • 1 comments

When I was experimenting with prompt learning, I found that the performance of the model was very unstable, with performance fluctuating from high to low. Is there any way I can reproduce the performance of the model consistently? I would be grateful if someone could reply!

NEMOlv avatar Jul 10 '22 07:07 NEMOlv

Could you please provide more details? For example, is the performance fluctuating with respect to the choice of templates? Is your experiment conducted under the zero-shot setting?

ningding97 avatar Jul 20 '22 08:07 ningding97