metaseq icon indicating copy to clipboard operation
metaseq copied to clipboard
verified publisher icon facebookresearch

Downstream task evaluation

Open ofirpress opened this issue 3 years ago • 3 comments

Hi! Is the code for downstream task evaluation public? I see that some of the issues here refer to fairseq.eval.gpt3_eval but I can't actually find that code here.

If it's not public, are there any plans to release this? Thanks!

ofirpress avatar May 20 '22 03:05 ofirpress

What downstream task are you trying to solve?

SagarBansal7 avatar May 23 '22 15:05 SagarBansal7

@ofirpress Hi! Yes, there are efforts to split out the evaluation code and potentially release them separately, though no specific ETA on this right now.

suchenzang avatar May 24 '22 03:05 suchenzang

Is there an evaluation code now? I also have trouble on zero-shot and few-shot

Hdiao112 avatar Aug 08 '23 08:08 Hdiao112