TabLLM icon indicating copy to clipboard operation
TabLLM copied to clipboard

Zero-shot inference with t-few does not produce the scores and inferences

Open hansfarrell opened this issue 10 months ago • 1 comments

Hi @stefanhgm,

I am able to run the t-few code to infer all the datasets with any number of shots except 0 shot. Following your instruction, I changed the num_shot to 0 in the .sh file to run the pl_train.py but the output experiment folder does not contain the supposed dev_scores.json and the inferences. It works for the other shots, the issue only happens for zero-shot. I've attached the terminal output when the code is run for your reference. Screenshot 2024-04-20 113030 Screenshot 2024-04-20 113107

hansfarrell avatar Apr 20 '24 03:04 hansfarrell