Kedarnath Chimmad

icon location San Jose, CA icon location MS Student @ UMass Amherst | X-Data Engineer @ Shell

Results 1 issues of Kedarnath Chimmad

TypeError: pass_k int not iterable in evaluate.py

2 comment

Hi, Here is the command I am using: `bigcodebench.evaluate --execution local --split complete --subset full --samples /scratch3/workspace/wenlongzhao_umass_edu-reason/dev_kedar/Small-LLM-Reasoning/scratch/notebooks/output.jsonl --pass_k "1"` I was trying to locally evaluate the results, and I used...