Dan Saattrup Smart

Results 240 comments of Dan Saattrup Smart

Results live on the leaderboards now 🎉

Bug: ```sh /tmp/tmp7p3o_cao/main.c:5:10: fatal error: Python.h: No such file or directory 5 | #include | ^~~~~~~~~~ compilation terminated. /tmp/tmpeapxn7ht/main.c:4:10: fatal error: Python.h: No such file or directory 4 | #include...

Live on the leaderboards now 🎉

Bug: ```sh [rank0]: Traceback (most recent call last): [rank0]: File "/home/ubuntu/.venv/bin/scandeval", line 8, in [rank0]: sys.exit(benchmark()) [rank0]: File "/home/ubuntu/.venv/lib/python3.10/site-packages/click/core.py", line 1157, in __call__ [rank0]: return self.main(*args, **kwargs) [rank0]: File "/home/ubuntu/.venv/lib/python3.10/site-packages/click/core.py",...

Results live on the leaderboards now 🎉

Bug! Same bug as in https://github.com/ScandEval/ScandEval/issues/478.

Results live on the leaderboards now 🎉