test-suite-sql-eval
test-suite-sql-eval copied to clipboard
Classical Evaluation code cannot run
I have tried on my macos laptop and a centos server with your classical evaluation code. It returns TypeError: cannot unpack non-iterable coroutine object in the classical_evaluation.py code. The problem seems to be caused by the multiprocess module in the code.
Same issue @PosoSAgapo @taoyds @ruiqi-zhong Does anybody know the fix?
I'm having the same issue.
Any resolutions yet?
have the same issue too ,evaluate_classical_test2.py:64: RuntimeWarning: coroutine 'exec_on_db' was never awaited flg, gold_result = exec_on_db(testcase_path, gold_query, timeout=GOLD_TIMEOUT) RuntimeWarning: Enable tracemalloc to get the object allocation traceback 0%| | 0/196 [00:00<?, ?it/s] multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/home/anaconda/envs/RESDSQL/lib/python3.8/multiprocessing/pool.py", line 125, in worker result = (True, func(*args, **kwds)) File "evaluate_classical_test2.py", line 64, in judge flg, gold_result = exec_on_db(testcase_path, gold_query, timeout=GOLD_TIMEOUT) TypeError: cannot unpack non-iterable coroutine object
I Just mad a quick fix:
https://github.com/taoyds/test-suite-sql-eval/pull/22