test-suite-sql-eval
test-suite-sql-eval copied to clipboard
taoyds
Semantic Evaluation for Text-to-SQL with Distilled Test Suites
## Problem: Adding an alias to a projection in the SELECT clause is a pretty standard syntax: ``` SELECT count(*) AS table_size FROM Table ``` However, the evaluator breaks when...
As can be seen in [this link](https://dba.stackexchange.com/questions/95765/alias-using-as-and-without-using-as), both cases: ``` SELECT * FROM Table AS t ``` ``` SELECT * FROM Table t ``` are valid in many SQL versions,...
Hi. Thank you so much for your work. Besides this, you also have another [evaluation code](https://github.com/taoyds/spider/blob/master/evaluation.py) on the [spider repo](https://github.com/taoyds/spider/tree/master). Some people have experienced different results, like in this [issue](https://github.com/MohammadrezaPourreza/Few-shot-NL2SQL-with-prompting/issues/7#issuecomment-1571228848)....
Hi, many thanks in advance! I'm trying to create a new and complex NL2SQL dataset, however the eval does not seem to support inner join. What should I do except...
The previous implementation may raise errors when table names and column names contain the substring "value".
I encountered an issue while using your project. The problem arises because the pred results differ between Windows and Linux systems. ### Description Gold SQL: ``` SELECT YEAR FROM concert...
### Problem: Would it be possible to add support for `UNION ALL`? Since it's quite common in sql queries. ### Reproduce: here's my gold file, btw the script works well...
This test method seems not very stable, it might get stuck after running for a while, but if you run it multiple times, the test might eventually complete. What could...
