Shuaichen Chang

icon indicating an email [email protected]

icon company The Ohio State University icon location I am a research at AWS. I work on LLMs, RAG, and tabular data.

Results 2 issues of Shuaichen Chang

Add text-to-sql evaluation metrics

3 comment

Add text-to-sql evaluation metrics # Overview This PR is the first of three PRs to add text-to-sql evaluation metrics. 1. Add exact set match accuracy and execution accuracy metrics, and...

require the in replace value not to be part of other tokens

The previous implementation may raise errors when table names and column names contain the substring "value".