rill
rill copied to clipboard
Prompt if file format can not be detected using the user's glob pattern
Currently if I provide this glob pattern : gs://<bucket>/<path>/**/*.gz the source yaml generated is as follows:
type: source
connector: "duckdb"
sql: "select * from 'gs://<bucket>/<path>/**/*.gz'"
DuckDB can't auto detect the format of the file using this glob pattern. The error msg generated is also cryptic:
Catalog Error: Table with name gs://<bucket>/<path>/**/*.gz does not exist! Did you mean "pg_settings"?
If a file format can't be detected UI should nudge user to add file extension in the glob pattern.
Note: our form library SuperForms only comes built-in with errors, not warnings. Further, warnings are tricky with our current form validation library Yup, but easier with Zod.
We should:
- Migrate to Zod
- Reach out to SuperForms to see how they recommend integrating Zod's native warning capability