rill icon indicating copy to clipboard operation
rill copied to clipboard

Prompt if file format can not be detected using the user's glob pattern

Open k-anshul opened this issue 8 months ago • 1 comments

Currently if I provide this glob pattern : gs://<bucket>/<path>/**/*.gz the source yaml generated is as follows:

type: source

connector: "duckdb"
sql: "select * from 'gs://<bucket>/<path>/**/*.gz'"

DuckDB can't auto detect the format of the file using this glob pattern. The error msg generated is also cryptic:

 Catalog Error: Table with name gs://<bucket>/<path>/**/*.gz does not exist! Did you mean "pg_settings"?

If a file format can't be detected UI should nudge user to add file extension in the glob pattern.

k-anshul avatar Apr 03 '25 07:04 k-anshul

Note: our form library SuperForms only comes built-in with errors, not warnings. Further, warnings are tricky with our current form validation library Yup, but easier with Zod.

We should:

  1. Migrate to Zod
  2. Reach out to SuperForms to see how they recommend integrating Zod's native warning capability

ericpgreen2 avatar Apr 14 '25 14:04 ericpgreen2