duckdb-wasm icon indicating copy to clipboard operation
duckdb-wasm copied to clipboard

Glob partitioning causes wasm exception

Open danthegoodman1 opened this issue 1 year ago • 4 comments

What happens?

When using the query SELECT count(*) FROM read_parquet('s3://ookla-open-data/parquet/performance/type=fixed/year=2022/quarter=1/*.parquet', HIVE_PARTITIONING = 1, filename=true); in the wasm shell, it throws an exception. This query runs fine in python duckdb.

To Reproduce

duckdb> SELECT count() FROM read_parquet('s3://ookla-open-data/parquet/performance/type=fixed/year=2022/quarter=1/.parquet', HIVE_PARTITIONING = 1, filename=true);

Invalid Error: [object WebAssembly.Exception]

Browser/Environment:

Chrome 110

Device:

mbp 2019 16inch

DuckDB-Wasm Version:

SELECT count() FROM read_parquet('s3://ookla-open-data/parquet/performance/type=fixed/year=2022/quarter=1/.parquet', HIVE_PARTITIONING = 1, filename=true);

DuckDB-Wasm Deployment:

shell.duckdb.org

Full Name:

Dan Goodman

Affiliation:

Self

danthegoodman1 avatar May 25 '23 14:05 danthegoodman1

Having this same issue across multiple browsers and deployments.

uadjet avatar May 25 '23 15:05 uadjet

I want to echo that I'm having the same problem. Any plan to fix this?

murrayju avatar Aug 05 '23 19:08 murrayju

I think this is related to https://github.com/duckdb/duckdb-wasm/issues/1040

rickiesmooth avatar Aug 25 '23 09:08 rickiesmooth

This would be great to get working - I'm happy to help where I can. If the issue is with the httpfs extension, is this something that the upcoming updates to extension loading will affect? Any hints would be appreciated so I know where to start poking. @carlopi

carstonhernke avatar Aug 28 '23 15:08 carstonhernke