hyper-api-samples icon indicating copy to clipboard operation
hyper-api-samples copied to clipboard

does hyper support reading multiple files from the same folders

Open djouallah opened this issue 1 year ago • 1 comments

is this supposed to work ?

create table "region" as (select * from ('./region/*.parquet') );

djouallah avatar Mar 20 '23 23:03 djouallah

no, globs don't current work.

You can use array syntax instead

create table "region" as select * from external(array['./region/1.parquet', './region/2.parquet']);

However that requires an explicit list of file names. glob syntax is currently not natively supported in Hyper, but you can combine it with Python and use Python to create that list

vogelsgesang avatar Mar 21 '23 18:03 vogelsgesang