Phillip Cloud
Phillip Cloud
Can you run the query **without** Ibis? I.e., using only the `duckdb` module (and `fsspec`)? That way we can rule out Ibis here. Ibis doesn't do anything with creds/auth/fsspec except...
This is reproducible with just the duckdb CLI in a public bucket: ``` D select version(); ┌─────────────┐ │ "version"() │ │ varchar │ ├─────────────┤ │ v1.1.2 │ └─────────────┘ D select...
I tried with both an older duckdb and older ibis and am still seeing the all or none behavior.
@Mytherin Much appreciated! @rapatel0 I'll investigate this, since the default behavior in Ibis should be `bernoulli`.
I can't reproduce this on `main`, and we're compiling in `bernoulli` to the SQL: ``` In [1]: from ibis.interactive import * In [2]: t = ibis.read_csv("https://storage.googleapis.com/ibis-tutorial-data/penguins.csv") In [3]: ibis.to_sql(t.sample(0.1)) Out[3]:...
Is this PR still viable?
It looks like we're not handling the single partition case here. Can you try putting the partition expression in a `list`, like `["DATE_TRUNC(c1, MONTH)"]`? Long term, we'll continue to support...
I haven't started working on this yet, but I should be able to get to it for the next release (10.0).
Yep, the thing that doesn't work (reported in the OP) is passing a more complex expression for partitioning.