ibis
ibis copied to clipboard
the portable Python dataframe library
> You should be able to avoid the extra compute here by doing a `map_partitions` call of a function that applies the `between` operation below. This will avoid excess compute...
> dask has built in covariance and correlation methods, why are they not sufficient here/why do we need to compute? > > IMO anything that needs to compute like this...
> I need this to concatenate the window results, after joins and for offset. I agree that we should avoid where we can. _Originally posted by @kszucs in https://github.com/ibis-project/ibis/pull/8005#discussion_r1475062816_
When possible, it's better to use top-level functions instead of lambdas for cheaper pickling of tasks. This is probably negligible here, but it's good to keep in mind. _Originally posted...
### What happened? When trying to do an operation on a geospatial literal object, it fails due to missing "spatial" extension. Tried creating a connection, and loading the extension, but...
**Acceptance criteria**: Adding new backends for the core Ibis team is not a priority, but we will support new backends from the community or organizations partnering with the Ibis project....
Currently `ibis` supports `create_table` for creating (or replacing) a table, and `insert` for inserting new data into a table. Another common operation is `upsert`, which is supported by some backends....
### What happened? xref #8137 ```python [ins] In [1]: from ibis.interactive import * [ins] In [2]: con = ibis.duckdb.connect() t [ins] In [3]: t = con.read_parquet( ...: "ci/ibis-testing-data/parquet/functional_alltypes.parquet", ...: table_name="alltypes",...
### Is your feature request related to a problem? In several places in my app, I have a 1:many relationship, and I want the manys to be rolled up into...
### Is your feature request related to a problem? Inspired by https://github.com/ibis-project/ibis/issues/8110 I use duckdb for local analysis and processing and a hosted postgres to house our production data. I...