ibis
ibis copied to clipboard
ibis-project
the portable Python dataframe library
Also simplifies the implementation of Column.topk() and makes it re-use the implementation of Table.topk() This does NOT fix `column.unnest().topk(by=)`. This is a rare case so I decided to just punt...
Hello, I am not sure whether this is an issue or a feature request, but here is a recent challenge I encountered building some workflows with ibis. I would like...
A fresh attempt at solving https://github.com/ibis-project/ibis/issues/10703. So far, I only added support for Deferreds. Still working to support `lambda left, right: ...`.
## Description of changes - Follow-up on #11071 - Forward kwargs in `create_table` method to respective pyspark methods - [pyspark.sql.DataFrameWriter.saveAsTable](https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/api/pyspark.sql.DataFrameWriter.saveAsTable.html#pyspark.sql.DataFrameWriter.saveAsTable) if `obj` is passed or [pyspark.sql.Catalog.createTable](https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/api/pyspark.sql.Catalog.createTable.html#pyspark.sql.Catalog.createTable) if `schema` is passed....
## Description of changes Add a specific visit method for RisingWave visit_StructField. "f{idx}" is not supported like in Postgres. Use dot and parenthesis annotation as dots only is not working...
The sqlite_attach() approach is deprecated per https://duckdb.org/docs/stable/extensions/sqlite.html, and the newer syntax opens up read only flag, specifiying a name for the attachment, and not overwriting tables that already exist. This...
### Is your feature request related to a problem? ## issue: `Schema.to_sqlglot()` The semantics of `.to_sqlglot()` are a bit confusing. I expected the output to be a [sqlglot.schema.Schema](https://sqlglot.com/sqlglot/schema.html#MappingSchema) type with...
### What happened? The order_by clause is preserved in `group_by().agg()`, but not in `group_by().mutate()`. ```python import ibis t = ibis.memtable( [ (1, 2, "a"), (1, 1, "b"), (2, 5, "c"),...
Before, `t.mutate(t.x.first(ignore_nulls=True).over(group_by=y))` would behave the same as `t.mutate(t.x.first(ignore_nulls=False).over(group_by=y))`. Now they behave differently for some backends. I discovered this when implementing https://github.com/ibis-project/ibis/pull/11308 I am seeing what CI says before updating the...
Fixes https://github.com/ibis-project/ibis/issues/11307 Probably a bunch of other backends will fail this test, when I see which ones I'll add them. Maybe I could solve this in a better way, but...