Ion Koutsouris

Results 266 comments of Ion Koutsouris

I can look into this for the databricks unity catalog. It's one of the use cases I need to touch at work in a couple months. @houqp @wjones127 is this...

@wjones127 can you clarify what is still needed for this? I can work on it if it's still relevant

> @mohitreddy1996 - if it is about reading delta tables with polars, the methods [read_delta](https://pola-rs.github.io/polars/py-polars/html/reference/api/polars.read_delta.html) and [scan_delta](https://pola-rs.github.io/polars/py-polars/html/reference/api/polars.scan_delta.html) were recently added. > > Beyond that we are also looking into making...

> > Are there still considerations to move to using polars for internal operations that require a query execution engine? > > I don't think we have any plans to...

This is some info on void that I can find in the delta protocol definition: > Note: Existing tables may have void data type columns. Behavior is undefined for void...

@keen85 please make an issue for this upstream: https://github.com/apache/arrow-rs

@kylebarron hey Kyle, are you willing to make this contribution here?

I ran into the same issue today, I made an upstream issue in delta-rs repo: https://github.com/delta-io/delta-rs/issues/1528

@philszep I think you can close it here. It's going to be fixed upstream.