Ritchie Vink comments

Results 1125 comments of


                                            Ritchie Vink

refactor(python): Use polars parquet reader for delta scan

Nice, I didn't know we could bring our own readers.

refactor(python): Use polars parquet reader for delta scan

@nameexhaustion can you take a look at this one later?

Archive this project?

Yeah, I agree. I will archive. 👍

Implement (de)serialization of Series/DataFrames using IPC

Added p-low for now as it will be the bottlebeck once we want to support larger frames, but I'd like to start with cloud datasets.

Implement (de)serialization of Series/DataFrames using IPC

No, arbitrary nesting is much more complex and it will be an effort that's in vain as we will switch to IPC anyway. The p-goal is to get the cloud...

feat(rust!): rename ChunkedArray.try_apply to ChunkedArray.try_apply_values

Thanks, I wan to wait a bit with merging so we can still patch non-breaking rust versions.

[PoC] Change Series constructor argument order to values-first

I thought we decided not to go forward with this?

[PoC] Change Series constructor argument order to values-first

I don't think it is worth breaking peoples code over. It is a big change and doesn't leave the world a much better place IMO. To me it feels pedantic...

JSON Error should also report line

Pandas doesn't run in parallel. So it can (easily) keep a line counter. This error could be in a chunk later in the file when we don't know how large...

Support for Map DataType

I don't think it is worth the extra code bloat and complexity. It is a `List` physically, so that's how we read them in polars. I think `FixedSizeList` and `Decimal`...