Ritchie Vink

Results 1046 comments of Ritchie Vink
trafficstars

Thanks for the PR. Can you expose those options also to the python api and the lazy scanner?

I think you should write a generator that slices the file on the fly and caches and returns the rows you need.

Yes, the lazy plan does not yet have a node for horizontal stacking of `DataFrames` you will need to use a join for that.

Yes, you can use that node. This [file](https://github.com/pola-rs/polars/blob/master/py-polars/polars/internals/anonymous_scan.py) is an example. There we create a `scan_ds` and a `scan_parquet_fsspec` function. We push projections to the node and pass that as...

I have been thinking about this and is something that might fit in the scope of polars eventually. It is a lot of work with currently not much benefit with...

On our side that should work if we were to implement geo types.

There are more requests for fixedsizelist + extension types so that we can deal with tensor types. I want to add fixedsizelist type as a minimal type. One that can...

> @ritchie46 is there any news on supporting FixedSizeList in Polars? What would be involved in adding support? It would need a PR similar to this one. https://github.com/pola-rs/polars/pull/5122 I would...

> @ritchie46 I'm getting errors about building with arrow2 after I do > > ```shell > make clean > make venv > > error: could not compile `arrow2` due to...

Thanks a lot! That are many more examples! :100: