Ritchie Vink

@nameexhaustion it is related to `include_file_paths`. I also see that `include_file_paths` doesn't respect the projection pushdown: ```pyhton import polars as pl q = pl.scan_csv("a,b,c\na1,b1,c1".encode(), include_file_paths="path_name").select(["a", "b"]) print(q.collect()) ``` ``` shape:...

bugfix

Thanks a lot @adamreeve. I will pick this up. What I really want to add first is the parallel groups and then I need to think about the interface for...

Thanks a lot @adamreeve. This turned out great with full non-equi join support.

This and we will improve it even more as there are still a few places where we are linear when we can be O(1).

We will not plan to take pyarrow file system in our native readers. We do support pyarrow datasets as `scan` functions. The performance of very wide parquet files will further...

Yes. We finished the schema updates. I expect this to also resolve more quadratic behavior. Curious on a run on latest.

Alright.. thanks. Will see if we can get a profile on this.

@vstolin can you do another run with Polars 1.13?

Great to hear! :) Then I'll close this as fixed. :+1: