Marius S

thanks @ritchie46 ❤️

As I started to look into this problem I found this todo in the `ParquetSync` https://github.com/pola-rs/polars/blob/master/polars/polars-lazy/polars-pipe/src/executors/sinks/parquet_sink.rs#L62 ``` // TODO! speed this up by having a write thread that will make...

Sorry @ritchie46, can you wait until the weekend/next week? The code is working but the speedup is not significant - 6 seconds faster on this 42 second test that I...

@ritchie46 here is an update on this PR: 1. this PR is working as described in the python snippet above. I think it is worthwhile for you to review it...

Current status: * the scan_parquet code is DONE * when `collect`-ing from python the physical_plan scan also needs to download the files, also DONE * MISSING: an Tokio run-time needs...

@ritchie46 this is ready for review. I am happy to change the API as per @talawahtech 's great feedback, if you agree with it. I am not yet familiar with...

I am thinking of a macro that would take a model (can be a stand-in for a family of compatible models) and would generate a typed rust interface for it....