Ritchie Vink

Yes, this is fixed.

`NaN` isn't part of the JSON spec. So our json parser (external crate) don't parse it. https://www.json.org/json-en.html

This might run on our tokio runtime. Then we could static task (runs for the duration of the polars process) that most of the time sleeps and once in a...

Alright, did a brainstorm. I think we have got some ideas. Assuming our `spill/cache` directory `~.polars/`. We can dump spilled files under a folder created by a combination process id...

Have you got a repro with a dummy file?

> Not 100% sure if this is the case, but I believe this gets fixed by https://github.com/pola-rs/polars/pull/16549 (notably the removal of Default::default() for the hive partition info. Yes, that's the...

How does it perform if you turn off `comm_subexpr_elim`? And how do you get so deep expressions? 😉

Will see if we can apply some memoization in the `to_field` call.

I am not entirely sure the tree itself isn't quadratic. I need to do double the `to_field` calls of the depth. Because at every depth, we branch.

It is seen as trees. They are turned into DAGS during execution if CSE recognized it.