Jonas Hörsch

icon company Open Energy Transition icon location Siegsdorf, Germany

Results 160 comments of Jonas Hörsch

Pathway optimization

Closed in favour of the more far-reaching issue #14 .

Make polars frames lazy and stream into csv

Thanks for the profiling. Very disappointing.

Make polars frames lazy and stream into csv

It's possible that `.values.reshape(-1)` is not zero-copy.

Make polars frames lazy and stream into csv

The lazy version has to do everything at least twice, since the `check_nulls` already needs to eval everything (that could be improved). I don't know why factor 4, though.

Make polars frames lazy and stream into csv

I'll try to debug a bit around to find out where we are scooping up this memory use. Any particular xarray version to focus on? @FabianHofmann

feat(caching): tie lifetime of cached tables to python refs

~The `bidi` dependency (for a bidirectional dictionary) is not necessary anymore with the `RefCountedCache` implementation in this PR, but quite obviously my [attempt](https://github.com/ibis-project/ibis/pull/9477/commits/980f37b99e166f70d8486fe241bf4a901ab5d7e9) at removing it was incomplete.~

feat(caching): tie lifetime of cached tables to python refs

> I will clean up the `ruff` lints in #9489! Once that gets merged, i'll rebase ontop

feat(caching): tie lifetime of cached tables to python refs

Ok, I rebased ontop of `main` and removed the DeprecationWarning and updated the `.cache()` doc-string with another sentence on the explicit and implicit cache eviction. Only things left on my...

feat(caching): tie lifetime of cached tables to python refs

> Looks like there's maybe a bit of `DeprecationWarning` still hanging around? Ah yes, i forgot about all the tests i had to change :).

feat(caching): tie lifetime of cached tables to python refs

Couldn't find any user-guide explanations of the cache'ing mechanism. So i guess the doc-string is the best we have atm. And that is up-to-date. So, from my side this is...