Ritchie Vink
Ritchie Vink
> Just out of curiousity, is there something that makes exposing the interface difficult? Well.. TBH, I don't really know what exposing the interface means? Do you mean compiler rust...
> I was imagining the last one of having rust polars and sending a dataframe to the python polars processes when I said exposing the interface. In that case you...
> I'm working on this here: https://github.com/jmrgibson/polars/tree/user/jgibson/split_out_py_polars_as_rust_crate > > It appears to work using the nightly compiler. Looks like newer polars relies on simd which is nightly only? I'll continue...
I will close this as the implementation language is Rust and we follow that behavior in this respect.
> @ritchie46 any objections? Nope, that would be great!
This is expected result. It is not window by 'index'` but by integer. That's the integer representation of the column.
And currently with lz4?
@igmriegel could you create a function that create the same schema of your data? I could do some benchmarking on it.
> > @igmriegel could you create a function that create the same schema of your data? I could do some benchmarking on it. > > It is a really large...
Could it be that it is the performance of gzip on large blocks? Does changing the block size help?