Ádám Lippai
Ádám Lippai
Turbodbc 4.5.2 is not compatible with pyarrow 8.0. Upgrading to the latest (4.5.5) can help
Sure! Sorry for the delay.
This would enable publishing on conda-forge as well (at least that's what connectorx and polars does)
I have 10y+ experience with JS, TS, Python, PHP, Java, but I'm 100% beginner with Rust and I don't have C++ experience either. This exercise requires the low-level knowledge of...
It was the same (old) MySQL instance. The text is simply `mysql -e query` output piped to a file. The unixodbc, mysql client, turbodbc and odbc2parquet were installed using conda-forge...
I can make more scientific benchmarks (or even add to this repo to compare)
What do you think about https://github.com/sharkdp/hyperfine for e2e benchmarks? Criterion is nice for rust lib benchmarking, but it wouldn't allow us to track the performance compared to a CLI baseline...
I played with one of my larger tables (30M rows) a little bit. The query execution seems to be quick, eg if I add limit 1000000 it completes in 5sec...
`odbcsv` is similar in terms of performance, 1m50s with 1m user time. If I understand correctly it's 5000rows in a batch/fetch. Still 100% CPU usage continuously.