vortex
vortex copied to clipboard
spiraldb
Experimental DuckDB Exporter
Instead of slicing arrays and converting them, we track the row offset and export from a single ArrayIterator
Benchmarks: TPC-H on NVME
Table of Results
| name | PR b919d4cd | base 54c09f66 | ratio (PR/base) | unit |
|---|---|---|---|---|
| tpch_q01/DataFusion:arrow | 66260250 | 7.84204e+07 | 0.844936 | ns |
| tpch_q02/DataFusion:arrow | 15934805 | 1.95935e+07 | 0.813268 | ns |
| tpch_q03/DataFusion:arrow | 23601535 | 2.95384e+07 | 0.799011 | ns |
| tpch_q04/DataFusion:arrow | 18798683 | 2.28791e+07 | 0.821652 | ns |
| tpch_q05/DataFusion:arrow | 33657446 | 3.96223e+07 | 0.849458 | ns |
| tpch_q06/DataFusion:arrow | 6365664 | 7.17894e+06 | 0.886713 | ns |
| tpch_q07/DataFusion:arrow | 53462229 | 7.04161e+07 | 0.759233 | ns |
| tpch_q08/DataFusion:arrow | 18430022 | 2.44163e+07 | 0.754824 | ns |
| tpch_q09/DataFusion:arrow | 32709223 | 4.42929e+07 | 0.738475 | ns |
| tpch_q10/DataFusion:arrow | 37451535 | 5.14513e+07 | 0.727903 | ns |
| tpch_q11/DataFusion:arrow | 7742767 | 9.82919e+06 | 0.787732 | ns |
| tpch_q12/DataFusion:arrow | 18560283 | 2.08203e+07 | 0.891453 | ns |
| tpch_q13/DataFusion:arrow | 14612408 | 1.75192e+07 | 0.834081 | ns |
| tpch_q14/DataFusion:arrow | 8385462 | 1.13849e+07 | 0.736545 | ns |
| tpch_q15/DataFusion:arrow | 18352114 | 2.19713e+07 | 0.835278 | ns |
| tpch_q16/DataFusion:arrow | 14688475 | 1.77e+07 | 0.829859 | ns |
| tpch_q17/DataFusion:arrow | 49097706 | 5.06406e+07 | 0.969533 | ns |
| tpch_q18/DataFusion:arrow | 107371254 | 1.20304e+08 | 0.8925 | ns |
| tpch_q19/DataFusion:arrow | 18037744 | 2.01299e+07 | 0.896067 | ns |
| tpch_q20/DataFusion:arrow | 23697340 | 3.04391e+07 | 0.778517 | ns |
| tpch_q21/DataFusion:arrow | 83266175 | 1.03186e+08 | 0.806952 | ns |
| tpch_q22/DataFusion:arrow | 10324006 | 1.25137e+07 | 0.825019 | ns |
| tpch_q01/DataFusion:parquet | 81062227 | 1.00681e+08 | 0.805138 | ns |
| tpch_q02/DataFusion:parquet | 41230815 | 4.81049e+07 | 0.857101 | ns |
| tpch_q03/DataFusion:parquet | 37421305 | 4.38414e+07 | 0.85356 | ns |
| tpch_q04/DataFusion:parquet | 23792603 | 2.91479e+07 | 0.816272 | ns |
| tpch_q05/DataFusion:parquet | 56876903 | 6.92646e+07 | 0.821154 | ns |
| tpch_q06/DataFusion:parquet | 14106888 | 1.558e+07 | 0.90545 | ns |
| tpch_q07/DataFusion:parquet | 73163592 | 8.54366e+07 | 0.856349 | ns |
| tpch_q08/DataFusion:parquet | 50612054 | 6.27664e+07 | 0.806355 | ns |
| tpch_q09/DataFusion:parquet | 72037082 | 9.7071e+07 | 0.742107 | ns |
| tpch_q10/DataFusion:parquet | 84691958 | 8.57288e+07 | 0.987905 | ns |
| tpch_q11/DataFusion:parquet | 29269659 | 2.98092e+07 | 0.981901 | ns |
| tpch_q12/DataFusion:parquet | 27181524 | 3.36723e+07 | 0.807238 | ns |
| tpch_q13/DataFusion:parquet | 44011076 | 4.77928e+07 | 0.920873 | ns |
| tpch_q14/DataFusion:parquet | 22738010 | 2.64565e+07 | 0.85945 | ns |
| tpch_q15/DataFusion:parquet | 39844484 | 4.61981e+07 | 0.862469 | ns |
| tpch_q16/DataFusion:parquet | 27680870 | 3.1562e+07 | 0.877031 | ns |
| tpch_q17/DataFusion:parquet | 76470111 | 8.95484e+07 | 0.853953 | ns |
| tpch_q18/DataFusion:parquet | 104420229 | 1.4593e+08 | 0.715552 | ns |
| tpch_q19/DataFusion:parquet | 39994395 | 4.90092e+07 | 0.816059 | ns |
| tpch_q20/DataFusion:parquet | 48518948 | 5.35569e+07 | 0.905933 | ns |
| tpch_q21/DataFusion:parquet | 93149547 | 9.84742e+07 | 0.945928 | ns |
| tpch_q22/DataFusion:parquet | 51035764 | 5.50976e+07 | 0.926279 | ns |
| tpch_q01/DataFusion:vortex-file-compressed | 54437120 | 5.53818e+07 | 0.982943 | ns |
| tpch_q02/DataFusion:vortex-file-compressed | 36199551 | 3.77197e+07 | 0.959698 | ns |
| tpch_q03/DataFusion:vortex-file-compressed | 28046723 | 2.77641e+07 | 1.01018 | ns |
| tpch_q04/DataFusion:vortex-file-compressed | 14486913 | 1.51624e+07 | 0.955448 | ns |
| tpch_q05/DataFusion:vortex-file-compressed | 46493231 | 4.64372e+07 | 1.00121 | ns |
| tpch_q06/DataFusion:vortex-file-compressed | 2416271 | 2.28931e+06 | 1.05546 | ns |
| tpch_q07/DataFusion:vortex-file-compressed | 63239137 | 6.25304e+07 | 1.01133 | ns |
| tpch_q08/DataFusion:vortex-file-compressed | 54185125 | 5.05368e+07 | 1.07219 | ns |
| tpch_q09/DataFusion:vortex-file-compressed | 75261535 | 7.31606e+07 | 1.02872 | ns |
| tpch_q10/DataFusion:vortex-file-compressed | 43753598 | 4.18966e+07 | 1.04432 | ns |
| tpch_q11/DataFusion:vortex-file-compressed | 25558599 | 2.60221e+07 | 0.982189 | ns |
| tpch_q12/DataFusion:vortex-file-compressed | 15656748 | 1.53786e+07 | 1.01809 | ns |
| tpch_q13/DataFusion:vortex-file-compressed | 17537061 | 1.9327e+07 | 0.907388 | ns |
| tpch_q14/DataFusion:vortex-file-compressed | 9443620 | 1.00747e+07 | 0.937363 | ns |
| tpch_q15/DataFusion:vortex-file-compressed | 16332131 | 1.76534e+07 | 0.925155 | ns |
| tpch_q16/DataFusion:vortex-file-compressed | 22611845 | 2.71642e+07 | 0.832415 | ns |
| tpch_q17/DataFusion:vortex-file-compressed | 76100496 | 8.37824e+07 | 0.908311 | ns |
| tpch_q18/DataFusion:vortex-file-compressed | 92232255 | 1.19908e+08 | 0.769195 | ns |
| tpch_q19/DataFusion:vortex-file-compressed | 10371829 | 1.26684e+07 | 0.818717 | ns |
| tpch_q20/DataFusion:vortex-file-compressed | 25643313 | 3.23911e+07 | 0.791677 | ns |
| tpch_q21/DataFusion:vortex-file-compressed | 86509228 | 1.1286e+08 | 0.766517 | ns |
| tpch_q22/DataFusion:vortex-file-compressed | 12062850 | 1.44373e+07 | 0.835536 | ns |
| tpch_q01/DuckDB:parquet | 36000000 | 3.8e+07 | 0.947368 | ns |
| tpch_q02/DuckDB:parquet | 28000000 | 3.2e+07 | 0.875 | ns |
| tpch_q03/DuckDB:parquet | 51000000 | 5.7e+07 | 0.894737 | ns |
| tpch_q04/DuckDB:parquet | 26000000 | 2.9e+07 | 0.896552 | ns |
| tpch_q05/DuckDB:parquet | 37000000 | 4.1e+07 | 0.902439 | ns |
| tpch_q06/DuckDB:parquet | 12000000 | 1.4e+07 | 0.857143 | ns |
| tpch_q07/DuckDB:parquet | 41000000 | 4.6e+07 | 0.891304 | ns |
| tpch_q08/DuckDB:parquet | 44000000 | 4.8e+07 | 0.916667 | ns |
| tpch_q09/DuckDB:parquet | 83000000 | 9e+07 | 0.922222 | ns |
| tpch_q10/DuckDB:parquet | 215000000 | 2.11e+08 | 1.01896 | ns |
| tpch_q11/DuckDB:parquet | 14000000 | 1.5e+07 | 0.933333 | ns |
| tpch_q12/DuckDB:parquet | 25000000 | 2.5e+07 | 1 | ns |
| tpch_q13/DuckDB:parquet | 47000000 | 4.7e+07 | 1 | ns |
| tpch_q14/DuckDB:parquet | 30000000 | 3e+07 | 1 | ns |
| tpch_q15/DuckDB:parquet | 32000000 | 3.6e+07 | 0.888889 | ns |
| tpch_q16/DuckDB:parquet | 49000000 | 4.9e+07 | 1 | ns |
| tpch_q17/DuckDB:parquet | 36000000 | 3.6e+07 | 1 | ns |
| tpch_q18/DuckDB:parquet | 46000000 | 4.8e+07 | 0.958333 | ns |
| tpch_q19/DuckDB:parquet | 42000000 | 4.1e+07 | 1.02439 | ns |
| tpch_q20/DuckDB:parquet | 37000000 | 3.7e+07 | 1 | ns |
| tpch_q21/DuckDB:parquet | 102000000 | 1.04e+08 | 0.980769 | ns |
| tpch_q22/DuckDB:parquet | 32000000 | 3.2e+07 | 1 | ns |
| tpch_q01/DuckDB:vortex-file-compressed | 53000000 | 5.7e+07 | 0.929825 | ns |
| tpch_q02/DuckDB:vortex-file-compressed | 37000000 | 3.7e+07 | 1 | ns |
| tpch_q03/DuckDB:vortex-file-compressed | 69000000 | 6.8e+07 | 1.01471 | ns |
| tpch_q04/DuckDB:vortex-file-compressed | 46000000 | 5.1e+07 | 0.901961 | ns |
| tpch_q05/DuckDB:vortex-file-compressed | 55000000 | 5.6e+07 | 0.982143 | ns |
| tpch_q06/DuckDB:vortex-file-compressed | 4000000 | 4e+06 | 1 | ns |
| tpch_q07/DuckDB:vortex-file-compressed | 55000000 | 6.3e+07 | 0.873016 | ns |
| tpch_q08/DuckDB:vortex-file-compressed | 65000000 | 6.5e+07 | 1 | ns |
| tpch_q09/DuckDB:vortex-file-compressed | 99000000 | 1e+08 | 0.99 | ns |
| tpch_q10/DuckDB:vortex-file-compressed | 207000000 | 2.1e+08 | 0.985714 | ns |
| tpch_q11/DuckDB:vortex-file-compressed | 22000000 | 2.3e+07 | 0.956522 | ns |
| tpch_q12/DuckDB:vortex-file-compressed | 47000000 | 4.8e+07 | 0.979167 | ns |
| tpch_q13/DuckDB:vortex-file-compressed | 53000000 | 5.4e+07 | 0.981481 | ns |
| tpch_q14/DuckDB:vortex-file-compressed | 37000000 | 3.7e+07 | 1 | ns |
| tpch_q15/DuckDB:vortex-file-compressed | 56000000 | 5.1e+07 | 1.09804 | ns |
| tpch_q16/DuckDB:vortex-file-compressed | 53000000 | 5.4e+07 | 0.981481 | ns |
| tpch_q17/DuckDB:vortex-file-compressed | 45000000 | 5.3e+07 | 0.849057 | ns |
| tpch_q18/DuckDB:vortex-file-compressed | 60000000 | 7.2e+07 | 0.833333 | ns |
| tpch_q19/DuckDB:vortex-file-compressed | 53000000 | 5.8e+07 | 0.913793 | ns |
| tpch_q20/DuckDB:vortex-file-compressed | 49000000 | 5.1e+07 | 0.960784 | ns |
| tpch_q21/DuckDB:vortex-file-compressed | 135000000 | 1.48e+08 | 0.912162 | ns |
| tpch_q22/DuckDB:vortex-file-compressed | 32000000 | 3.3e+07 | 0.969697 | ns |
| tpch_q01/DuckDB:duckdb | 20000000 | 2.2e+07 | 0.909091 | ns |
| tpch_q02/DuckDB:duckdb | 19000000 | 1.9e+07 | 1 | ns |
| tpch_q03/DuckDB:duckdb | 43000000 | 4.3e+07 | 1 | ns |
| tpch_q04/DuckDB:duckdb | 19000000 | 1.9e+07 | 1 | ns |
| tpch_q05/DuckDB:duckdb | 27000000 | 2.6e+07 | 1.03846 | ns |
| tpch_q06/DuckDB:duckdb | 8000000 | 8e+06 | 1 | ns |
| tpch_q07/DuckDB:duckdb | 31000000 | 3e+07 | 1.03333 | ns |
| tpch_q08/DuckDB:duckdb | 29000000 | 2.9e+07 | 1 | ns |
| tpch_q09/DuckDB:duckdb | 70000000 | 7e+07 | 1 | ns |
| tpch_q10/DuckDB:duckdb | 199000000 | 1.97e+08 | 1.01015 | ns |
| tpch_q11/DuckDB:duckdb | 8000000 | 9e+06 | 0.888889 | ns |
| tpch_q12/DuckDB:duckdb | 23000000 | 2.3e+07 | 1 | ns |
| tpch_q13/DuckDB:duckdb | 41000000 | 4.2e+07 | 0.97619 | ns |
| tpch_q14/DuckDB:duckdb | 22000000 | 2.3e+07 | 0.956522 | ns |
| tpch_q15/DuckDB:duckdb | 29000000 | 2.9e+07 | 1 | ns |
| tpch_q16/DuckDB:duckdb | 43000000 | 4.6e+07 | 0.934783 | ns |
| tpch_q17/DuckDB:duckdb | 27000000 | 3.1e+07 | 0.870968 | ns |
| tpch_q18/DuckDB:duckdb | 35000000 | 4e+07 | 0.875 | ns |
| tpch_q19/DuckDB:duckdb | 37000000 | 4.1e+07 | 0.902439 | ns |
| tpch_q20/DuckDB:duckdb | 27000000 | 3e+07 | 0.9 | ns |
| tpch_q21/DuckDB:duckdb | 62000000 | 6.9e+07 | 0.898551 | ns |
| tpch_q22/DuckDB:duckdb | 25000000 | 2.6e+07 | 0.961538 | ns |
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
Benchmarks: TPC-H on S3
Table of Results
| name | PR b919d4cd | base 54c09f66 | ratio (PR/base) | unit |
|---|---|---|---|---|
| tpch_q01/DataFusion:parquet | 190545972 | 1.88875e+08 | 1.00885 | ns |
| tpch_q02/DataFusion:parquet | 734631343 | 7.63048e+08 | 0.962759 | ns |
| tpch_q03/DataFusion:parquet | 358209008 | 3.30832e+08 | 1.08275 | ns |
| tpch_q04/DataFusion:parquet | 234398931 | 2.19384e+08 | 1.06844 | ns |
| tpch_q05/DataFusion:parquet | 558620293 | 5.45935e+08 | 1.02324 | ns |
| tpch_q06/DataFusion:parquet | 136550991 | 1.27413e+08 | 1.07172 | ns |
| tpch_q07/DataFusion:parquet | 493324216 | 5.14704e+08 | 0.958462 | ns |
| tpch_q08/DataFusion:parquet | 752739857 | 7.26133e+08 | 1.03664 | ns |
| tpch_q09/DataFusion:parquet | 613246731 | 6.19825e+08 | 0.989386 | ns |
| tpch_q10/DataFusion:parquet | 536083219 | 5.22551e+08 | 1.0259 | ns |
| tpch_q11/DataFusion:parquet | 476539230 | 4.8021e+08 | 0.992357 | ns |
| tpch_q12/DataFusion:parquet | 274637888 | 2.70636e+08 | 1.01479 | ns |
| tpch_q13/DataFusion:parquet | 219979198 | 2.14218e+08 | 1.02689 | ns |
| tpch_q14/DataFusion:parquet | 274474769 | 2.67952e+08 | 1.02434 | ns |
| tpch_q15/DataFusion:parquet | 357455704 | 3.56345e+08 | 1.00312 | ns |
| tpch_q16/DataFusion:parquet | 365013560 | 3.71411e+08 | 0.982774 | ns |
| tpch_q17/DataFusion:parquet | 500155850 | 5.07999e+08 | 0.98456 | ns |
| tpch_q18/DataFusion:parquet | 468647083 | 4.44539e+08 | 1.05423 | ns |
| tpch_q19/DataFusion:parquet | 352038625 | 3.51752e+08 | 1.00081 | ns |
| tpch_q20/DataFusion:parquet | 516387923 | 5.30142e+08 | 0.974056 | ns |
| tpch_q21/DataFusion:parquet | 689865274 | 6.9477e+08 | 0.992941 | ns |
| tpch_q22/DataFusion:parquet | 290950611 | 2.81431e+08 | 1.03382 | ns |
| tpch_q01/DataFusion:vortex-file-compressed | 156854160 | 1.46983e+08 | 1.06716 | ns |
| tpch_q02/DataFusion:vortex-file-compressed | 149695549 | 1.52938e+08 | 0.978798 | ns |
| tpch_q03/DataFusion:vortex-file-compressed | 225228551 | 2.29214e+08 | 0.982613 | ns |
| tpch_q04/DataFusion:vortex-file-compressed | 139067850 | 1.50438e+08 | 0.924423 | ns |
| tpch_q05/DataFusion:vortex-file-compressed | 235216086 | 2.25263e+08 | 1.04418 | ns |
| tpch_q06/DataFusion:vortex-file-compressed | 9087586 | 9.58079e+06 | 0.948521 | ns |
| tpch_q07/DataFusion:vortex-file-compressed | 233029536 | 2.30883e+08 | 1.0093 | ns |
| tpch_q08/DataFusion:vortex-file-compressed | 292285072 | 2.71455e+08 | 1.07674 | ns |
| tpch_q09/DataFusion:vortex-file-compressed | 307350287 | 3.18666e+08 | 0.96449 | ns |
| tpch_q10/DataFusion:vortex-file-compressed | 239350261 | 2.56912e+08 | 0.931642 | ns |
| tpch_q11/DataFusion:vortex-file-compressed | 130139324 | 1.29894e+08 | 1.00189 | ns |
| tpch_q12/DataFusion:vortex-file-compressed | 199249973 | 1.90804e+08 | 1.04426 | ns |
| tpch_q13/DataFusion:vortex-file-compressed | 127155638 | 1.27844e+08 | 0.994617 | ns |
| tpch_q14/DataFusion:vortex-file-compressed | 135416477 | 1.33202e+08 | 1.01662 | ns |
| tpch_q15/DataFusion:vortex-file-compressed | 211958365 | 2.02177e+08 | 1.04838 | ns |
| tpch_q16/DataFusion:vortex-file-compressed | 91506819 | 9.2288e+07 | 0.991536 | ns |
| tpch_q17/DataFusion:vortex-file-compressed | 257435037 | 2.64319e+08 | 0.973954 | ns |
| tpch_q18/DataFusion:vortex-file-compressed | 299181983 | 2.81778e+08 | 1.06176 | ns |
| tpch_q19/DataFusion:vortex-file-compressed | 43778719 | 4.04498e+07 | 1.0823 | ns |
| tpch_q20/DataFusion:vortex-file-compressed | 216972016 | 2.13964e+08 | 1.01406 | ns |
| tpch_q21/DataFusion:vortex-file-compressed | 377879207 | 3.7674e+08 | 1.00302 | ns |
| tpch_q22/DataFusion:vortex-file-compressed | 104851879 | 1.04538e+08 | 1.003 | ns |
| tpch_q01/DuckDB:parquet | 426000000 | 4.1e+08 | 1.03902 | ns |
| tpch_q02/DuckDB:parquet | 535000000 | 4.73e+08 | 1.13108 | ns |
| tpch_q03/DuckDB:parquet | 583000000 | 5.85e+08 | 0.996581 | ns |
| tpch_q04/DuckDB:parquet | 363000000 | 3.62e+08 | 1.00276 | ns |
| tpch_q05/DuckDB:parquet | 667000000 | 5.87e+08 | 1.13629 | ns |
| tpch_q06/DuckDB:parquet | 267000000 | 2.52e+08 | 1.05952 | ns |
| tpch_q07/DuckDB:parquet | 639000000 | 5.7e+08 | 1.12105 | ns |
| tpch_q08/DuckDB:parquet | 655000000 | 6.41e+08 | 1.02184 | ns |
| tpch_q09/DuckDB:parquet | 747000000 | 7.76e+08 | 0.962629 | ns |
| tpch_q10/DuckDB:parquet | 938000000 | 9.14e+08 | 1.02626 | ns |
| tpch_q11/DuckDB:parquet | 304000000 | 2.82e+08 | 1.07801 | ns |
| tpch_q12/DuckDB:parquet | 332000000 | 3.29e+08 | 1.00912 | ns |
| tpch_q13/DuckDB:parquet | 239000000 | 2.71e+08 | 0.881919 | ns |
| tpch_q14/DuckDB:parquet | 406000000 | 3.64e+08 | 1.11538 | ns |
| tpch_q15/DuckDB:parquet | 455000000 | 4.02e+08 | 1.13184 | ns |
| tpch_q16/DuckDB:parquet | 346000000 | 3.41e+08 | 1.01466 | ns |
| tpch_q17/DuckDB:parquet | 359000000 | 3.53e+08 | 1.017 | ns |
| tpch_q18/DuckDB:parquet | 363000000 | 3.74e+08 | 0.970588 | ns |
| tpch_q19/DuckDB:parquet | 524000000 | 5.11e+08 | 1.02544 | ns |
| tpch_q20/DuckDB:parquet | 563000000 | 5.68e+08 | 0.991197 | ns |
| tpch_q21/DuckDB:parquet | 574000000 | 5.34e+08 | 1.07491 | ns |
| tpch_q22/DuckDB:parquet | 223000000 | 2.36e+08 | 0.944915 | ns |
| tpch_q01/DuckDB:vortex-file-compressed | 54000000 | 5.3e+07 | 1.01887 | ns |
| tpch_q02/DuckDB:vortex-file-compressed | 37000000 | 3.6e+07 | 1.02778 | ns |
| tpch_q03/DuckDB:vortex-file-compressed | 66000000 | 6.9e+07 | 0.956522 | ns |
| tpch_q04/DuckDB:vortex-file-compressed | 44000000 | 5e+07 | 0.88 | ns |
| tpch_q05/DuckDB:vortex-file-compressed | 54000000 | 5.6e+07 | 0.964286 | ns |
| tpch_q06/DuckDB:vortex-file-compressed | 5000000 | 4e+06 | 1.25 | ns |
| tpch_q07/DuckDB:vortex-file-compressed | 60000000 | 6.2e+07 | 0.967742 | ns |
| tpch_q08/DuckDB:vortex-file-compressed | 65000000 | 6.8e+07 | 0.955882 | ns |
| tpch_q09/DuckDB:vortex-file-compressed | 99000000 | 1e+08 | 0.99 | ns |
| tpch_q10/DuckDB:vortex-file-compressed | 210000000 | 2.07e+08 | 1.01449 | ns |
| tpch_q11/DuckDB:vortex-file-compressed | 24000000 | 2.3e+07 | 1.04348 | ns |
| tpch_q12/DuckDB:vortex-file-compressed | 50000000 | 4.9e+07 | 1.02041 | ns |
| tpch_q13/DuckDB:vortex-file-compressed | 58000000 | 5.5e+07 | 1.05455 | ns |
| tpch_q14/DuckDB:vortex-file-compressed | 37000000 | 3.6e+07 | 1.02778 | ns |
| tpch_q15/DuckDB:vortex-file-compressed | 53000000 | 4.8e+07 | 1.10417 | ns |
| tpch_q16/DuckDB:vortex-file-compressed | 52000000 | 5.3e+07 | 0.981132 | ns |
| tpch_q17/DuckDB:vortex-file-compressed | 52000000 | 5.5e+07 | 0.945455 | ns |
| tpch_q18/DuckDB:vortex-file-compressed | 63000000 | 6.9e+07 | 0.913043 | ns |
| tpch_q19/DuckDB:vortex-file-compressed | 53000000 | 5.7e+07 | 0.929825 | ns |
| tpch_q20/DuckDB:vortex-file-compressed | 48000000 | 4.9e+07 | 0.979592 | ns |
| tpch_q21/DuckDB:vortex-file-compressed | 137000000 | 1.46e+08 | 0.938356 | ns |
| tpch_q22/DuckDB:vortex-file-compressed | 32000000 | 3.2e+07 | 1 | ns |
Benchmarks: Clickbench on NVME
Table of Results
| name | PR b919d4cd | base 54c09f66 | ratio (PR/base) | unit |
|---|---|---|---|---|
| clickbench_q00/DataFusion:parquet | 1319089 | 1.29285e+06 | 1.0203 | ns |
| clickbench_q01/DataFusion:parquet | 28418158 | 2.87662e+07 | 0.987902 | ns |
| clickbench_q02/DataFusion:parquet | 66612985 | 6.51021e+07 | 1.02321 | ns |
| clickbench_q03/DataFusion:parquet | 51844571 | 5.37325e+07 | 0.964865 | ns |
| clickbench_q04/DataFusion:parquet | 403206401 | 3.97398e+08 | 1.01462 | ns |
| clickbench_q05/DataFusion:parquet | 378448982 | 3.84338e+08 | 0.984677 | ns |
| clickbench_q06/DataFusion:parquet | 1343834 | 1.31582e+06 | 1.02129 | ns |
| clickbench_q07/DataFusion:parquet | 33219283 | 3.13238e+07 | 1.06051 | ns |
| clickbench_q08/DataFusion:parquet | 459939601 | 4.6496e+08 | 0.989202 | ns |
| clickbench_q09/DataFusion:parquet | 669222710 | 6.91274e+08 | 0.9681 | ns |
| clickbench_q10/DataFusion:parquet | 149203030 | 1.51067e+08 | 0.987658 | ns |
| clickbench_q11/DataFusion:parquet | 171030120 | 1.7667e+08 | 0.968074 | ns |
| clickbench_q12/DataFusion:parquet | 409508466 | 4.12356e+08 | 0.993093 | ns |
| clickbench_q13/DataFusion:parquet | 570772404 | 5.90766e+08 | 0.966157 | ns |
| clickbench_q14/DataFusion:parquet | 396350426 | 4.0124e+08 | 0.987815 | ns |
| clickbench_q15/DataFusion:parquet | 474064138 | 4.67645e+08 | 1.01373 | ns |
| clickbench_q16/DataFusion:parquet | 820294142 | 8.27223e+08 | 0.991624 | ns |
| clickbench_q17/DataFusion:parquet | 792509848 | 7.96612e+08 | 0.994851 | ns |
| clickbench_q18/DataFusion:parquet | 1474855308 | 1.56302e+09 | 0.943591 | ns |
| clickbench_q19/DataFusion:parquet | 42472765 | 4.19252e+07 | 1.01306 | ns |
| clickbench_q20/DataFusion:parquet | 648134684 | 6.65891e+08 | 0.973335 | ns |
| clickbench_q21/DataFusion:parquet | 739801345 | 7.59347e+08 | 0.97426 | ns |
| clickbench_q22/DataFusion:parquet | 1188743006 | 1.20287e+09 | 0.988254 | ns |
| clickbench_q23/DataFusion:parquet | 4914067100 | 4.98909e+09 | 0.984962 | ns |
| clickbench_q24/DataFusion:parquet | 245826150 | 2.54117e+08 | 0.967375 | ns |
| clickbench_q25/DataFusion:parquet | 215988133 | 2.15798e+08 | 1.00088 | ns |
| clickbench_q26/DataFusion:parquet | 277929670 | 2.83134e+08 | 0.981618 | ns |
| clickbench_q27/DataFusion:parquet | 967459305 | 9.9374e+08 | 0.973554 | ns |
| clickbench_q28/DataFusion:parquet | 5908795331 | 5.94974e+09 | 0.993118 | ns |
| clickbench_q29/DataFusion:parquet | 238635587 | 2.41807e+08 | 0.986883 | ns |
| clickbench_q30/DataFusion:parquet | 387203416 | 3.9044e+08 | 0.991711 | ns |
| clickbench_q31/DataFusion:parquet | 441892418 | 4.32001e+08 | 1.0229 | ns |
| clickbench_q32/DataFusion:parquet | 1341211230 | 1.44928e+09 | 0.925436 | ns |
| clickbench_q33/DataFusion:parquet | 1692028026 | 1.68646e+09 | 1.0033 | ns |
| clickbench_q34/DataFusion:parquet | 1696916048 | 1.69581e+09 | 1.00065 | ns |
| clickbench_q35/DataFusion:parquet | 632137146 | 6.33048e+08 | 0.998562 | ns |
| clickbench_q36/DataFusion:parquet | 179251132 | 1.81083e+08 | 0.989883 | ns |
| clickbench_q37/DataFusion:parquet | 71984783 | 7.19456e+07 | 1.00055 | ns |
| clickbench_q38/DataFusion:parquet | 108697301 | 1.11679e+08 | 0.973302 | ns |
| clickbench_q39/DataFusion:parquet | 350470897 | 3.51552e+08 | 0.996924 | ns |
| clickbench_q40/DataFusion:parquet | 40975589 | 4.39086e+07 | 0.933202 | ns |
| clickbench_q41/DataFusion:parquet | 37412878 | 4.26251e+07 | 0.87772 | ns |
| clickbench_q42/DataFusion:parquet | 60059436 | 5.94063e+07 | 1.01099 | ns |
| clickbench_q00/DataFusion:vortex-file-compressed | 1338986 | 1.3136e+06 | 1.01933 | ns |
| clickbench_q01/DataFusion:vortex-file-compressed | 7353632 | 7.48234e+06 | 0.982798 | ns |
| clickbench_q02/DataFusion:vortex-file-compressed | 25896276 | 2.75442e+07 | 0.940172 | ns |
| clickbench_q03/DataFusion:vortex-file-compressed | 35268968 | 3.50559e+07 | 1.00608 | ns |
| clickbench_q04/DataFusion:vortex-file-compressed | 324705431 | 3.34625e+08 | 0.970355 | ns |
| clickbench_q05/DataFusion:vortex-file-compressed | 337426009 | 3.50552e+08 | 0.962556 | ns |
| clickbench_q06/DataFusion:vortex-file-compressed | 1407649 | 1.3523e+06 | 1.04093 | ns |
| clickbench_q07/DataFusion:vortex-file-compressed | 11893989 | 1.05316e+07 | 1.12936 | ns |
| clickbench_q08/DataFusion:vortex-file-compressed | 390282806 | 3.75222e+08 | 1.04014 | ns |
| clickbench_q09/DataFusion:vortex-file-compressed | 566496519 | 5.66449e+08 | 1.00008 | ns |
| clickbench_q10/DataFusion:vortex-file-compressed | 70705335 | 7.1755e+07 | 0.985372 | ns |
| clickbench_q11/DataFusion:vortex-file-compressed | 83919130 | 8.45041e+07 | 0.993078 | ns |
| clickbench_q12/DataFusion:vortex-file-compressed | 298904231 | 3.05822e+08 | 0.977381 | ns |
| clickbench_q13/DataFusion:vortex-file-compressed | 486595363 | 4.86641e+08 | 0.999907 | ns |
| clickbench_q14/DataFusion:vortex-file-compressed | 280445213 | 2.77056e+08 | 1.01223 | ns |
| clickbench_q15/DataFusion:vortex-file-compressed | 406955389 | 4.02707e+08 | 1.01055 | ns |
| clickbench_q16/DataFusion:vortex-file-compressed | 828916505 | 8.40962e+08 | 0.985677 | ns |
| clickbench_q17/DataFusion:vortex-file-compressed | 803691949 | 8.00199e+08 | 1.00437 | ns |
| clickbench_q18/DataFusion:vortex-file-compressed | 1514576403 | 1.50757e+09 | 1.00465 | ns |
| clickbench_q19/DataFusion:vortex-file-compressed | 14239126 | 1.36233e+07 | 1.04521 | ns |
| clickbench_q20/DataFusion:vortex-file-compressed | 268794251 | 2.79859e+08 | 0.960464 | ns |
| clickbench_q21/DataFusion:vortex-file-compressed | 328533927 | 3.32972e+08 | 0.986671 | ns |
| clickbench_q22/DataFusion:vortex-file-compressed | 695897764 | 6.91433e+08 | 1.00646 | ns |
| clickbench_q23/DataFusion:vortex-file-compressed | 2091590935 | 2.10122e+09 | 0.995416 | ns |
| clickbench_q24/DataFusion:vortex-file-compressed | 128471791 | 1.29979e+08 | 0.988403 | ns |
| clickbench_q25/DataFusion:vortex-file-compressed | 108385214 | 1.05631e+08 | 1.02607 | ns |
| clickbench_q26/DataFusion:vortex-file-compressed | 160807316 | 1.61473e+08 | 0.99588 | ns |
| clickbench_q27/DataFusion:vortex-file-compressed | 683867210 | 6.89752e+08 | 0.991469 | ns |
| clickbench_q28/DataFusion:vortex-file-compressed | 6829399783 | 6.64591e+09 | 1.02761 | ns |
| clickbench_q29/DataFusion:vortex-file-compressed | 238208704 | 2.47394e+08 | 0.962872 | ns |
| clickbench_q30/DataFusion:vortex-file-compressed | 240432916 | 2.50016e+08 | 0.961668 | ns |
| clickbench_q31/DataFusion:vortex-file-compressed | 279196701 | 2.84129e+08 | 0.982639 | ns |
| clickbench_q32/DataFusion:vortex-file-compressed | 1290942541 | 1.36551e+09 | 0.945395 | ns |
| clickbench_q33/DataFusion:vortex-file-compressed | 1541281455 | 1.54129e+09 | 0.999996 | ns |
| clickbench_q34/DataFusion:vortex-file-compressed | 1574967291 | 1.5322e+09 | 1.02791 | ns |
| clickbench_q35/DataFusion:vortex-file-compressed | 552364990 | 5.57391e+08 | 0.990983 | ns |
| clickbench_q36/DataFusion:vortex-file-compressed | 99770086 | 9.38809e+07 | 1.06273 | ns |
| clickbench_q37/DataFusion:vortex-file-compressed | 43385709 | 4.20892e+07 | 1.0308 | ns |
| clickbench_q38/DataFusion:vortex-file-compressed | 26967498 | 2.87372e+07 | 0.938418 | ns |
| clickbench_q39/DataFusion:vortex-file-compressed | 195822675 | 1.89249e+08 | 1.03474 | ns |
| clickbench_q40/DataFusion:vortex-file-compressed | 15999934 | 1.64922e+07 | 0.970152 | ns |
| clickbench_q41/DataFusion:vortex-file-compressed | 13985745 | 1.43976e+07 | 0.971393 | ns |
| clickbench_q42/DataFusion:vortex-file-compressed | 36756434 | 3.57077e+07 | 1.02937 | ns |
| clickbench_q00/DuckDB:parquet | 119000000 | 1.19e+08 | 1 | ns |
| clickbench_q01/DuckDB:parquet | 49000000 | 4.9e+07 | 1 | ns |
| clickbench_q02/DuckDB:parquet | 59000000 | 6.1e+07 | 0.967213 | ns |
| clickbench_q03/DuckDB:parquet | 59000000 | 6e+07 | 0.983333 | ns |
| clickbench_q04/DuckDB:parquet | 205000000 | 2.06e+08 | 0.995146 | ns |
| clickbench_q05/DuckDB:parquet | 240000000 | 2.41e+08 | 0.995851 | ns |
| clickbench_q06/DuckDB:parquet | 55000000 | 5.7e+07 | 0.964912 | ns |
| clickbench_q07/DuckDB:parquet | 53000000 | 5.4e+07 | 0.981481 | ns |
| clickbench_q08/DuckDB:parquet | 248000000 | 2.49e+08 | 0.995984 | ns |
| clickbench_q09/DuckDB:parquet | 340000000 | 3.4e+08 | 1 | ns |
| clickbench_q10/DuckDB:parquet | 91000000 | 9.2e+07 | 0.98913 | ns |
| clickbench_q11/DuckDB:parquet | 105000000 | 1.05e+08 | 1 | ns |
| clickbench_q12/DuckDB:parquet | 249000000 | 2.5e+08 | 0.996 | ns |
| clickbench_q13/DuckDB:parquet | 415000000 | 4.12e+08 | 1.00728 | ns |
| clickbench_q14/DuckDB:parquet | 281000000 | 2.84e+08 | 0.989437 | ns |
| clickbench_q15/DuckDB:parquet | 225000000 | 2.28e+08 | 0.986842 | ns |
| clickbench_q16/DuckDB:parquet | 550000000 | 5.54e+08 | 0.99278 | ns |
| clickbench_q17/DuckDB:parquet | 465000000 | 4.67e+08 | 0.995717 | ns |
| clickbench_q18/DuckDB:parquet | 910000000 | 9.17e+08 | 0.992366 | ns |
| clickbench_q19/DuckDB:parquet | 52000000 | 5.2e+07 | 1 | ns |
| clickbench_q20/DuckDB:parquet | 333000000 | 3.33e+08 | 1 | ns |
| clickbench_q21/DuckDB:parquet | 432000000 | 4.4e+08 | 0.981818 | ns |
| clickbench_q22/DuckDB:parquet | 737000000 | 7.39e+08 | 0.997294 | ns |
| clickbench_q23/DuckDB:parquet | 284000000 | 2.81e+08 | 1.01068 | ns |
| clickbench_q24/DuckDB:parquet | 94000000 | 9.3e+07 | 1.01075 | ns |
| clickbench_q25/DuckDB:parquet | 127000000 | 1.27e+08 | 1 | ns |
| clickbench_q26/DuckDB:parquet | 59000000 | 5.8e+07 | 1.01724 | ns |
| clickbench_q27/DuckDB:parquet | 510000000 | 5.13e+08 | 0.994152 | ns |
| clickbench_q28/DuckDB:parquet | 5958000000 | 6.004e+09 | 0.992338 | ns |
| clickbench_q29/DuckDB:parquet | 57000000 | 5.8e+07 | 0.982759 | ns |
| clickbench_q30/DuckDB:parquet | 272000000 | 2.74e+08 | 0.992701 | ns |
| clickbench_q31/DuckDB:parquet | 328000000 | 3.3e+08 | 0.993939 | ns |
| clickbench_q32/DuckDB:parquet | 1047000000 | 1.059e+09 | 0.988669 | ns |
| clickbench_q33/DuckDB:parquet | 1049000000 | 1.051e+09 | 0.998097 | ns |
| clickbench_q34/DuckDB:parquet | 1099000000 | 1.114e+09 | 0.986535 | ns |
| clickbench_q35/DuckDB:parquet | 300000000 | 3.21e+08 | 0.934579 | ns |
| clickbench_q36/DuckDB:parquet | 57000000 | 5.8e+07 | 0.982759 | ns |
| clickbench_q37/DuckDB:parquet | 44000000 | 4.7e+07 | 0.93617 | ns |
| clickbench_q38/DuckDB:parquet | 49000000 | 4.7e+07 | 1.04255 | ns |
| clickbench_q39/DuckDB:parquet | 90000000 | 8.8e+07 | 1.02273 | ns |
| clickbench_q40/DuckDB:parquet | 46000000 | 4.7e+07 | 0.978723 | ns |
| clickbench_q41/DuckDB:parquet | 52000000 | 5.2e+07 | 1 | ns |
| clickbench_q42/DuckDB:parquet | 42000000 | 4.2e+07 | 1 | ns |
| clickbench_q00/DuckDB:vortex-file-compressed | 18000000 | 2.6e+07 | 0.692308 | ns |
| clickbench_q01/DuckDB:vortex-file-compressed | 31000000 | 3.4e+07 | 0.911765 | ns |
| clickbench_q02/DuckDB:vortex-file-compressed | 43000000 | 1.41e+08 | 0.304965 | ns |
| clickbench_q03/DuckDB:vortex-file-compressed | 52000000 | 8.6e+07 | 0.604651 | ns |
| clickbench_q04/DuckDB:vortex-file-compressed | 233000000 | 2.46e+08 | 0.947154 | ns |
| clickbench_q05/DuckDB:vortex-file-compressed | 340000000 | 3.34e+08 | 1.01796 | ns |
| clickbench_q06/DuckDB:vortex-file-compressed | 42000000 | 7.6e+07 | 0.552632 | ns |
| clickbench_q07/DuckDB:vortex-file-compressed | 37000000 | 4e+07 | 0.925 | ns |
| clickbench_q08/DuckDB:vortex-file-compressed | 281000000 | 3.52e+08 | 0.798295 | ns |
| clickbench_q09/DuckDB:vortex-file-compressed | 370000000 | 5.01e+08 | 0.738523 | ns |
| clickbench_q10/DuckDB:vortex-file-compressed | 118000000 | 1.24e+08 | 0.951613 | ns |
| clickbench_q11/DuckDB:vortex-file-compressed | 135000000 | 1.36e+08 | 0.992647 | ns |
| clickbench_q12/DuckDB:vortex-file-compressed | 327000000 | 3.14e+08 | 1.0414 | ns |
| clickbench_q13/DuckDB:vortex-file-compressed | 509000000 | 5.04e+08 | 1.00992 | ns |
| clickbench_q14/DuckDB:vortex-file-compressed | 344000000 | 3.27e+08 | 1.05199 | ns |
| clickbench_q15/DuckDB:vortex-file-compressed | 247000000 | 2.68e+08 | 0.921642 | ns |
| clickbench_q16/DuckDB:vortex-file-compressed | 648000000 | 7.53e+08 | 0.860558 | ns |
| clickbench_q17/DuckDB:vortex-file-compressed | 569000000 | 6.69e+08 | 0.850523 | ns |
| clickbench_q18/DuckDB:vortex-file-compressed | 1155000000 | 1.295e+09 | 0.891892 | ns |
| clickbench_q19/DuckDB:vortex-file-compressed | 338000000 | 3.77e+08 | 0.896552 | ns |
| clickbench_q20/DuckDB:vortex-file-compressed | 562000000 | 5.04e+08 | 1.11508 | ns |
| clickbench_q21/DuckDB:vortex-file-compressed | 496000000 | 4.69e+08 | 1.05757 | ns |
| clickbench_q22/DuckDB:vortex-file-compressed | 881000000 | 7.55e+08 | 1.16689 | ns |
| clickbench_q23/DuckDB:vortex-file-compressed | 1945000000 | 1.702e+09 | 1.14277 | ns |
| clickbench_q24/DuckDB:vortex-file-compressed | 179000000 | 1.78e+08 | 1.00562 | ns |
| clickbench_q25/DuckDB:vortex-file-compressed | 142000000 | 1.44e+08 | 0.986111 | ns |
| clickbench_q26/DuckDB:vortex-file-compressed | 181000000 | 1.83e+08 | 0.989071 | ns |
| clickbench_q27/DuckDB:vortex-file-compressed | 674000000 | 6.24e+08 | 1.08013 | ns |
| clickbench_q28/DuckDB:vortex-file-compressed | 7327000000 | 7.216e+09 | 1.01538 | ns |
| clickbench_q29/DuckDB:vortex-file-compressed | 43000000 | 1e+08 | 0.43 | ns |
| clickbench_q30/DuckDB:vortex-file-compressed | 274000000 | 2.83e+08 | 0.968198 | ns |
| clickbench_q31/DuckDB:vortex-file-compressed | 377000000 | 3.85e+08 | 0.979221 | ns |
| clickbench_q32/DuckDB:vortex-file-compressed | 1161000000 | 1.266e+09 | 0.917062 | ns |
| clickbench_q33/DuckDB:vortex-file-compressed | 1550000000 | 1.401e+09 | 1.10635 | ns |
| clickbench_q34/DuckDB:vortex-file-compressed | 1514000000 | 1.526e+09 | 0.992136 | ns |
| clickbench_q35/DuckDB:vortex-file-compressed | 346000000 | 3.81e+08 | 0.908136 | ns |
| clickbench_q36/DuckDB:vortex-file-compressed | 45000000 | 4.4e+07 | 1.02273 | ns |
| clickbench_q37/DuckDB:vortex-file-compressed | 31000000 | 3.5e+07 | 0.885714 | ns |
| clickbench_q38/DuckDB:vortex-file-compressed | 35000000 | 3.2e+07 | 1.09375 | ns |
| clickbench_q39/DuckDB:vortex-file-compressed | 72000000 | 8.1e+07 | 0.888889 | ns |
| clickbench_q40/DuckDB:vortex-file-compressed | 31000000 | 3.1e+07 | 1 | ns |
| clickbench_q41/DuckDB:vortex-file-compressed | 32000000 | 3.1e+07 | 1.03226 | ns |
| clickbench_q42/DuckDB:vortex-file-compressed | 32000000 | 3e+07 | 1.06667 | ns |
| clickbench_q00/DuckDB:duckdb | 19000000 | 1.9e+07 | 1 | ns |
| clickbench_q01/DuckDB:duckdb | 42000000 | 4.2e+07 | 1 | ns |
| clickbench_q02/DuckDB:duckdb | 65000000 | 6.5e+07 | 1 | ns |
| clickbench_q03/DuckDB:duckdb | 59000000 | 5.8e+07 | 1.01724 | ns |
| clickbench_q04/DuckDB:duckdb | 210000000 | 2.1e+08 | 1 | ns |
| clickbench_q05/DuckDB:duckdb | 215000000 | 2.16e+08 | 0.99537 | ns |
| clickbench_q06/DuckDB:duckdb | 38000000 | 3.9e+07 | 0.974359 | ns |
| clickbench_q07/DuckDB:duckdb | 43000000 | 4.2e+07 | 1.02381 | ns |
| clickbench_q08/DuckDB:duckdb | 254000000 | 2.54e+08 | 1 | ns |
| clickbench_q09/DuckDB:duckdb | 346000000 | 3.5e+08 | 0.988571 | ns |
| clickbench_q10/DuckDB:duckdb | 126000000 | 1.27e+08 | 0.992126 | ns |
| clickbench_q11/DuckDB:duckdb | 140000000 | 1.42e+08 | 0.985915 | ns |
| clickbench_q12/DuckDB:duckdb | 225000000 | 2.25e+08 | 1 | ns |
| clickbench_q13/DuckDB:duckdb | 404000000 | 4.04e+08 | 1 | ns |
| clickbench_q14/DuckDB:duckdb | 257000000 | 2.52e+08 | 1.01984 | ns |
| clickbench_q15/DuckDB:duckdb | 227000000 | 2.29e+08 | 0.991266 | ns |
| clickbench_q16/DuckDB:duckdb | 519000000 | 5.26e+08 | 0.986692 | ns |
| clickbench_q17/DuckDB:duckdb | 434000000 | 4.34e+08 | 1 | ns |
| clickbench_q18/DuckDB:duckdb | 895000000 | 9e+08 | 0.994444 | ns |
| clickbench_q19/DuckDB:duckdb | 39000000 | 3.8e+07 | 1.02632 | ns |
| clickbench_q20/DuckDB:duckdb | 383000000 | 3.86e+08 | 0.992228 | ns |
| clickbench_q21/DuckDB:duckdb | 390000000 | 3.87e+08 | 1.00775 | ns |
| clickbench_q22/DuckDB:duckdb | 619000000 | 6.28e+08 | 0.985669 | ns |
| clickbench_q23/DuckDB:duckdb | 96000000 | 9.7e+07 | 0.989691 | ns |
| clickbench_q24/DuckDB:duckdb | 48000000 | 4.9e+07 | 0.979592 | ns |
| clickbench_q25/DuckDB:duckdb | 72000000 | 7.2e+07 | 1 | ns |
| clickbench_q26/DuckDB:duckdb | 46000000 | 4.6e+07 | 1 | ns |
| clickbench_q27/DuckDB:duckdb | 445000000 | 4.49e+08 | 0.991091 | ns |
| clickbench_q28/DuckDB:duckdb | 5951000000 | 5.971e+09 | 0.99665 | ns |
| clickbench_q29/DuckDB:duckdb | 54000000 | 5.5e+07 | 0.981818 | ns |
| clickbench_q30/DuckDB:duckdb | 253000000 | 2.54e+08 | 0.996063 | ns |
| clickbench_q31/DuckDB:duckdb | 353000000 | 3.64e+08 | 0.96978 | ns |
| clickbench_q32/DuckDB:duckdb | 1066000000 | 1.071e+09 | 0.995331 | ns |
| clickbench_q33/DuckDB:duckdb | 1078000000 | 1.076e+09 | 1.00186 | ns |
| clickbench_q34/DuckDB:duckdb | 1113000000 | 1.109e+09 | 1.00361 | ns |
| clickbench_q35/DuckDB:duckdb | 288000000 | 2.63e+08 | 1.09506 | ns |
| clickbench_q36/DuckDB:duckdb | 41000000 | 4.1e+07 | 1 | ns |
| clickbench_q37/DuckDB:duckdb | 33000000 | 3.3e+07 | 1 | ns |
| clickbench_q38/DuckDB:duckdb | 34000000 | 3.4e+07 | 1 | ns |
| clickbench_q39/DuckDB:duckdb | 61000000 | 6.1e+07 | 1 | ns |
| clickbench_q40/DuckDB:duckdb | 33000000 | 3.3e+07 | 1 | ns |
| clickbench_q41/DuckDB:duckdb | 34000000 | 3.4e+07 | 1 | ns |
| clickbench_q42/DuckDB:duckdb | 33000000 | 3.3e+07 | 1 | ns |
Benchmarks: random_access
Table of Results
| name | PR b919d4cd | base 54c09f66 | ratio (PR/base) | unit |
|---|---|---|---|---|
| random-access/vortex-tokio-local-disk | 1972413 | 1.65637e+06 | 1.1908 | ns |
| random-access/parquet-tokio-local-disk | 186258441 | 1.87295e+08 | 0.994468 | ns |
Benchmarks: compress
Table of Results
| name | PR b919d4cd | base 54c09f66 | ratio (PR/base) | unit |
|---|---|---|---|---|
| compress time/taxi | 1.16464e+09 | 1.11729e+09 | 1.04239 | ns |
| parquet_rs-zstd compress time/taxi | 1.83436e+09 | 1.77273e+09 | 1.03477 | ns |
| decompress time/taxi | 1.25322e+08 | 1.26114e+08 | 0.993719 | ns |
| parquet_rs-zstd decompress time/taxi | 2.87158e+08 | 2.73604e+08 | 1.04954 | ns |
| compress time/Arade | 1.83795e+09 | 1.7112e+09 | 1.07407 | ns |
| parquet_rs-zstd compress time/Arade | 3.04384e+09 | 2.99423e+09 | 1.01657 | ns |
| decompress time/Arade | 2.27185e+08 | 2.26868e+08 | 1.0014 | ns |
| parquet_rs-zstd decompress time/Arade | 6.47897e+08 | 6.25655e+08 | 1.03555 | ns |
| compress time/Bimbo | 1.01196e+10 | 9.38355e+09 | 1.07844 | ns |
| parquet_rs-zstd compress time/Bimbo | 2.13157e+10 | 2.03109e+10 | 1.04947 | ns |
| decompress time/Bimbo | 1.17076e+09 | 1.01883e+09 | 1.14912 | ns |
| parquet_rs-zstd decompress time/Bimbo | 2.64379e+09 | 2.55677e+09 | 1.03403 | ns |
| compress time/CMSprovider | 7.77348e+09 | 7.22123e+09 | 1.07648 | ns |
| parquet_rs-zstd compress time/CMSprovider | 8.92692e+09 | 8.60292e+09 | 1.03766 | ns |
| decompress time/CMSprovider | 7.1348e+08 | 7.02003e+08 | 1.01635 | ns |
| parquet_rs-zstd decompress time/CMSprovider | 1.55424e+09 | 1.49686e+09 | 1.03834 | ns |
| compress time/Euro2016 | 1.92952e+09 | 1.81044e+09 | 1.06578 | ns |
| parquet_rs-zstd compress time/Euro2016 | 1.57302e+09 | 1.51452e+09 | 1.03862 | ns |
| decompress time/Euro2016 | 2.1787e+08 | 2.12818e+08 | 1.02374 | ns |
| parquet_rs-zstd decompress time/Euro2016 | 4.41227e+08 | 4.05423e+08 | 1.08831 | ns |
| compress time/Food | 6.00697e+08 | 5.64906e+08 | 1.06336 | ns |
| parquet_rs-zstd compress time/Food | 1.04936e+09 | 1.0297e+09 | 1.0191 | ns |
| decompress time/Food | 9.01667e+07 | 8.66591e+07 | 1.04048 | ns |
| parquet_rs-zstd decompress time/Food | 2.02189e+08 | 1.92827e+08 | 1.04855 | ns |
| compress time/HashTags | 4.70368e+09 | 4.40508e+09 | 1.06779 | ns |
| parquet_rs-zstd compress time/HashTags | 2.88052e+09 | 2.73304e+09 | 1.05396 | ns |
| decompress time/HashTags | 1.83812e+09 | 1.79071e+09 | 1.02647 | ns |
| parquet_rs-zstd decompress time/HashTags | 7.2452e+08 | 6.4863e+08 | 1.117 | ns |
| compress time/TPC-H l_comment chunked | 1.02721e+09 | 9.98744e+08 | 1.0285 | ns |
| parquet_rs-zstd compress time/TPC-H l_comment chunked | 8.72662e+08 | 8.46047e+08 | 1.03146 | ns |
| decompress time/TPC-H l_comment chunked | 1.02372e+08 | 1.00473e+08 | 1.01891 | ns |
| parquet_rs-zstd decompress time/TPC-H l_comment chunked | 2.44354e+08 | 2.2797e+08 | 1.07187 | ns |
| compress time/TPC-H l_comment canonical | 2.10074e+09 | 2.05369e+09 | 1.02291 | ns |
| parquet_rs-zstd compress time/TPC-H l_comment canonical | 8.8598e+08 | 8.64127e+08 | 1.02529 | ns |
| decompress time/TPC-H l_comment canonical | 1.07224e+08 | 1.05103e+08 | 1.02018 | ns |
| parquet_rs-zstd decompress time/TPC-H l_comment canonical | 2.45539e+08 | 2.2775e+08 | 1.07811 | ns |
| compress time/wide table cols=10 chunks=1 rows=1000 | 1.3191e+06 | 1.23003e+06 | 1.07241 | ns |
| parquet_rs-zstd compress time/wide table cols=10 chunks=1 rows=1000 | 811243 | 752783 | 1.07766 | ns |
| decompress time/wide table cols=10 chunks=1 rows=1000 | 182845 | 192545 | 0.949622 | ns |
| parquet_rs-zstd decompress time/wide table cols=10 chunks=1 rows=1000 | 267484 | 264196 | 1.01245 | ns |
| compress time/wide table cols=100 chunks=1 rows=1000 | 1.26871e+07 | 1.18192e+07 | 1.07343 | ns |
| parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 | 8.16467e+06 | 7.18285e+06 | 1.13669 | ns |
| decompress time/wide table cols=100 chunks=1 rows=1000 | 1.80228e+06 | 1.65506e+06 | 1.08895 | ns |
| parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 | 2.68012e+06 | 2.62349e+06 | 1.02159 | ns |
| compress time/wide table cols=1000 chunks=1 rows=1000 | 1.37702e+08 | 1.24667e+08 | 1.10456 | ns |
| parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 | 9.22245e+07 | 8.65643e+07 | 1.06539 | ns |
| decompress time/wide table cols=1000 chunks=1 rows=1000 | 3.86475e+07 | 3.23341e+07 | 1.19525 | ns |
| parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 | 2.97778e+07 | 2.75545e+07 | 1.08068 | ns |
| compress time/wide table cols=10 chunks=50 rows=1000 | 3.639e+06 | 3.47979e+06 | 1.04575 | ns |
| parquet_rs-zstd compress time/wide table cols=10 chunks=50 rows=1000 | 1.06044e+06 | 1.012e+06 | 1.04786 | ns |
| decompress time/wide table cols=10 chunks=50 rows=1000 | 178155 | 174856 | 1.01887 | ns |
| parquet_rs-zstd decompress time/wide table cols=10 chunks=50 rows=1000 | 261247 | 259271 | 1.00762 | ns |
| compress time/wide table cols=100 chunks=50 rows=1000 | 3.75274e+07 | 3.35482e+07 | 1.11861 | ns |
| parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 | 1.20063e+07 | 1.02395e+07 | 1.17255 | ns |
| decompress time/wide table cols=100 chunks=50 rows=1000 | 1.73582e+06 | 1.61134e+06 | 1.07726 | ns |
| parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 | 2.68034e+06 | 2.62713e+06 | 1.02025 | ns |
| compress time/wide table cols=1000 chunks=50 rows=1000 | 3.91958e+08 | 3.8103e+08 | 1.02868 | ns |
| parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 | 1.58976e+08 | 1.43775e+08 | 1.10573 | ns |
| decompress time/wide table cols=1000 chunks=50 rows=1000 | 3.47915e+07 | 3.21132e+07 | 1.0834 | ns |
| parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 | 3.00471e+07 | 2.72329e+07 | 1.10334 | ns |
| vortex size/taxi | 5.48475e+07 | 5.48475e+07 | 1 | bytes |
| parquet-zstd size/taxi | 5.59542e+07 | 5.59542e+07 | 1 | bytes |
| vortex:parquet-zstd size/taxi | 0.980222 | 0.980222 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/taxi | 0.634906 | 0.630265 | 1.00736 | ratio |
| vortex:parquet-zstd ratio decompress time/taxi | 0.43642 | 0.460935 | 0.946813 | ratio |
| vortex size/Arade | 1.63813e+08 | 1.63813e+08 | 1 | bytes |
| parquet-zstd size/Arade | 3.0538e+08 | 3.0538e+08 | 1 | bytes |
| vortex:parquet-zstd size/Arade | 0.536424 | 0.536424 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/Arade | 0.603828 | 0.5715 | 1.05657 | ratio |
| vortex:parquet-zstd ratio decompress time/Arade | 0.350651 | 0.362609 | 0.967022 | ratio |
| vortex size/Bimbo | 5.37111e+08 | 5.37111e+08 | 1 | bytes |
| parquet-zstd size/Bimbo | 3.89789e+08 | 3.89789e+08 | 1 | bytes |
| vortex:parquet-zstd size/Bimbo | 1.37795 | 1.37795 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/Bimbo | 0.474748 | 0.461995 | 1.0276 | ratio |
| vortex:parquet-zstd ratio decompress time/Bimbo | 0.442833 | 0.398481 | 1.1113 | ratio |
| vortex size/CMSprovider | 4.91306e+08 | 4.91306e+08 | 1 | bytes |
| parquet-zstd size/CMSprovider | 3.84908e+08 | 3.84908e+08 | 1 | bytes |
| vortex:parquet-zstd size/CMSprovider | 1.27642 | 1.27642 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/CMSprovider | 0.870791 | 0.839393 | 1.03741 | ratio |
| vortex:parquet-zstd ratio decompress time/CMSprovider | 0.459053 | 0.468984 | 0.978825 | ratio |
| vortex size/Euro2016 | 1.80199e+08 | 1.80199e+08 | 1 | bytes |
| parquet-zstd size/Euro2016 | 1.23121e+08 | 1.23121e+08 | 1 | bytes |
| vortex:parquet-zstd size/Euro2016 | 1.46359 | 1.46359 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/Euro2016 | 1.22663 | 1.19538 | 1.02614 | ratio |
| vortex:parquet-zstd ratio decompress time/Euro2016 | 0.493782 | 0.524929 | 0.940664 | ratio |
| vortex size/Food | 4.61732e+07 | 4.61732e+07 | 1 | bytes |
| parquet-zstd size/Food | 3.62159e+07 | 3.62159e+07 | 1 | bytes |
| vortex:parquet-zstd size/Food | 1.27494 | 1.27494 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/Food | 0.57244 | 0.548614 | 1.04343 | ratio |
| vortex:parquet-zstd ratio decompress time/Food | 0.445953 | 0.449413 | 0.992302 | ratio |
| vortex size/HashTags | 2.09619e+08 | 2.09619e+08 | 1 | bytes |
| parquet-zstd size/HashTags | 1.33942e+08 | 1.33942e+08 | 1 | bytes |
| vortex:parquet-zstd size/HashTags | 1.565 | 1.565 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/HashTags | 1.63293 | 1.61179 | 1.01312 | ratio |
| vortex:parquet-zstd ratio decompress time/HashTags | 2.53702 | 2.76076 | 0.918956 | ratio |
| vortex size/TPC-H l_comment chunked | 8.50359e+07 | 8.55738e+07 | 0.993714 | bytes |
| parquet-zstd size/TPC-H l_comment chunked | 5.69195e+07 | 5.69176e+07 | 1.00003 | bytes |
| vortex:parquet-zstd size/TPC-H l_comment chunked | 1.49397 | 1.50347 | 0.99368 | ratio |
| vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked | 1.1771 | 1.18048 | 0.997135 | ratio |
| vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked | 0.41895 | 0.440728 | 0.950588 | ratio |
| vortex size/TPC-H l_comment canonical | 8.52733e+07 | 8.55002e+07 | 0.997345 | bytes |
| parquet-zstd size/TPC-H l_comment canonical | 5.69202e+07 | 5.69183e+07 | 1.00003 | bytes |
| vortex:parquet-zstd size/TPC-H l_comment canonical | 1.49812 | 1.50216 | 0.997313 | ratio |
| vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical | 2.37109 | 2.37661 | 0.997677 | ratio |
| vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical | 0.436689 | 0.461486 | 0.946269 | ratio |
| vortex size/wide table cols=10 chunks=1 rows=1000 | 108880 | 108880 | 1 | bytes |
| parquet-zstd size/wide table cols=10 chunks=1 rows=1000 | 93484 | 93484 | 1 | bytes |
| vortex:parquet-zstd size/wide table cols=10 chunks=1 rows=1000 | 1.16469 | 1.16469 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/wide table cols=10 chunks=1 rows=1000 | 1.62602 | 1.63398 | 0.995128 | ratio |
| vortex:parquet-zstd ratio decompress time/wide table cols=10 chunks=1 rows=1000 | 0.683574 | 0.728796 | 0.937949 | ratio |
| vortex size/wide table cols=100 chunks=1 rows=1000 | 1.08268e+06 | 1.08268e+06 | 1 | bytes |
| parquet-zstd size/wide table cols=100 chunks=1 rows=1000 | 934804 | 934804 | 1 | bytes |
| vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 | 1.15819 | 1.15819 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 | 1.55391 | 1.64548 | 0.944348 | ratio |
| vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 | 0.672464 | 0.630863 | 1.06594 | ratio |
| vortex size/wide table cols=1000 chunks=1 rows=1000 | 1.08207e+07 | 1.08207e+07 | 1 | bytes |
| parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 | 9.348e+06 | 9.348e+06 | 1 | bytes |
| vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 | 1.15754 | 1.15754 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 | 1.49312 | 1.44016 | 1.03677 | ratio |
| vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 | 1.29786 | 1.17346 | 1.10602 | ratio |
| vortex size/wide table cols=10 chunks=50 rows=1000 | 108880 | 108880 | 1 | bytes |
| parquet-zstd size/wide table cols=10 chunks=50 rows=1000 | 93484 | 93484 | 1 | bytes |
| vortex:parquet-zstd size/wide table cols=10 chunks=50 rows=1000 | 1.16469 | 1.16469 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/wide table cols=10 chunks=50 rows=1000 | 3.4316 | 3.43853 | 0.997985 | ratio |
| vortex:parquet-zstd ratio decompress time/wide table cols=10 chunks=50 rows=1000 | 0.681941 | 0.674414 | 1.01116 | ratio |
| vortex size/wide table cols=100 chunks=50 rows=1000 | 1.08268e+06 | 1.08268e+06 | 1 | bytes |
| parquet-zstd size/wide table cols=100 chunks=50 rows=1000 | 934804 | 934804 | 1 | bytes |
| vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 | 1.15819 | 1.15819 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 | 3.12563 | 3.27636 | 0.953994 | ratio |
| vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 | 0.647614 | 0.613345 | 1.05587 | ratio |
| vortex size/wide table cols=1000 chunks=50 rows=1000 | 1.08207e+07 | 1.08207e+07 | 1 | bytes |
| parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 | 9.348e+06 | 9.348e+06 | 1 | bytes |
| vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 | 1.15754 | 1.15754 | 1 | ratio |
| vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 | 2.46552 | 2.65018 | 0.930321 | ratio |
| vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 | 1.1579 | 1.17921 | 0.981934 | ratio |