Take 3 on supporting dynamic expression in DF
Inspired by @adriangb's attempt and some conversations
Benchmarks: TPC-H SF=1 on NVME
Summary
- Overall: 1.155x ❌
- Vortex: 1.269x ❌
- duckdb:vortex: 0.994x ➖
- datafusion:vortex: 1.620x ❌
- Best: tpch_q11/duckdb:vortex-compact (0.879x)
- Worst: tpch_q09/datafusion:vortex-compact (7.385x)
- Significant (>10%): 1↑ 34↓
Detailed Results Table
| name | PR d45a27d4 | base 7541a3b3 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| tpch_q01/datafusion:arrow | 64349177 | 6.03741e+07 | 1.06584 | ns | |
| tpch_q02/datafusion:arrow | 25142135 | 1.8729e+07 | 1.34242 | ns | 🚨 |
| tpch_q03/datafusion:arrow | 27839817 | 2.31527e+07 | 1.20244 | ns | |
| tpch_q04/datafusion:arrow | 15475158 | 1.26486e+07 | 1.22347 | ns | |
| tpch_q05/datafusion:arrow | 41439686 | 3.29473e+07 | 1.25776 | ns | |
| tpch_q06/datafusion:arrow | 10164678 | 7.44837e+06 | 1.36469 | ns | 🚨 |
| tpch_q07/datafusion:arrow | 60620248 | 5.34018e+07 | 1.13517 | ns | |
| tpch_q08/datafusion:arrow | 27051065 | 1.90928e+07 | 1.41682 | ns | 🚨 |
| tpch_q09/datafusion:arrow | 39661210 | 3.25479e+07 | 1.21855 | ns | |
| tpch_q10/datafusion:arrow | 36183896 | 2.8062e+07 | 1.28943 | ns | |
| tpch_q11/datafusion:arrow | 42094704 | 3.89622e+07 | 1.0804 | ns | |
| tpch_q12/datafusion:arrow | 24831269 | 1.91793e+07 | 1.29469 | ns | |
| tpch_q13/datafusion:arrow | 20489913 | 1.83465e+07 | 1.11683 | ns | |
| tpch_q14/datafusion:arrow | 10886778 | 7.33762e+06 | 1.48369 | ns | 🚨 |
| tpch_q15/datafusion:arrow | 21672351 | 1.34736e+07 | 1.6085 | ns | 🚨 |
| tpch_q16/datafusion:arrow | 18772840 | 1.52555e+07 | 1.23056 | ns | |
| tpch_q17/datafusion:arrow | 56144833 | 4.9878e+07 | 1.12564 | ns | |
| tpch_q18/datafusion:arrow | 111497904 | 1.01547e+08 | 1.098 | ns | |
| tpch_q19/datafusion:arrow | 23299488 | 1.68197e+07 | 1.38525 | ns | 🚨 |
| tpch_q20/datafusion:arrow | 27123043 | 2.047e+07 | 1.32501 | ns | 🚨 |
| tpch_q21/datafusion:arrow | 86691287 | 7.74796e+07 | 1.11889 | ns | |
| tpch_q22/datafusion:arrow | 13992505 | 1.02343e+07 | 1.36721 | ns | 🚨 |
| tpch_q01/datafusion:parquet | 179157117 | 1.57143e+08 | 1.14009 | ns | |
| tpch_q02/datafusion:parquet | 97712347 | 9.37326e+07 | 1.04246 | ns | |
| tpch_q03/datafusion:parquet | 93335743 | 8.56312e+07 | 1.08997 | ns | |
| tpch_q04/datafusion:parquet | 57470363 | 5.88889e+07 | 0.975912 | ns | |
| tpch_q05/datafusion:parquet | 110762333 | 1.09941e+08 | 1.00747 | ns | |
| tpch_q06/datafusion:parquet | 46264897 | 3.61897e+07 | 1.2784 | ns | |
| tpch_q07/datafusion:parquet | 143394823 | 1.33305e+08 | 1.07569 | ns | |
| tpch_q08/datafusion:parquet | 131700581 | 1.28014e+08 | 1.02879 | ns | |
| tpch_q09/datafusion:parquet | 163247393 | 1.58754e+08 | 1.0283 | ns | |
| tpch_q10/datafusion:parquet | 130648944 | 1.23885e+08 | 1.0546 | ns | |
| tpch_q11/datafusion:parquet | 77883314 | 7.08045e+07 | 1.09998 | ns | |
| tpch_q12/datafusion:parquet | 94488163 | 9.73581e+07 | 0.970522 | ns | |
| tpch_q13/datafusion:parquet | 205004567 | 2.03064e+08 | 1.00955 | ns | |
| tpch_q14/datafusion:parquet | 46713944 | 4.89603e+07 | 0.95412 | ns | |
| tpch_q15/datafusion:parquet | 67112251 | 6.55122e+07 | 1.02442 | ns | |
| tpch_q16/datafusion:parquet | 50983290 | 4.8694e+07 | 1.04701 | ns | |
| tpch_q17/datafusion:parquet | 136347371 | 1.51507e+08 | 0.899941 | ns | |
| tpch_q18/datafusion:parquet | 188233335 | 1.90941e+08 | 0.985818 | ns | |
| tpch_q19/datafusion:parquet | 108737408 | 1.07171e+08 | 1.01462 | ns | |
| tpch_q20/datafusion:parquet | 73494464 | 7.38475e+07 | 0.99522 | ns | |
| tpch_q21/datafusion:parquet | 152809053 | 1.52901e+08 | 0.999402 | ns | |
| tpch_q22/datafusion:parquet | 72456107 | 6.93973e+07 | 1.04408 | ns | |
| tpch_q01/datafusion:vortex-file-compressed | 65232841 | 6.63918e+07 | 0.982543 | ns | |
| tpch_q02/datafusion:vortex-file-compressed | 106561058 | 3.90428e+07 | 2.72934 | ns | 🚨 |
| tpch_q03/datafusion:vortex-file-compressed | 40899786 | 2.74332e+07 | 1.49089 | ns | 🚨 |
| tpch_q04/datafusion:vortex-file-compressed | 19974061 | 1.83852e+07 | 1.08642 | ns | |
| tpch_q05/datafusion:vortex-file-compressed | 94066576 | 6.646e+07 | 1.41539 | ns | 🚨 |
| tpch_q06/datafusion:vortex-file-compressed | 11379836 | 1.0822e+07 | 1.05155 | ns | |
| tpch_q07/datafusion:vortex-file-compressed | 158187477 | 7.31447e+07 | 2.16267 | ns | 🚨 |
| tpch_q08/datafusion:vortex-file-compressed | 155711717 | 4.59479e+07 | 3.38888 | ns | 🚨 |
| tpch_q09/datafusion:vortex-file-compressed | 219530652 | 6.1604e+07 | 3.56358 | ns | 🚨 |
| tpch_q10/datafusion:vortex-file-compressed | 75499376 | 5.20963e+07 | 1.44923 | ns | 🚨 |
| tpch_q11/datafusion:vortex-file-compressed | 42627758 | 2.71438e+07 | 1.57044 | ns | 🚨 |
| tpch_q12/datafusion:vortex-file-compressed | 24263261 | 2.17905e+07 | 1.11348 | ns | |
| tpch_q13/datafusion:vortex-file-compressed | 31050513 | 2.92747e+07 | 1.06066 | ns | |
| tpch_q14/datafusion:vortex-file-compressed | 25735805 | 1.51746e+07 | 1.69598 | ns | 🚨 |
| tpch_q15/datafusion:vortex-file-compressed | 25658287 | 2.3015e+07 | 1.11485 | ns | |
| tpch_q16/datafusion:vortex-file-compressed | 25502667 | 2.2141e+07 | 1.15183 | ns | |
| tpch_q17/datafusion:vortex-file-compressed | 70244530 | 6.2316e+07 | 1.12723 | ns | |
| tpch_q18/datafusion:vortex-file-compressed | 102527241 | 9.88147e+07 | 1.03757 | ns | |
| tpch_q19/datafusion:vortex-file-compressed | 59385975 | 2.27997e+07 | 2.60468 | ns | 🚨 |
| tpch_q20/datafusion:vortex-file-compressed | 34789251 | 2.77382e+07 | 1.2542 | ns | |
| tpch_q21/datafusion:vortex-file-compressed | 149208429 | 7.41729e+07 | 2.01163 | ns | 🚨 |
| tpch_q22/datafusion:vortex-file-compressed | 20451564 | 1.71652e+07 | 1.19146 | ns | |
| tpch_q01/datafusion:vortex-compact | 71000033 | 6.85557e+07 | 1.03566 | ns | |
| tpch_q02/datafusion:vortex-compact | 158086667 | 4.27954e+07 | 3.69401 | ns | 🚨 |
| tpch_q03/datafusion:vortex-compact | 61332910 | 3.10462e+07 | 1.97554 | ns | 🚨 |
| tpch_q04/datafusion:vortex-compact | 23815232 | 2.18688e+07 | 1.08901 | ns | |
| tpch_q05/datafusion:vortex-compact | 87383659 | 7.05075e+07 | 1.23935 | ns | |
| tpch_q06/datafusion:vortex-compact | 16233128 | 1.5808e+07 | 1.02689 | ns | |
| tpch_q07/datafusion:vortex-compact | 280620093 | 8.08942e+07 | 3.46897 | ns | 🚨 |
| tpch_q08/datafusion:vortex-compact | 268137033 | 4.87049e+07 | 5.50534 | ns | 🚨 |
| tpch_q09/datafusion:vortex-compact | 494026275 | 6.68997e+07 | 7.38458 | ns | 🚨 |
| tpch_q10/datafusion:vortex-compact | 77603155 | 4.8725e+07 | 1.59268 | ns | 🚨 |
| tpch_q11/datafusion:vortex-compact | 48166282 | 2.82324e+07 | 1.70606 | ns | 🚨 |
| tpch_q12/datafusion:vortex-compact | 46504160 | 3.06044e+07 | 1.51953 | ns | 🚨 |
| tpch_q13/datafusion:vortex-compact | 38974057 | 3.53964e+07 | 1.10108 | ns | |
| tpch_q14/datafusion:vortex-compact | 28353182 | 1.99531e+07 | 1.42099 | ns | 🚨 |
| tpch_q15/datafusion:vortex-compact | 38085781 | 3.45973e+07 | 1.10083 | ns | |
| tpch_q16/datafusion:vortex-compact | 31519193 | 3.00774e+07 | 1.04794 | ns | |
| tpch_q17/datafusion:vortex-compact | 100987961 | 7.01493e+07 | 1.43961 | ns | 🚨 |
| tpch_q18/datafusion:vortex-compact | 114375278 | 9.87026e+07 | 1.15879 | ns | |
| tpch_q19/datafusion:vortex-compact | 92098352 | 3.91534e+07 | 2.35225 | ns | 🚨 |
| tpch_q20/datafusion:vortex-compact | 37054786 | 3.5197e+07 | 1.05278 | ns | |
| tpch_q21/datafusion:vortex-compact | 294797732 | 8.26689e+07 | 3.566 | ns | 🚨 |
| tpch_q22/datafusion:vortex-compact | 19775182 | 1.74671e+07 | 1.13214 | ns | |
| tpch_q01/duckdb:parquet | 79863403 | 1.14287e+08 | 0.698796 | ns | 🚀 |
| tpch_q02/duckdb:parquet | 46897401 | 4.71405e+07 | 0.994843 | ns | |
| tpch_q03/duckdb:parquet | 77699391 | 7.74002e+07 | 1.00387 | ns | |
| tpch_q04/duckdb:parquet | 59934694 | 7.20973e+07 | 0.831302 | ns | |
| tpch_q05/duckdb:parquet | 75126658 | 7.4196e+07 | 1.01254 | ns | |
| tpch_q06/duckdb:parquet | 23008223 | 3.3271e+07 | 0.691541 | ns | 🚀 |
| tpch_q07/duckdb:parquet | 80972474 | 8.77045e+07 | 0.923242 | ns | |
| tpch_q08/duckdb:parquet | 97521900 | 1.0794e+08 | 0.903479 | ns | |
| tpch_q09/duckdb:parquet | 151964781 | 1.70498e+08 | 0.891298 | ns | |
| tpch_q10/duckdb:parquet | 139548918 | 1.38895e+08 | 1.00471 | ns | |
| tpch_q11/duckdb:parquet | 25834196 | 2.61716e+07 | 0.987106 | ns | |
| tpch_q12/duckdb:parquet | 59259490 | 5.92552e+07 | 1.00007 | ns | |
| tpch_q13/duckdb:parquet | 279370116 | 2.72729e+08 | 1.02435 | ns | |
| tpch_q14/duckdb:parquet | 53115049 | 6.2694e+07 | 0.847211 | ns | |
| tpch_q15/duckdb:parquet | 29374192 | 2.92549e+07 | 1.00408 | ns | |
| tpch_q16/duckdb:parquet | 59840295 | 6.01474e+07 | 0.994894 | ns | |
| tpch_q17/duckdb:parquet | 58890025 | 7.17834e+07 | 0.820385 | ns | |
| tpch_q18/duckdb:parquet | 144094311 | 1.31721e+08 | 1.09394 | ns | |
| tpch_q19/duckdb:parquet | 92860471 | 7.06967e+07 | 1.3135 | ns | 🚨 |
| tpch_q20/duckdb:parquet | 71649576 | 7.09183e+07 | 1.01031 | ns | |
| tpch_q21/duckdb:parquet | 187925134 | 1.90766e+08 | 0.985109 | ns | |
| tpch_q22/duckdb:parquet | 56959755 | 5.66372e+07 | 1.00569 | ns | |
| tpch_q01/duckdb:vortex-file-compressed | 30352497 | 3.01162e+07 | 1.00785 | ns | |
| tpch_q02/duckdb:vortex-file-compressed | 28228318 | 2.82903e+07 | 0.99781 | ns | |
| tpch_q03/duckdb:vortex-file-compressed | 31360957 | 3.22832e+07 | 0.971433 | ns | |
| tpch_q04/duckdb:vortex-file-compressed | 35488213 | 3.4723e+07 | 1.02204 | ns | |
| tpch_q05/duckdb:vortex-file-compressed | 37003493 | 3.55533e+07 | 1.04079 | ns | |
| tpch_q06/duckdb:vortex-file-compressed | 10188632 | 1.06509e+07 | 0.956596 | ns | |
| tpch_q07/duckdb:vortex-file-compressed | 39483147 | 4.16386e+07 | 0.948235 | ns | |
| tpch_q08/duckdb:vortex-file-compressed | 44034846 | 4.50601e+07 | 0.977247 | ns | |
| tpch_q09/duckdb:vortex-file-compressed | 73005179 | 7.3398e+07 | 0.994648 | ns | |
| tpch_q10/duckdb:vortex-file-compressed | 34665196 | 3.47846e+07 | 0.996568 | ns | |
| tpch_q11/duckdb:vortex-file-compressed | 16002436 | 1.68376e+07 | 0.950397 | ns | |
| tpch_q12/duckdb:vortex-file-compressed | 25343844 | 2.51198e+07 | 1.00892 | ns | |
| tpch_q13/duckdb:vortex-file-compressed | 39218562 | 3.89122e+07 | 1.00787 | ns | |
| tpch_q14/duckdb:vortex-file-compressed | 24128661 | 2.43114e+07 | 0.992481 | ns | |
| tpch_q15/duckdb:vortex-file-compressed | 17247149 | 1.68474e+07 | 1.02372 | ns | |
| tpch_q16/duckdb:vortex-file-compressed | 33482970 | 3.38618e+07 | 0.988811 | ns | |
| tpch_q17/duckdb:vortex-file-compressed | 25805800 | 2.58272e+07 | 0.999173 | ns | |
| tpch_q18/duckdb:vortex-file-compressed | 50878722 | 4.99988e+07 | 1.0176 | ns | |
| tpch_q19/duckdb:vortex-file-compressed | 32330553 | 3.26369e+07 | 0.990614 | ns | |
| tpch_q20/duckdb:vortex-file-compressed | 33273397 | 3.39149e+07 | 0.981084 | ns | |
| tpch_q21/duckdb:vortex-file-compressed | 103440853 | 1.04081e+08 | 0.993852 | ns | |
| tpch_q22/duckdb:vortex-file-compressed | 21695606 | 2.11454e+07 | 1.02602 | ns | |
| tpch_q01/duckdb:vortex-compact | 34598278 | 3.49769e+07 | 0.989174 | ns | |
| tpch_q02/duckdb:vortex-compact | 39603344 | 3.92272e+07 | 1.00959 | ns | |
| tpch_q03/duckdb:vortex-compact | 39014236 | 4.10681e+07 | 0.949989 | ns | |
| tpch_q04/duckdb:vortex-compact | 43688390 | 4.3489e+07 | 1.00458 | ns | |
| tpch_q05/duckdb:vortex-compact | 43183491 | 4.21259e+07 | 1.02511 | ns | |
| tpch_q06/duckdb:vortex-compact | 16240516 | 1.61144e+07 | 1.00782 | ns | |
| tpch_q07/duckdb:vortex-compact | 47973028 | 4.87397e+07 | 0.984269 | ns | |
| tpch_q08/duckdb:vortex-compact | 54217407 | 5.40641e+07 | 1.00284 | ns | |
| tpch_q09/duckdb:vortex-compact | 79394034 | 8.11734e+07 | 0.97808 | ns | |
| tpch_q10/duckdb:vortex-compact | 43839526 | 4.37016e+07 | 1.00316 | ns | |
| tpch_q11/duckdb:vortex-compact | 18248179 | 2.07515e+07 | 0.879368 | ns | |
| tpch_q12/duckdb:vortex-compact | 48370651 | 4.89193e+07 | 0.988785 | ns | |
| tpch_q13/duckdb:vortex-compact | 44220681 | 4.47713e+07 | 0.987701 | ns | |
| tpch_q14/duckdb:vortex-compact | 29603215 | 2.94309e+07 | 1.00586 | ns | |
| tpch_q15/duckdb:vortex-compact | 21780822 | 2.1019e+07 | 1.03624 | ns | |
| tpch_q16/duckdb:vortex-compact | 40786021 | 4.11429e+07 | 0.991326 | ns | |
| tpch_q17/duckdb:vortex-compact | 30581260 | 3.14489e+07 | 0.97241 | ns | |
| tpch_q18/duckdb:vortex-compact | 56290521 | 5.5212e+07 | 1.01953 | ns | |
| tpch_q19/duckdb:vortex-compact | 40348877 | 4.06869e+07 | 0.991692 | ns | |
| tpch_q20/duckdb:vortex-compact | 44757646 | 4.59947e+07 | 0.973104 | ns | |
| tpch_q21/duckdb:vortex-compact | 116569539 | 1.15734e+08 | 1.00722 | ns | |
| tpch_q22/duckdb:vortex-compact | 22851023 | 2.20525e+07 | 1.03621 | ns | |
| tpch_q01/duckdb:duckdb | 17491543 | 1.74868e+07 | 1.00027 | ns | |
| tpch_q02/duckdb:duckdb | 14159345 | 1.44468e+07 | 0.980103 | ns | |
| tpch_q03/duckdb:duckdb | 21645532 | 2.20046e+07 | 0.983681 | ns | |
| tpch_q04/duckdb:duckdb | 20217248 | 2.06364e+07 | 0.97969 | ns | |
| tpch_q05/duckdb:duckdb | 22873354 | 2.37885e+07 | 0.961532 | ns | |
| tpch_q06/duckdb:duckdb | 7210793 | 7.28384e+06 | 0.989971 | ns | |
| tpch_q07/duckdb:duckdb | 26612952 | 2.64861e+07 | 1.00479 | ns | |
| tpch_q08/duckdb:duckdb | 26709324 | 2.6731e+07 | 0.999191 | ns | |
| tpch_q09/duckdb:duckdb | 59805059 | 5.74794e+07 | 1.04046 | ns | |
| tpch_q10/duckdb:duckdb | 58792063 | 5.78873e+07 | 1.01563 | ns | |
| tpch_q11/duckdb:duckdb | 7491447 | 7.65323e+06 | 0.978861 | ns | |
| tpch_q12/duckdb:duckdb | 17529154 | 1.73319e+07 | 1.01138 | ns | |
| tpch_q13/duckdb:duckdb | 40707495 | 3.9206e+07 | 1.0383 | ns | |
| tpch_q14/duckdb:duckdb | 22550678 | 2.25526e+07 | 0.999913 | ns | |
| tpch_q15/duckdb:duckdb | 14040983 | 1.43141e+07 | 0.980921 | ns | |
| tpch_q16/duckdb:duckdb | 25264944 | 2.5246e+07 | 1.00075 | ns | |
| tpch_q17/duckdb:duckdb | 18328644 | 1.83641e+07 | 0.998071 | ns | |
| tpch_q18/duckdb:duckdb | 39821952 | 3.92785e+07 | 1.01384 | ns | |
| tpch_q19/duckdb:duckdb | 32335177 | 3.23316e+07 | 1.00011 | ns | |
| tpch_q20/duckdb:duckdb | 26977633 | 2.68797e+07 | 1.00364 | ns | |
| tpch_q21/duckdb:duckdb | 61854003 | 6.30539e+07 | 0.980971 | ns | |
| tpch_q22/duckdb:duckdb | 27342365 | 2.67932e+07 | 1.0205 | ns |
Benchmarks: FineWeb NVMe
Summary
- Overall: 0.994x ➖
- Vortex: 0.994x ➖
- duckdb:vortex: 1.000x ➖
- datafusion:vortex: 0.989x ➖
- Best: fineweb_q00/duckdb:vortex-compact (0.863x)
- Worst: fineweb_q00/datafusion:vortex-compact (1.127x)
- Significant (>10%): 4↑ 1↓
Detailed Results Table
| name | PR d45a27d4 | base 7541a3b3 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| fineweb_q00/datafusion:parquet | 6475768 | 5.86993e+06 | 1.10321 | ns | |
| fineweb_q00/datafusion:parquet | 6475768 | 6.13096e+06 | 1.05624 | ns | |
| fineweb_q01/datafusion:parquet | 305821496 | 3.05712e+08 | 1.00036 | ns | |
| fineweb_q01/datafusion:parquet | 305821496 | 3.07995e+08 | 0.992944 | ns | |
| fineweb_q02/datafusion:parquet | 299609057 | 3.0108e+08 | 0.995116 | ns | |
| fineweb_q02/datafusion:parquet | 299609057 | 3.04666e+08 | 0.983401 | ns | |
| fineweb_q03/datafusion:parquet | 294900684 | 2.96417e+08 | 0.994886 | ns | |
| fineweb_q03/datafusion:parquet | 294900684 | 2.93826e+08 | 1.00366 | ns | |
| fineweb_q04/datafusion:parquet | 315352029 | 3.26628e+08 | 0.965477 | ns | |
| fineweb_q04/datafusion:parquet | 315352029 | 3.22461e+08 | 0.977954 | ns | |
| fineweb_q05/datafusion:parquet | 309982885 | 3.15189e+08 | 0.983482 | ns | |
| fineweb_q05/datafusion:parquet | 309982885 | 3.20142e+08 | 0.968266 | ns | |
| fineweb_q06/datafusion:parquet | 303529748 | 3.06738e+08 | 0.98954 | ns | |
| fineweb_q06/datafusion:parquet | 303529748 | 3.0688e+08 | 0.989082 | ns | |
| fineweb_q07/datafusion:parquet | 293772500 | 2.99249e+08 | 0.9817 | ns | |
| fineweb_q07/datafusion:parquet | 293772500 | 3.00398e+08 | 0.977943 | ns | |
| fineweb_q08/datafusion:parquet | 291865652 | 2.97008e+08 | 0.982687 | ns | |
| fineweb_q08/datafusion:parquet | 291865652 | 2.96174e+08 | 0.985452 | ns | |
| fineweb_q00/datafusion:vortex-file-compressed | 4717720 | 4.32533e+06 | 1.09072 | ns | |
| fineweb_q00/datafusion:vortex-file-compressed | 4717720 | 4.3619e+06 | 1.08157 | ns | |
| fineweb_q01/datafusion:vortex-file-compressed | 32075298 | 2.96603e+07 | 1.08142 | ns | |
| fineweb_q01/datafusion:vortex-file-compressed | 32075298 | 3.01847e+07 | 1.06264 | ns | |
| fineweb_q02/datafusion:vortex-file-compressed | 30439571 | 2.92489e+07 | 1.04071 | ns | |
| fineweb_q02/datafusion:vortex-file-compressed | 30439571 | 3.24231e+07 | 0.938823 | ns | |
| fineweb_q03/datafusion:vortex-file-compressed | 73969469 | 7.80567e+07 | 0.947638 | ns | |
| fineweb_q03/datafusion:vortex-file-compressed | 73969469 | 8.31577e+07 | 0.889508 | ns | |
| fineweb_q04/datafusion:vortex-file-compressed | 211885103 | 2.16871e+08 | 0.977008 | ns | |
| fineweb_q04/datafusion:vortex-file-compressed | 211885103 | 2.148e+08 | 0.98643 | ns | |
| fineweb_q05/datafusion:vortex-file-compressed | 187357399 | 1.94511e+08 | 0.963225 | ns | |
| fineweb_q05/datafusion:vortex-file-compressed | 187357399 | 1.91633e+08 | 0.977689 | ns | |
| fineweb_q06/datafusion:vortex-file-compressed | 71071254 | 7.19608e+07 | 0.987638 | ns | |
| fineweb_q06/datafusion:vortex-file-compressed | 71071254 | 7.59971e+07 | 0.935183 | ns | |
| fineweb_q07/datafusion:vortex-file-compressed | 69449137 | 7.2702e+07 | 0.955257 | ns | |
| fineweb_q07/datafusion:vortex-file-compressed | 69449137 | 7.38958e+07 | 0.939826 | ns | |
| fineweb_q08/datafusion:vortex-file-compressed | 30957116 | 3.12563e+07 | 0.990429 | ns | |
| fineweb_q08/datafusion:vortex-file-compressed | 30957116 | 3.41637e+07 | 0.906141 | ns | |
| fineweb_q00/datafusion:vortex-compact | 5052826 | 4.48205e+06 | 1.12735 | ns | |
| fineweb_q00/datafusion:vortex-compact | 5052826 | 4.90598e+06 | 1.02993 | ns | |
| fineweb_q01/datafusion:vortex-compact | 147100496 | 1.65433e+08 | 0.889182 | ns | |
| fineweb_q01/datafusion:vortex-compact | 147100496 | 1.65336e+08 | 0.889706 | ns | |
| fineweb_q02/datafusion:vortex-compact | 163956624 | 1.61022e+08 | 1.01823 | ns | |
| fineweb_q02/datafusion:vortex-compact | 163956624 | 1.55996e+08 | 1.05103 | ns | |
| fineweb_q03/datafusion:vortex-compact | 1369270815 | 1.38775e+09 | 0.986685 | ns | |
| fineweb_q03/datafusion:vortex-compact | 1369270815 | 1.39695e+09 | 0.980188 | ns | |
| fineweb_q04/datafusion:vortex-compact | 1620313273 | 1.64566e+09 | 0.984597 | ns | |
| fineweb_q04/datafusion:vortex-compact | 1620313273 | 1.65274e+09 | 0.980378 | ns | |
| fineweb_q05/datafusion:vortex-compact | 1233574971 | 1.24399e+09 | 0.99163 | ns | |
| fineweb_q05/datafusion:vortex-compact | 1233574971 | 1.24439e+09 | 0.99131 | ns | |
| fineweb_q06/datafusion:vortex-compact | 624371358 | 6.32725e+08 | 0.986797 | ns | |
| fineweb_q06/datafusion:vortex-compact | 624371358 | 6.50294e+08 | 0.960137 | ns | |
| fineweb_q07/datafusion:vortex-compact | 655781468 | 6.6148e+08 | 0.991385 | ns | |
| fineweb_q07/datafusion:vortex-compact | 655781468 | 6.91166e+08 | 0.948805 | ns | |
| fineweb_q08/datafusion:vortex-compact | 29103404 | 2.87037e+07 | 1.01392 | ns | |
| fineweb_q08/datafusion:vortex-compact | 29103404 | 2.70169e+07 | 1.07723 | ns | |
| fineweb_q00/duckdb:parquet | 26488979 | 2.663e+07 | 0.994706 | ns | |
| fineweb_q00/duckdb:parquet | 26488979 | 2.65775e+07 | 0.996668 | ns | |
| fineweb_q01/duckdb:parquet | 92674798 | 9.43009e+07 | 0.982756 | ns | |
| fineweb_q01/duckdb:parquet | 92674798 | 9.42527e+07 | 0.983259 | ns | |
| fineweb_q02/duckdb:parquet | 99347126 | 1.00886e+08 | 0.984744 | ns | |
| fineweb_q02/duckdb:parquet | 99347126 | 1.00196e+08 | 0.991528 | ns | |
| fineweb_q03/duckdb:parquet | 303994521 | 3.05242e+08 | 0.995914 | ns | |
| fineweb_q03/duckdb:parquet | 303994521 | 3.05313e+08 | 0.995683 | ns | |
| fineweb_q04/duckdb:parquet | 427080901 | 4.29949e+08 | 0.993329 | ns | |
| fineweb_q04/duckdb:parquet | 427080901 | 4.28834e+08 | 0.995911 | ns | |
| fineweb_q05/duckdb:parquet | 400040068 | 4.02042e+08 | 0.995021 | ns | |
| fineweb_q05/duckdb:parquet | 400040068 | 4.01566e+08 | 0.996201 | ns | |
| fineweb_q06/duckdb:parquet | 200200913 | 2.00417e+08 | 0.99892 | ns | |
| fineweb_q06/duckdb:parquet | 200200913 | 1.99399e+08 | 1.00402 | ns | |
| fineweb_q07/duckdb:parquet | 212863724 | 2.12207e+08 | 1.00309 | ns | |
| fineweb_q07/duckdb:parquet | 212863724 | 2.1279e+08 | 1.00035 | ns | |
| fineweb_q08/duckdb:parquet | 56960747 | 6.07204e+07 | 0.938083 | ns | |
| fineweb_q08/duckdb:parquet | 56960747 | 5.86898e+07 | 0.970538 | ns | |
| fineweb_q00/duckdb:vortex-file-compressed | 4554751 | 4.50964e+06 | 1.01 | ns | |
| fineweb_q00/duckdb:vortex-file-compressed | 4554751 | 4.52446e+06 | 1.00669 | ns | |
| fineweb_q01/duckdb:vortex-file-compressed | 23423434 | 2.41208e+07 | 0.97109 | ns | |
| fineweb_q01/duckdb:vortex-file-compressed | 23423434 | 2.33822e+07 | 1.00176 | ns | |
| fineweb_q02/duckdb:vortex-file-compressed | 32404087 | 3.33342e+07 | 0.972098 | ns | |
| fineweb_q02/duckdb:vortex-file-compressed | 32404087 | 2.99078e+07 | 1.08347 | ns | |
| fineweb_q03/duckdb:vortex-file-compressed | 102986270 | 1.047e+08 | 0.983629 | ns | |
| fineweb_q03/duckdb:vortex-file-compressed | 102986270 | 1.05306e+08 | 0.977976 | ns | |
| fineweb_q04/duckdb:vortex-file-compressed | 190912963 | 1.89691e+08 | 1.00644 | ns | |
| fineweb_q04/duckdb:vortex-file-compressed | 190912963 | 1.88909e+08 | 1.01061 | ns | |
| fineweb_q05/duckdb:vortex-file-compressed | 172754092 | 1.72745e+08 | 1.00005 | ns | |
| fineweb_q05/duckdb:vortex-file-compressed | 172754092 | 1.76132e+08 | 0.980822 | ns | |
| fineweb_q06/duckdb:vortex-file-compressed | 54271796 | 5.40438e+07 | 1.00422 | ns | |
| fineweb_q06/duckdb:vortex-file-compressed | 54271796 | 5.50106e+07 | 0.98657 | ns | |
| fineweb_q07/duckdb:vortex-file-compressed | 56902044 | 5.64243e+07 | 1.00847 | ns | |
| fineweb_q07/duckdb:vortex-file-compressed | 56902044 | 5.86176e+07 | 0.970733 | ns | |
| fineweb_q08/duckdb:vortex-file-compressed | 8928954 | 8.23876e+06 | 1.08377 | ns | |
| fineweb_q08/duckdb:vortex-file-compressed | 8928954 | 8.13309e+06 | 1.09786 | ns | |
| fineweb_q00/duckdb:vortex-compact | 5736308 | 6.64591e+06 | 0.863134 | ns | |
| fineweb_q00/duckdb:vortex-compact | 5736308 | 5.67881e+06 | 1.01013 | ns | |
| fineweb_q01/duckdb:vortex-compact | 88411640 | 9.10066e+07 | 0.971486 | ns | |
| fineweb_q01/duckdb:vortex-compact | 88411640 | 9.454e+07 | 0.935177 | ns | |
| fineweb_q02/duckdb:vortex-compact | 102584879 | 1.04999e+08 | 0.977007 | ns | |
| fineweb_q02/duckdb:vortex-compact | 102584879 | 1.00467e+08 | 1.02108 | ns | |
| fineweb_q03/duckdb:vortex-compact | 850215478 | 8.54791e+08 | 0.994647 | ns | |
| fineweb_q03/duckdb:vortex-compact | 850215478 | 8.50242e+08 | 0.999968 | ns | |
| fineweb_q04/duckdb:vortex-compact | 886072846 | 8.95433e+08 | 0.989547 | ns | |
| fineweb_q04/duckdb:vortex-compact | 886072846 | 8.95513e+08 | 0.989458 | ns | |
| fineweb_q05/duckdb:vortex-compact | 796241821 | 8.08027e+08 | 0.985415 | ns | |
| fineweb_q05/duckdb:vortex-compact | 796241821 | 8.10085e+08 | 0.982911 | ns | |
| fineweb_q06/duckdb:vortex-compact | 454400392 | 4.46872e+08 | 1.01685 | ns | |
| fineweb_q06/duckdb:vortex-compact | 454400392 | 4.49907e+08 | 1.00999 | ns | |
| fineweb_q07/duckdb:vortex-compact | 463965871 | 4.57732e+08 | 1.01362 | ns | |
| fineweb_q07/duckdb:vortex-compact | 463965871 | 4.67058e+08 | 0.993379 | ns | |
| fineweb_q08/duckdb:vortex-compact | 8674531 | 7.95256e+06 | 1.09078 | ns | |
| fineweb_q08/duckdb:vortex-compact | 8674531 | 8.34832e+06 | 1.03908 | ns |
Benchmarks: FineWeb S3
Summary
- Overall: 1.028x ➖
- Vortex: 1.032x ➖
- duckdb:vortex: 1.038x ➖
- datafusion:vortex: 1.025x ➖
- Best: fineweb_q08/datafusion:vortex-file-compressed (0.920x)
- Worst: fineweb_q08/duckdb:vortex-file-compressed (1.292x)
- Significant (>30%): 0↑ 0↓
Detailed Results Table
| name | PR d45a27d4 | base 7541a3b3 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| fineweb_q00/datafusion:parquet | 6994194 | 5.86993e+06 | 1.19153 | ns | |
| fineweb_q00/datafusion:parquet | 6994194 | 6.13096e+06 | 1.1408 | ns | |
| fineweb_q01/datafusion:parquet | 308379007 | 3.05712e+08 | 1.00872 | ns | |
| fineweb_q01/datafusion:parquet | 308379007 | 3.07995e+08 | 1.00125 | ns | |
| fineweb_q02/datafusion:parquet | 304275989 | 3.0108e+08 | 1.01062 | ns | |
| fineweb_q02/datafusion:parquet | 304275989 | 3.04666e+08 | 0.99872 | ns | |
| fineweb_q03/datafusion:parquet | 298734841 | 2.96417e+08 | 1.00782 | ns | |
| fineweb_q03/datafusion:parquet | 298734841 | 2.93826e+08 | 1.01671 | ns | |
| fineweb_q04/datafusion:parquet | 333841378 | 3.26628e+08 | 1.02208 | ns | |
| fineweb_q04/datafusion:parquet | 333841378 | 3.22461e+08 | 1.03529 | ns | |
| fineweb_q05/datafusion:parquet | 318561639 | 3.15189e+08 | 1.0107 | ns | |
| fineweb_q05/datafusion:parquet | 318561639 | 3.20142e+08 | 0.995063 | ns | |
| fineweb_q06/datafusion:parquet | 309638395 | 3.06738e+08 | 1.00945 | ns | |
| fineweb_q06/datafusion:parquet | 309638395 | 3.0688e+08 | 1.00899 | ns | |
| fineweb_q07/datafusion:parquet | 301560073 | 2.99249e+08 | 1.00772 | ns | |
| fineweb_q07/datafusion:parquet | 301560073 | 3.00398e+08 | 1.00387 | ns | |
| fineweb_q08/datafusion:parquet | 299726533 | 2.97008e+08 | 1.00915 | ns | |
| fineweb_q08/datafusion:parquet | 299726533 | 2.96174e+08 | 1.01199 | ns | |
| fineweb_q00/datafusion:vortex-file-compressed | 4814400 | 4.32533e+06 | 1.11307 | ns | |
| fineweb_q00/datafusion:vortex-file-compressed | 4814400 | 4.3619e+06 | 1.10374 | ns | |
| fineweb_q01/datafusion:vortex-file-compressed | 31221093 | 2.96603e+07 | 1.05262 | ns | |
| fineweb_q01/datafusion:vortex-file-compressed | 31221093 | 3.01847e+07 | 1.03434 | ns | |
| fineweb_q02/datafusion:vortex-file-compressed | 32157909 | 2.92489e+07 | 1.09946 | ns | |
| fineweb_q02/datafusion:vortex-file-compressed | 32157909 | 3.24231e+07 | 0.99182 | ns | |
| fineweb_q03/datafusion:vortex-file-compressed | 90731452 | 7.80567e+07 | 1.16238 | ns | |
| fineweb_q03/datafusion:vortex-file-compressed | 90731452 | 8.31577e+07 | 1.09108 | ns | |
| fineweb_q04/datafusion:vortex-file-compressed | 212362501 | 2.16871e+08 | 0.979209 | ns | |
| fineweb_q04/datafusion:vortex-file-compressed | 212362501 | 2.148e+08 | 0.988652 | ns | |
| fineweb_q05/datafusion:vortex-file-compressed | 195566472 | 1.94511e+08 | 1.00543 | ns | |
| fineweb_q05/datafusion:vortex-file-compressed | 195566472 | 1.91633e+08 | 1.02053 | ns | |
| fineweb_q06/datafusion:vortex-file-compressed | 71547626 | 7.19608e+07 | 0.994258 | ns | |
| fineweb_q06/datafusion:vortex-file-compressed | 71547626 | 7.59971e+07 | 0.941452 | ns | |
| fineweb_q07/datafusion:vortex-file-compressed | 70233140 | 7.2702e+07 | 0.966041 | ns | |
| fineweb_q07/datafusion:vortex-file-compressed | 70233140 | 7.38958e+07 | 0.950435 | ns | |
| fineweb_q08/datafusion:vortex-file-compressed | 31422488 | 3.12563e+07 | 1.00532 | ns | |
| fineweb_q08/datafusion:vortex-file-compressed | 31422488 | 3.41637e+07 | 0.919763 | ns | |
| fineweb_q00/datafusion:vortex-compact | 5451226 | 4.48205e+06 | 1.21624 | ns | |
| fineweb_q00/datafusion:vortex-compact | 5451226 | 4.90598e+06 | 1.11114 | ns | |
| fineweb_q01/datafusion:vortex-compact | 157206863 | 1.65433e+08 | 0.950273 | ns | |
| fineweb_q01/datafusion:vortex-compact | 157206863 | 1.65336e+08 | 0.950832 | ns | |
| fineweb_q02/datafusion:vortex-compact | 156479118 | 1.61022e+08 | 0.971789 | ns | |
| fineweb_q02/datafusion:vortex-compact | 156479118 | 1.55996e+08 | 1.0031 | ns | |
| fineweb_q03/datafusion:vortex-compact | 1418697817 | 1.38775e+09 | 1.0223 | ns | |
| fineweb_q03/datafusion:vortex-compact | 1418697817 | 1.39695e+09 | 1.01557 | ns | |
| fineweb_q04/datafusion:vortex-compact | 1668743271 | 1.64566e+09 | 1.01403 | ns | |
| fineweb_q04/datafusion:vortex-compact | 1668743271 | 1.65274e+09 | 1.00968 | ns | |
| fineweb_q05/datafusion:vortex-compact | 1301198593 | 1.24399e+09 | 1.04599 | ns | |
| fineweb_q05/datafusion:vortex-compact | 1301198593 | 1.24439e+09 | 1.04565 | ns | |
| fineweb_q06/datafusion:vortex-compact | 656886963 | 6.32725e+08 | 1.03819 | ns | |
| fineweb_q06/datafusion:vortex-compact | 656886963 | 6.50294e+08 | 1.01014 | ns | |
| fineweb_q07/datafusion:vortex-compact | 678081431 | 6.6148e+08 | 1.0251 | ns | |
| fineweb_q07/datafusion:vortex-compact | 678081431 | 6.91166e+08 | 0.981069 | ns | |
| fineweb_q08/datafusion:vortex-compact | 29797006 | 2.87037e+07 | 1.03809 | ns | |
| fineweb_q08/datafusion:vortex-compact | 29797006 | 2.70169e+07 | 1.1029 | ns | |
| fineweb_q00/duckdb:parquet | 28128200 | 2.663e+07 | 1.05626 | ns | |
| fineweb_q00/duckdb:parquet | 28128200 | 2.65775e+07 | 1.05834 | ns | |
| fineweb_q01/duckdb:parquet | 94794669 | 9.43009e+07 | 1.00524 | ns | |
| fineweb_q01/duckdb:parquet | 94794669 | 9.42527e+07 | 1.00575 | ns | |
| fineweb_q02/duckdb:parquet | 102396932 | 1.00886e+08 | 1.01497 | ns | |
| fineweb_q02/duckdb:parquet | 102396932 | 1.00196e+08 | 1.02197 | ns | |
| fineweb_q03/duckdb:parquet | 307772294 | 3.05242e+08 | 1.00829 | ns | |
| fineweb_q03/duckdb:parquet | 307772294 | 3.05313e+08 | 1.00806 | ns | |
| fineweb_q04/duckdb:parquet | 430515218 | 4.29949e+08 | 1.00132 | ns | |
| fineweb_q04/duckdb:parquet | 430515218 | 4.28834e+08 | 1.00392 | ns | |
| fineweb_q05/duckdb:parquet | 405033272 | 4.02042e+08 | 1.00744 | ns | |
| fineweb_q05/duckdb:parquet | 405033272 | 4.01566e+08 | 1.00863 | ns | |
| fineweb_q06/duckdb:parquet | 202985218 | 2.00417e+08 | 1.01281 | ns | |
| fineweb_q06/duckdb:parquet | 202985218 | 1.99399e+08 | 1.01799 | ns | |
| fineweb_q07/duckdb:parquet | 214017683 | 2.12207e+08 | 1.00853 | ns | |
| fineweb_q07/duckdb:parquet | 214017683 | 2.1279e+08 | 1.00577 | ns | |
| fineweb_q08/duckdb:parquet | 60318439 | 6.07204e+07 | 0.993381 | ns | |
| fineweb_q08/duckdb:parquet | 60318439 | 5.86898e+07 | 1.02775 | ns | |
| fineweb_q00/duckdb:vortex-file-compressed | 4510962 | 4.50964e+06 | 1.00029 | ns | |
| fineweb_q00/duckdb:vortex-file-compressed | 4510962 | 4.52446e+06 | 0.997016 | ns | |
| fineweb_q01/duckdb:vortex-file-compressed | 24231851 | 2.41208e+07 | 1.00461 | ns | |
| fineweb_q01/duckdb:vortex-file-compressed | 24231851 | 2.33822e+07 | 1.03634 | ns | |
| fineweb_q02/duckdb:vortex-file-compressed | 32646968 | 3.33342e+07 | 0.979384 | ns | |
| fineweb_q02/duckdb:vortex-file-compressed | 32646968 | 2.99078e+07 | 1.09159 | ns | |
| fineweb_q03/duckdb:vortex-file-compressed | 107361623 | 1.047e+08 | 1.02542 | ns | |
| fineweb_q03/duckdb:vortex-file-compressed | 107361623 | 1.05306e+08 | 1.01953 | ns | |
| fineweb_q04/duckdb:vortex-file-compressed | 192858266 | 1.89691e+08 | 1.0167 | ns | |
| fineweb_q04/duckdb:vortex-file-compressed | 192858266 | 1.88909e+08 | 1.02091 | ns | |
| fineweb_q05/duckdb:vortex-file-compressed | 176834419 | 1.72745e+08 | 1.02367 | ns | |
| fineweb_q05/duckdb:vortex-file-compressed | 176834419 | 1.76132e+08 | 1.00399 | ns | |
| fineweb_q06/duckdb:vortex-file-compressed | 54512702 | 5.40438e+07 | 1.00868 | ns | |
| fineweb_q06/duckdb:vortex-file-compressed | 54512702 | 5.50106e+07 | 0.990949 | ns | |
| fineweb_q07/duckdb:vortex-file-compressed | 57284703 | 5.64243e+07 | 1.01525 | ns | |
| fineweb_q07/duckdb:vortex-file-compressed | 57284703 | 5.86176e+07 | 0.977261 | ns | |
| fineweb_q08/duckdb:vortex-file-compressed | 10511740 | 8.23876e+06 | 1.27589 | ns | |
| fineweb_q08/duckdb:vortex-file-compressed | 10511740 | 8.13309e+06 | 1.29247 | ns | |
| fineweb_q00/duckdb:vortex-compact | 6452601 | 6.64591e+06 | 0.970914 | ns | |
| fineweb_q00/duckdb:vortex-compact | 6452601 | 5.67881e+06 | 1.13626 | ns | |
| fineweb_q01/duckdb:vortex-compact | 103158528 | 9.10066e+07 | 1.13353 | ns | |
| fineweb_q01/duckdb:vortex-compact | 103158528 | 9.454e+07 | 1.09116 | ns | |
| fineweb_q02/duckdb:vortex-compact | 103470255 | 1.04999e+08 | 0.98544 | ns | |
| fineweb_q02/duckdb:vortex-compact | 103470255 | 1.00467e+08 | 1.02989 | ns | |
| fineweb_q03/duckdb:vortex-compact | 852321836 | 8.54791e+08 | 0.997111 | ns | |
| fineweb_q03/duckdb:vortex-compact | 852321836 | 8.50242e+08 | 1.00245 | ns | |
| fineweb_q04/duckdb:vortex-compact | 904942910 | 8.95433e+08 | 1.01062 | ns | |
| fineweb_q04/duckdb:vortex-compact | 904942910 | 8.95513e+08 | 1.01053 | ns | |
| fineweb_q05/duckdb:vortex-compact | 804342593 | 8.08027e+08 | 0.995441 | ns | |
| fineweb_q05/duckdb:vortex-compact | 804342593 | 8.10085e+08 | 0.992911 | ns | |
| fineweb_q06/duckdb:vortex-compact | 458191910 | 4.46872e+08 | 1.02533 | ns | |
| fineweb_q06/duckdb:vortex-compact | 458191910 | 4.49907e+08 | 1.01841 | ns | |
| fineweb_q07/duckdb:vortex-compact | 463532909 | 4.57732e+08 | 1.01267 | ns | |
| fineweb_q07/duckdb:vortex-compact | 463532909 | 4.67058e+08 | 0.992452 | ns | |
| fineweb_q08/duckdb:vortex-compact | 9299030 | 7.95256e+06 | 1.16931 | ns | |
| fineweb_q08/duckdb:vortex-compact | 9299030 | 8.34832e+06 | 1.11388 | ns |
Benchmarks: TPC-H SF=1 on S3
Summary
- Overall: 1.028x ➖
- Vortex: 1.056x ➖
- duckdb:vortex: 0.979x ➖
- datafusion:vortex: 1.139x ➖
- Best: tpch_q04/datafusion:vortex-compact (0.755x)
- Worst: tpch_q09/datafusion:vortex-compact (2.367x)
- Significant (>30%): 0↑ 9↓
Detailed Results Table
| name | PR d45a27d4 | base 7541a3b3 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| tpch_q01/datafusion:parquet | 280091411 | 2.96633e+08 | 0.944235 | ns | |
| tpch_q02/datafusion:parquet | 370464906 | 3.74324e+08 | 0.989691 | ns | |
| tpch_q03/datafusion:parquet | 307771993 | 3.38092e+08 | 0.91032 | ns | |
| tpch_q04/datafusion:parquet | 138776433 | 1.38369e+08 | 1.00294 | ns | |
| tpch_q05/datafusion:parquet | 401519530 | 3.83906e+08 | 1.04588 | ns | |
| tpch_q06/datafusion:parquet | 130853626 | 1.2856e+08 | 1.01784 | ns | |
| tpch_q07/datafusion:parquet | 414273483 | 4.00935e+08 | 1.03327 | ns | |
| tpch_q08/datafusion:parquet | 482010042 | 4.80336e+08 | 1.00349 | ns | |
| tpch_q09/datafusion:parquet | 441763858 | 4.43194e+08 | 0.996774 | ns | |
| tpch_q10/datafusion:parquet | 469889287 | 4.51236e+08 | 1.04134 | ns | |
| tpch_q11/datafusion:parquet | 302546740 | 3.1069e+08 | 0.973789 | ns | |
| tpch_q12/datafusion:parquet | 236889470 | 2.23109e+08 | 1.06177 | ns | |
| tpch_q13/datafusion:parquet | 430043769 | 4.49097e+08 | 0.957574 | ns | |
| tpch_q14/datafusion:parquet | 162342012 | 1.60194e+08 | 1.01341 | ns | |
| tpch_q15/datafusion:parquet | 285666728 | 2.80209e+08 | 1.01948 | ns | |
| tpch_q16/datafusion:parquet | 202448862 | 1.84637e+08 | 1.09647 | ns | |
| tpch_q17/datafusion:parquet | 348954593 | 3.48725e+08 | 1.00066 | ns | |
| tpch_q18/datafusion:parquet | 441631447 | 4.33834e+08 | 1.01797 | ns | |
| tpch_q19/datafusion:parquet | 316488703 | 2.97635e+08 | 1.06335 | ns | |
| tpch_q20/datafusion:parquet | 270096168 | 2.69609e+08 | 1.00181 | ns | |
| tpch_q21/datafusion:parquet | 424891636 | 4.49283e+08 | 0.945711 | ns | |
| tpch_q22/datafusion:parquet | 179389031 | 1.79765e+08 | 0.997908 | ns | |
| tpch_q01/datafusion:vortex-file-compressed | 432298944 | 2.55317e+08 | 1.69318 | ns | 🚨 |
| tpch_q02/datafusion:vortex-file-compressed | 274599540 | 1.9831e+08 | 1.3847 | ns | 🚨 |
| tpch_q03/datafusion:vortex-file-compressed | 294872432 | 2.92184e+08 | 1.0092 | ns | |
| tpch_q04/datafusion:vortex-file-compressed | 175516501 | 1.79668e+08 | 0.976893 | ns | |
| tpch_q05/datafusion:vortex-file-compressed | 323903467 | 2.6135e+08 | 1.23935 | ns | |
| tpch_q06/datafusion:vortex-file-compressed | 202045000 | 1.96736e+08 | 1.02699 | ns | |
| tpch_q07/datafusion:vortex-file-compressed | 494584275 | 2.82181e+08 | 1.75272 | ns | 🚨 |
| tpch_q08/datafusion:vortex-file-compressed | 531145177 | 4.8819e+08 | 1.08799 | ns | |
| tpch_q09/datafusion:vortex-file-compressed | 531490805 | 4.09289e+08 | 1.29857 | ns | |
| tpch_q10/datafusion:vortex-file-compressed | 450146706 | 4.24464e+08 | 1.06051 | ns | |
| tpch_q11/datafusion:vortex-file-compressed | 141542133 | 1.24173e+08 | 1.13988 | ns | |
| tpch_q12/datafusion:vortex-file-compressed | 281355896 | 2.68487e+08 | 1.04793 | ns | |
| tpch_q13/datafusion:vortex-file-compressed | 206701589 | 2.08401e+08 | 0.991847 | ns | |
| tpch_q14/datafusion:vortex-file-compressed | 175195889 | 1.78266e+08 | 0.982781 | ns | |
| tpch_q15/datafusion:vortex-file-compressed | 253105852 | 2.6705e+08 | 0.947784 | ns | |
| tpch_q16/datafusion:vortex-file-compressed | 135043805 | 1.40563e+08 | 0.960736 | ns | |
| tpch_q17/datafusion:vortex-file-compressed | 285031911 | 2.71209e+08 | 1.05097 | ns | |
| tpch_q18/datafusion:vortex-file-compressed | 342830483 | 3.3809e+08 | 1.01402 | ns | |
| tpch_q19/datafusion:vortex-file-compressed | 369827421 | 3.20627e+08 | 1.15345 | ns | |
| tpch_q20/datafusion:vortex-file-compressed | 213586215 | 2.1407e+08 | 0.997738 | ns | |
| tpch_q21/datafusion:vortex-file-compressed | 496785763 | 3.80906e+08 | 1.30422 | ns | 🚨 |
| tpch_q22/datafusion:vortex-file-compressed | 142761148 | 1.48972e+08 | 0.958306 | ns | |
| tpch_q01/datafusion:vortex-compact | 246047516 | 2.41522e+08 | 1.01874 | ns | |
| tpch_q02/datafusion:vortex-compact | 305069455 | 2.02182e+08 | 1.50889 | ns | 🚨 |
| tpch_q03/datafusion:vortex-compact | 314821171 | 2.68126e+08 | 1.17415 | ns | |
| tpch_q04/datafusion:vortex-compact | 168611616 | 2.23205e+08 | 0.755412 | ns | |
| tpch_q05/datafusion:vortex-compact | 304821895 | 2.79484e+08 | 1.09066 | ns | |
| tpch_q06/datafusion:vortex-compact | 239874650 | 2.67307e+08 | 0.897374 | ns | |
| tpch_q07/datafusion:vortex-compact | 474154080 | 2.29744e+08 | 2.06383 | ns | 🚨 |
| tpch_q08/datafusion:vortex-compact | 513500889 | 2.97776e+08 | 1.72446 | ns | 🚨 |
| tpch_q09/datafusion:vortex-compact | 696054197 | 2.94126e+08 | 2.36652 | ns | 🚨 |
| tpch_q10/datafusion:vortex-compact | 405723861 | 3.37369e+08 | 1.20261 | ns | |
| tpch_q11/datafusion:vortex-compact | 117417895 | 1.18012e+08 | 0.994964 | ns | |
| tpch_q12/datafusion:vortex-compact | 308576978 | 3.93715e+08 | 0.783758 | ns | |
| tpch_q13/datafusion:vortex-compact | 160080908 | 1.63866e+08 | 0.976903 | ns | |
| tpch_q14/datafusion:vortex-compact | 195031920 | 1.78258e+08 | 1.0941 | ns | |
| tpch_q15/datafusion:vortex-compact | 292779835 | 3.13792e+08 | 0.933037 | ns | |
| tpch_q16/datafusion:vortex-compact | 128802372 | 1.25107e+08 | 1.02954 | ns | |
| tpch_q17/datafusion:vortex-compact | 299099618 | 2.77024e+08 | 1.07969 | ns | |
| tpch_q18/datafusion:vortex-compact | 283277408 | 2.48773e+08 | 1.1387 | ns | |
| tpch_q19/datafusion:vortex-compact | 398701994 | 3.42879e+08 | 1.16281 | ns | |
| tpch_q20/datafusion:vortex-compact | 242940895 | 2.35368e+08 | 1.03217 | ns | |
| tpch_q21/datafusion:vortex-compact | 589054527 | 3.58292e+08 | 1.64406 | ns | 🚨 |
| tpch_q22/datafusion:vortex-compact | 115887914 | 1.23624e+08 | 0.937419 | ns | |
| tpch_q01/duckdb:parquet | 448619151 | 5.31792e+08 | 0.8436 | ns | |
| tpch_q02/duckdb:parquet | 992703009 | 1.03644e+09 | 0.957802 | ns | |
| tpch_q03/duckdb:parquet | 748531490 | 7.50994e+08 | 0.996721 | ns | |
| tpch_q04/duckdb:parquet | 454291097 | 5.44639e+08 | 0.834114 | ns | |
| tpch_q05/duckdb:parquet | 1126255266 | 1.22218e+09 | 0.921512 | ns | |
| tpch_q06/duckdb:parquet | 294304622 | 3.06036e+08 | 0.961665 | ns | |
| tpch_q07/duckdb:parquet | 921409345 | 1.00615e+09 | 0.915779 | ns | |
| tpch_q08/duckdb:parquet | 1166346395 | 1.25266e+09 | 0.931094 | ns | |
| tpch_q09/duckdb:parquet | 1043377459 | 1.10982e+09 | 0.94013 | ns | |
| tpch_q10/duckdb:parquet | 1067062118 | 1.07719e+09 | 0.990598 | ns | |
| tpch_q11/duckdb:parquet | 631863554 | 6.62682e+08 | 0.953494 | ns | |
| tpch_q12/duckdb:parquet | 496453943 | 4.61752e+08 | 1.07515 | ns | |
| tpch_q13/duckdb:parquet | 791691443 | 7.83454e+08 | 1.01051 | ns | |
| tpch_q14/duckdb:parquet | 529513407 | 5.68434e+08 | 0.931531 | ns | |
| tpch_q15/duckdb:parquet | 536606482 | 5.75202e+08 | 0.9329 | ns | |
| tpch_q16/duckdb:parquet | 436815242 | 4.84597e+08 | 0.901398 | ns | |
| tpch_q17/duckdb:parquet | 675388885 | 6.17299e+08 | 1.0941 | ns | |
| tpch_q18/duckdb:parquet | 700025986 | 7.07639e+08 | 0.989242 | ns | |
| tpch_q19/duckdb:parquet | 627138499 | 6.42057e+08 | 0.976764 | ns | |
| tpch_q20/duckdb:parquet | 803878471 | 8.89912e+08 | 0.903324 | ns | |
| tpch_q21/duckdb:parquet | 878280576 | 9.80551e+08 | 0.895701 | ns | |
| tpch_q22/duckdb:parquet | 389052732 | 4.44068e+08 | 0.876111 | ns | |
| tpch_q01/duckdb:vortex-file-compressed | 269742778 | 3.04143e+08 | 0.886894 | ns | |
| tpch_q02/duckdb:vortex-file-compressed | 625881588 | 6.88047e+08 | 0.90965 | ns | |
| tpch_q03/duckdb:vortex-file-compressed | 618278016 | 6.26624e+08 | 0.986681 | ns | |
| tpch_q04/duckdb:vortex-file-compressed | 387187140 | 3.84153e+08 | 1.0079 | ns | |
| tpch_q05/duckdb:vortex-file-compressed | 679211285 | 6.9616e+08 | 0.975653 | ns | |
| tpch_q06/duckdb:vortex-file-compressed | 331497555 | 3.48252e+08 | 0.95189 | ns | |
| tpch_q07/duckdb:vortex-file-compressed | 636614157 | 6.64431e+08 | 0.958134 | ns | |
| tpch_q08/duckdb:vortex-file-compressed | 906011722 | 9.2676e+08 | 0.977613 | ns | |
| tpch_q09/duckdb:vortex-file-compressed | 724904993 | 7.34981e+08 | 0.986291 | ns | |
| tpch_q10/duckdb:vortex-file-compressed | 744876437 | 7.32619e+08 | 1.01673 | ns | |
| tpch_q11/duckdb:vortex-file-compressed | 346943951 | 3.57418e+08 | 0.970695 | ns | |
| tpch_q12/duckdb:vortex-file-compressed | 511692613 | 5.04281e+08 | 1.0147 | ns | |
| tpch_q13/duckdb:vortex-file-compressed | 433015602 | 4.32953e+08 | 1.00015 | ns | |
| tpch_q14/duckdb:vortex-file-compressed | 386813459 | 3.61868e+08 | 1.06893 | ns | |
| tpch_q15/duckdb:vortex-file-compressed | 302876091 | 2.91997e+08 | 1.03726 | ns | |
| tpch_q16/duckdb:vortex-file-compressed | 282423945 | 3.07283e+08 | 0.919101 | ns | |
| tpch_q17/duckdb:vortex-file-compressed | 533997484 | 5.49596e+08 | 0.971619 | ns | |
| tpch_q18/duckdb:vortex-file-compressed | 604648331 | 6.08839e+08 | 0.993117 | ns | |
| tpch_q19/duckdb:vortex-file-compressed | 410261853 | 3.98507e+08 | 1.0295 | ns | |
| tpch_q20/duckdb:vortex-file-compressed | 614061566 | 6.02064e+08 | 1.01993 | ns | |
| tpch_q21/duckdb:vortex-file-compressed | 899019787 | 8.73876e+08 | 1.02877 | ns | |
| tpch_q22/duckdb:vortex-file-compressed | 224773772 | 2.51702e+08 | 0.893016 | ns | |
| tpch_q01/duckdb:vortex-compact | 285208874 | 2.8611e+08 | 0.996849 | ns | |
| tpch_q02/duckdb:vortex-compact | 606577762 | 6.32032e+08 | 0.959727 | ns | |
| tpch_q03/duckdb:vortex-compact | 544569436 | 5.56705e+08 | 0.9782 | ns | |
| tpch_q04/duckdb:vortex-compact | 332602478 | 3.37875e+08 | 0.984394 | ns | |
| tpch_q05/duckdb:vortex-compact | 605852526 | 6.35798e+08 | 0.952902 | ns | |
| tpch_q06/duckdb:vortex-compact | 356290927 | 3.39675e+08 | 1.04892 | ns | |
| tpch_q07/duckdb:vortex-compact | 564977884 | 5.65924e+08 | 0.998327 | ns | |
| tpch_q08/duckdb:vortex-compact | 792094389 | 8.17613e+08 | 0.968789 | ns | |
| tpch_q09/duckdb:vortex-compact | 733898937 | 7.46967e+08 | 0.982506 | ns | |
| tpch_q10/duckdb:vortex-compact | 639798492 | 6.33143e+08 | 1.01051 | ns | |
| tpch_q11/duckdb:vortex-compact | 329103377 | 3.30238e+08 | 0.996564 | ns | |
| tpch_q12/duckdb:vortex-compact | 466809030 | 4.62711e+08 | 1.00886 | ns | |
| tpch_q13/duckdb:vortex-compact | 378045304 | 3.80696e+08 | 0.993039 | ns | |
| tpch_q14/duckdb:vortex-compact | 343404090 | 3.72721e+08 | 0.921342 | ns | |
| tpch_q15/duckdb:vortex-compact | 261645848 | 2.4909e+08 | 1.05041 | ns | |
| tpch_q16/duckdb:vortex-compact | 282585883 | 3.01301e+08 | 0.937886 | ns | |
| tpch_q17/duckdb:vortex-compact | 509897004 | 5.31799e+08 | 0.958815 | ns | |
| tpch_q18/duckdb:vortex-compact | 491606059 | 5.24638e+08 | 0.937039 | ns | |
| tpch_q19/duckdb:vortex-compact | 429559738 | 4.33895e+08 | 0.990008 | ns | |
| tpch_q20/duckdb:vortex-compact | 579411445 | 6.22695e+08 | 0.930491 | ns | |
| tpch_q21/duckdb:vortex-compact | 811839609 | 8.43575e+08 | 0.96238 | ns | |
| tpch_q22/duckdb:vortex-compact | 228957791 | 2.38117e+08 | 0.961533 | ns |
Benchmarks: TPC-H SF=10 on NVME
Summary
- Overall: 1.070x ➖
- Vortex: 1.114x ❌
- duckdb:vortex: 0.998x ➖
- datafusion:vortex: 1.243x ❌
- Best: tpch_q07/datafusion:vortex-file-compressed (0.743x)
- Worst: tpch_q09/datafusion:vortex-compact (3.267x)
- Significant (>10%): 2↑ 17↓
Detailed Results Table
| name | PR d45a27d4 | base 7541a3b3 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| tpch_q01/datafusion:arrow | 515182944 | 4.86917e+08 | 1.05805 | ns | |
| tpch_q02/datafusion:arrow | 103551852 | 9.39936e+07 | 1.10169 | ns | |
| tpch_q03/datafusion:arrow | 208762494 | 1.88402e+08 | 1.10807 | ns | |
| tpch_q04/datafusion:arrow | 109224262 | 9.70935e+07 | 1.12494 | ns | |
| tpch_q05/datafusion:arrow | 376991631 | 3.57435e+08 | 1.05471 | ns | |
| tpch_q06/datafusion:arrow | 78264049 | 6.7784e+07 | 1.15461 | ns | |
| tpch_q07/datafusion:arrow | 709407772 | 6.67778e+08 | 1.06234 | ns | |
| tpch_q08/datafusion:arrow | 323161391 | 2.88309e+08 | 1.12089 | ns | |
| tpch_q09/datafusion:arrow | 605370323 | 5.82824e+08 | 1.03868 | ns | |
| tpch_q10/datafusion:arrow | 265361575 | 2.38844e+08 | 1.11102 | ns | |
| tpch_q11/datafusion:arrow | 393403165 | 3.83655e+08 | 1.02541 | ns | |
| tpch_q12/datafusion:arrow | 210447820 | 1.82802e+08 | 1.15123 | ns | |
| tpch_q13/datafusion:arrow | 198488656 | 1.93638e+08 | 1.02505 | ns | |
| tpch_q14/datafusion:arrow | 76576691 | 5.42562e+07 | 1.41139 | ns | 🚨 |
| tpch_q15/datafusion:arrow | 150234171 | 1.01388e+08 | 1.48178 | ns | 🚨 |
| tpch_q16/datafusion:arrow | 79051671 | 7.40859e+07 | 1.06703 | ns | |
| tpch_q17/datafusion:arrow | 618776770 | 5.87304e+08 | 1.05359 | ns | |
| tpch_q18/datafusion:arrow | 1524684086 | 1.38043e+09 | 1.1045 | ns | |
| tpch_q19/datafusion:arrow | 137322079 | 1.198e+08 | 1.14626 | ns | |
| tpch_q20/datafusion:arrow | 191724498 | 1.67639e+08 | 1.14367 | ns | |
| tpch_q21/datafusion:arrow | 935543092 | 8.94425e+08 | 1.04597 | ns | |
| tpch_q22/datafusion:arrow | 57190254 | 5.66402e+07 | 1.00971 | ns | |
| tpch_q01/datafusion:parquet | 694431767 | 6.7514e+08 | 1.02857 | ns | |
| tpch_q02/datafusion:parquet | 224570471 | 2.07064e+08 | 1.08455 | ns | |
| tpch_q03/datafusion:parquet | 302226946 | 3.00974e+08 | 1.00416 | ns | |
| tpch_q04/datafusion:parquet | 214451912 | 2.09846e+08 | 1.02195 | ns | |
| tpch_q05/datafusion:parquet | 473404395 | 4.62144e+08 | 1.02437 | ns | |
| tpch_q06/datafusion:parquet | 132776442 | 1.29341e+08 | 1.02656 | ns | |
| tpch_q07/datafusion:parquet | 684854621 | 6.8933e+08 | 0.993508 | ns | |
| tpch_q08/datafusion:parquet | 530158847 | 5.20356e+08 | 1.01884 | ns | |
| tpch_q09/datafusion:parquet | 818283366 | 8.23726e+08 | 0.993393 | ns | |
| tpch_q10/datafusion:parquet | 514189103 | 5.19244e+08 | 0.990266 | ns | |
| tpch_q11/datafusion:parquet | 144274577 | 1.33449e+08 | 1.08112 | ns | |
| tpch_q12/datafusion:parquet | 203649554 | 2.12627e+08 | 0.957777 | ns | |
| tpch_q13/datafusion:parquet | 420735052 | 4.21774e+08 | 0.997538 | ns | |
| tpch_q14/datafusion:parquet | 160279763 | 1.56662e+08 | 1.02309 | ns | |
| tpch_q15/datafusion:parquet | 254899644 | 2.56691e+08 | 0.993019 | ns | |
| tpch_q16/datafusion:parquet | 150509764 | 1.45816e+08 | 1.03219 | ns | |
| tpch_q17/datafusion:parquet | 709473669 | 7.12878e+08 | 0.995225 | ns | |
| tpch_q18/datafusion:parquet | 1116693806 | 1.13308e+09 | 0.985539 | ns | |
| tpch_q19/datafusion:parquet | 304995501 | 2.89818e+08 | 1.05237 | ns | |
| tpch_q20/datafusion:parquet | 309996666 | 3.0668e+08 | 1.01081 | ns | |
| tpch_q21/datafusion:parquet | 873272694 | 8.72033e+08 | 1.00142 | ns | |
| tpch_q22/datafusion:parquet | 331230040 | 3.29733e+08 | 1.00454 | ns | |
| tpch_q01/datafusion:vortex-file-compressed | 494221441 | 4.90876e+08 | 1.00681 | ns | |
| tpch_q02/datafusion:vortex-file-compressed | 268970314 | 1.65611e+08 | 1.62411 | ns | 🚨 |
| tpch_q03/datafusion:vortex-file-compressed | 230560191 | 2.1914e+08 | 1.05211 | ns | |
| tpch_q04/datafusion:vortex-file-compressed | 104173077 | 1.02063e+08 | 1.02067 | ns | |
| tpch_q05/datafusion:vortex-file-compressed | 592233697 | 5.88279e+08 | 1.00672 | ns | |
| tpch_q06/datafusion:vortex-file-compressed | 37660497 | 3.69294e+07 | 1.0198 | ns | |
| tpch_q07/datafusion:vortex-file-compressed | 435165610 | 5.85961e+08 | 0.742653 | ns | |
| tpch_q08/datafusion:vortex-file-compressed | 1014071361 | 6.3158e+08 | 1.60561 | ns | 🚨 |
| tpch_q09/datafusion:vortex-file-compressed | 1654349710 | 1.01362e+09 | 1.63213 | ns | 🚨 |
| tpch_q10/datafusion:vortex-file-compressed | 330115409 | 2.65156e+08 | 1.24499 | ns | |
| tpch_q11/datafusion:vortex-file-compressed | 111915486 | 1.31882e+08 | 0.848603 | ns | |
| tpch_q12/datafusion:vortex-file-compressed | 106388497 | 1.02847e+08 | 1.03443 | ns | |
| tpch_q13/datafusion:vortex-file-compressed | 223381191 | 2.21595e+08 | 1.00806 | ns | |
| tpch_q14/datafusion:vortex-file-compressed | 77795202 | 5.54568e+07 | 1.40281 | ns | 🚨 |
| tpch_q15/datafusion:vortex-file-compressed | 100684716 | 9.44815e+07 | 1.06566 | ns | |
| tpch_q16/datafusion:vortex-file-compressed | 90539405 | 8.86725e+07 | 1.02105 | ns | |
| tpch_q17/datafusion:vortex-file-compressed | 917347123 | 9.0023e+08 | 1.01901 | ns | |
| tpch_q18/datafusion:vortex-file-compressed | 1103168897 | 1.10137e+09 | 1.00163 | ns | |
| tpch_q19/datafusion:vortex-file-compressed | 161796684 | 7.14048e+07 | 2.26591 | ns | 🚨 |
| tpch_q20/datafusion:vortex-file-compressed | 185113703 | 1.75591e+08 | 1.05423 | ns | |
| tpch_q21/datafusion:vortex-file-compressed | 1170365662 | 7.58579e+08 | 1.54284 | ns | 🚨 |
| tpch_q22/datafusion:vortex-file-compressed | 75084136 | 7.19379e+07 | 1.04373 | ns | |
| tpch_q01/datafusion:vortex-compact | 546589501 | 5.44231e+08 | 1.00433 | ns | |
| tpch_q02/datafusion:vortex-compact | 409969519 | 1.70994e+08 | 2.39757 | ns | 🚨 |
| tpch_q03/datafusion:vortex-compact | 404116608 | 2.39905e+08 | 1.68449 | ns | 🚨 |
| tpch_q04/datafusion:vortex-compact | 121009128 | 1.18803e+08 | 1.01857 | ns | |
| tpch_q05/datafusion:vortex-compact | 583795975 | 5.63841e+08 | 1.03539 | ns | |
| tpch_q06/datafusion:vortex-compact | 75321351 | 7.4578e+07 | 1.00997 | ns | |
| tpch_q07/datafusion:vortex-compact | 850161686 | 6.15778e+08 | 1.38063 | ns | 🚨 |
| tpch_q08/datafusion:vortex-compact | 1992954425 | 6.44614e+08 | 3.0917 | ns | 🚨 |
| tpch_q09/datafusion:vortex-compact | 3206217468 | 9.81482e+08 | 3.26671 | ns | 🚨 |
| tpch_q10/datafusion:vortex-compact | 453839288 | 3.16431e+08 | 1.43425 | ns | 🚨 |
| tpch_q11/datafusion:vortex-compact | 148627267 | 1.40359e+08 | 1.05891 | ns | |
| tpch_q12/datafusion:vortex-compact | 193927600 | 1.63155e+08 | 1.18861 | ns | |
| tpch_q13/datafusion:vortex-compact | 273922140 | 2.71244e+08 | 1.00987 | ns | |
| tpch_q14/datafusion:vortex-compact | 102950386 | 8.58139e+07 | 1.19969 | ns | |
| tpch_q15/datafusion:vortex-compact | 171552149 | 1.65109e+08 | 1.03902 | ns | |
| tpch_q16/datafusion:vortex-compact | 99556801 | 9.65287e+07 | 1.03137 | ns | |
| tpch_q17/datafusion:vortex-compact | 929792942 | 9.14183e+08 | 1.01708 | ns | |
| tpch_q18/datafusion:vortex-compact | 1124114083 | 1.10811e+09 | 1.01444 | ns | |
| tpch_q19/datafusion:vortex-compact | 220140799 | 1.26443e+08 | 1.74102 | ns | 🚨 |
| tpch_q20/datafusion:vortex-compact | 229006606 | 2.09839e+08 | 1.09134 | ns | |
| tpch_q21/datafusion:vortex-compact | 1632781219 | 7.62445e+08 | 2.14151 | ns | 🚨 |
| tpch_q22/datafusion:vortex-compact | 88473273 | 8.36264e+07 | 1.05796 | ns | |
| tpch_q01/duckdb:parquet | 260760817 | 2.63258e+08 | 0.990514 | ns | |
| tpch_q02/duckdb:parquet | 127851114 | 1.27112e+08 | 1.00581 | ns | |
| tpch_q03/duckdb:parquet | 221461693 | 2.25416e+08 | 0.982458 | ns | |
| tpch_q04/duckdb:parquet | 153063095 | 1.52466e+08 | 1.00392 | ns | |
| tpch_q05/duckdb:parquet | 231801699 | 2.33913e+08 | 0.990975 | ns | |
| tpch_q06/duckdb:parquet | 71131886 | 7.10797e+07 | 1.00073 | ns | |
| tpch_q07/duckdb:parquet | 218076126 | 2.19207e+08 | 0.994841 | ns | |
| tpch_q08/duckdb:parquet | 329897235 | 3.2974e+08 | 1.00048 | ns | |
| tpch_q09/duckdb:parquet | 486967178 | 4.91493e+08 | 0.990792 | ns | |
| tpch_q10/duckdb:parquet | 635556217 | 6.42064e+08 | 0.989864 | ns | |
| tpch_q11/duckdb:parquet | 50122624 | 5.65996e+07 | 0.885564 | ns | |
| tpch_q12/duckdb:parquet | 141565343 | 1.41308e+08 | 1.00182 | ns | |
| tpch_q13/duckdb:parquet | 410319028 | 4.16931e+08 | 0.984141 | ns | |
| tpch_q14/duckdb:parquet | 178523518 | 1.81377e+08 | 0.984268 | ns | |
| tpch_q15/duckdb:parquet | 108552301 | 1.07748e+08 | 1.00746 | ns | |
| tpch_q16/duckdb:parquet | 166214413 | 1.6625e+08 | 0.999783 | ns | |
| tpch_q17/duckdb:parquet | 206491945 | 2.05621e+08 | 1.00423 | ns | |
| tpch_q18/duckdb:parquet | 362968024 | 3.58873e+08 | 1.01141 | ns | |
| tpch_q19/duckdb:parquet | 291586947 | 2.81765e+08 | 1.03486 | ns | |
| tpch_q20/duckdb:parquet | 250003987 | 2.52513e+08 | 0.990066 | ns | |
| tpch_q21/duckdb:parquet | 581025946 | 5.85213e+08 | 0.992846 | ns | |
| tpch_q22/duckdb:parquet | 302966561 | 3.00251e+08 | 1.00904 | ns | |
| tpch_q01/duckdb:vortex-file-compressed | 206010239 | 2.01759e+08 | 1.02107 | ns | |
| tpch_q02/duckdb:vortex-file-compressed | 56028730 | 5.72381e+07 | 0.978872 | ns | |
| tpch_q03/duckdb:vortex-file-compressed | 135296562 | 1.35509e+08 | 0.998432 | ns | |
| tpch_q04/duckdb:vortex-file-compressed | 166921232 | 1.66602e+08 | 1.00191 | ns | |
| tpch_q05/duckdb:vortex-file-compressed | 141894566 | 1.39225e+08 | 1.01918 | ns | |
| tpch_q06/duckdb:vortex-file-compressed | 56137534 | 5.59739e+07 | 1.00292 | ns | |
| tpch_q07/duckdb:vortex-file-compressed | 148110612 | 1.47797e+08 | 1.00212 | ns | |
| tpch_q08/duckdb:vortex-file-compressed | 240852942 | 2.39306e+08 | 1.00646 | ns | |
| tpch_q09/duckdb:vortex-file-compressed | 365020708 | 3.67732e+08 | 0.992628 | ns | |
| tpch_q10/duckdb:vortex-file-compressed | 147210563 | 1.47976e+08 | 0.994826 | ns | |
| tpch_q11/duckdb:vortex-file-compressed | 39944870 | 4.01084e+07 | 0.995922 | ns | |
| tpch_q12/duckdb:vortex-file-compressed | 109625923 | 1.08734e+08 | 1.0082 | ns | |
| tpch_q13/duckdb:vortex-file-compressed | 236968209 | 2.39973e+08 | 0.98748 | ns | |
| tpch_q14/duckdb:vortex-file-compressed | 68377677 | 6.8731e+07 | 0.994859 | ns | |
| tpch_q15/duckdb:vortex-file-compressed | 97442541 | 9.92968e+07 | 0.981326 | ns | |
| tpch_q16/duckdb:vortex-file-compressed | 81614856 | 8.36072e+07 | 0.97617 | ns | |
| tpch_q17/duckdb:vortex-file-compressed | 128113983 | 1.2973e+08 | 0.987544 | ns | |
| tpch_q18/duckdb:vortex-file-compressed | 285027062 | 2.89727e+08 | 0.983777 | ns | |
| tpch_q19/duckdb:vortex-file-compressed | 98738648 | 9.82245e+07 | 1.00523 | ns | |
| tpch_q20/duckdb:vortex-file-compressed | 172461211 | 1.71287e+08 | 1.00686 | ns | |
| tpch_q21/duckdb:vortex-file-compressed | 586615930 | 5.79613e+08 | 1.01208 | ns | |
| tpch_q22/duckdb:vortex-file-compressed | 74593859 | 7.56862e+07 | 0.985568 | ns | |
| tpch_q01/duckdb:vortex-compact | 248426710 | 2.48461e+08 | 0.999862 | ns | |
| tpch_q02/duckdb:vortex-compact | 73888738 | 7.07829e+07 | 1.04388 | ns | |
| tpch_q03/duckdb:vortex-compact | 181423580 | 1.83823e+08 | 0.986947 | ns | |
| tpch_q04/duckdb:vortex-compact | 211456596 | 2.11843e+08 | 0.998175 | ns | |
| tpch_q05/duckdb:vortex-compact | 171795224 | 1.71404e+08 | 1.00228 | ns | |
| tpch_q06/duckdb:vortex-compact | 110679933 | 1.09739e+08 | 1.00858 | ns | |
| tpch_q07/duckdb:vortex-compact | 219508200 | 2.24203e+08 | 0.97906 | ns | |
| tpch_q08/duckdb:vortex-compact | 260883992 | 2.61788e+08 | 0.996546 | ns | |
| tpch_q09/duckdb:vortex-compact | 406705830 | 4.13215e+08 | 0.984248 | ns | |
| tpch_q10/duckdb:vortex-compact | 208103895 | 2.08461e+08 | 0.998285 | ns | |
| tpch_q11/duckdb:vortex-compact | 44132369 | 4.43008e+07 | 0.996198 | ns | |
| tpch_q12/duckdb:vortex-compact | 292709056 | 2.95219e+08 | 0.991496 | ns | |
| tpch_q13/duckdb:vortex-compact | 295775553 | 3.01387e+08 | 0.98138 | ns | |
| tpch_q14/duckdb:vortex-compact | 106625026 | 1.08062e+08 | 0.986703 | ns | |
| tpch_q15/duckdb:vortex-compact | 135009538 | 1.33934e+08 | 1.00803 | ns | |
| tpch_q16/duckdb:vortex-compact | 91974789 | 9.21995e+07 | 0.997563 | ns | |
| tpch_q17/duckdb:vortex-compact | 143158764 | 1.42001e+08 | 1.00815 | ns | |
| tpch_q18/duckdb:vortex-compact | 335172596 | 3.35263e+08 | 0.999732 | ns | |
| tpch_q19/duckdb:vortex-compact | 157602207 | 1.56369e+08 | 1.00788 | ns | |
| tpch_q20/duckdb:vortex-compact | 220853267 | 2.23127e+08 | 0.98981 | ns | |
| tpch_q21/duckdb:vortex-compact | 682951343 | 6.87168e+08 | 0.993864 | ns | |
| tpch_q22/duckdb:vortex-compact | 82727900 | 8.28588e+07 | 0.99842 | ns | |
| tpch_q01/duckdb:duckdb | 117363848 | 1.18613e+08 | 0.989473 | ns | |
| tpch_q02/duckdb:duckdb | 50367666 | 5.29381e+07 | 0.951445 | ns | |
| tpch_q03/duckdb:duckdb | 102310911 | 1.01614e+08 | 1.00685 | ns | |
| tpch_q04/duckdb:duckdb | 129190256 | 1.28779e+08 | 1.00319 | ns | |
| tpch_q05/duckdb:duckdb | 115558611 | 1.15351e+08 | 1.0018 | ns | |
| tpch_q06/duckdb:duckdb | 45338046 | 4.57565e+07 | 0.990854 | ns | |
| tpch_q07/duckdb:duckdb | 111103684 | 1.11023e+08 | 1.00072 | ns | |
| tpch_q08/duckdb:duckdb | 140594057 | 1.41757e+08 | 0.991795 | ns | |
| tpch_q09/duckdb:duckdb | 309074672 | 3.07555e+08 | 1.00494 | ns | |
| tpch_q10/duckdb:duckdb | 219604090 | 2.19607e+08 | 0.999988 | ns | |
| tpch_q11/duckdb:duckdb | 22779559 | 2.27902e+07 | 0.999532 | ns | |
| tpch_q12/duckdb:duckdb | 88054000 | 8.816e+07 | 0.998798 | ns | |
| tpch_q13/duckdb:duckdb | 236434294 | 2.36979e+08 | 0.997702 | ns | |
| tpch_q14/duckdb:duckdb | 79088011 | 7.85914e+07 | 1.00632 | ns | |
| tpch_q15/duckdb:duckdb | 82247344 | 8.31458e+07 | 0.989194 | ns | |
| tpch_q16/duckdb:duckdb | 73545133 | 7.40389e+07 | 0.993332 | ns | |
| tpch_q17/duckdb:duckdb | 99784613 | 1.00324e+08 | 0.994626 | ns | |
| tpch_q18/duckdb:duckdb | 220149253 | 2.20141e+08 | 1.00004 | ns | |
| tpch_q19/duckdb:duckdb | 129396755 | 1.30409e+08 | 0.99224 | ns | |
| tpch_q20/duckdb:duckdb | 124195229 | 1.24995e+08 | 0.993602 | ns | |
| tpch_q21/duckdb:duckdb | 318722299 | 3.1504e+08 | 1.01169 | ns | |
| tpch_q22/duckdb:duckdb | 71700903 | 7.21033e+07 | 0.994419 | ns |
Benchmarks: TPC-DS SF=1 on NVME
Summary
- Overall: 1.275x ❌
- Vortex: 1.473x ❌
- duckdb:vortex: 0.993x ➖
- datafusion:vortex: 2.184x ❌
- Best: tpcds_q72/datafusion:vortex-file-compressed (0.246x)
- Worst: tpcds_q90/datafusion:vortex-compact (7.518x)
- Significant (>10%): 9↑ 185↓
Detailed Results Table
| name | PR d45a27d4 | base 7541a3b3 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| tpcds_q01/datafusion:parquet | 49387195 | 4.36466e+07 | 1.13152 | ns | |
| tpcds_q02/datafusion:parquet | 51535765 | 4.37808e+07 | 1.17713 | ns | |
| tpcds_q03/datafusion:parquet | 24281766 | 2.13633e+07 | 1.13661 | ns | |
| tpcds_q04/datafusion:parquet | 381120826 | 3.45974e+08 | 1.10159 | ns | |
| tpcds_q05/datafusion:parquet | 52293445 | 4.10305e+07 | 1.2745 | ns | |
| tpcds_q06/datafusion:parquet | 72945216 | 6.56352e+07 | 1.11137 | ns | |
| tpcds_q07/datafusion:parquet | 115797859 | 1.09573e+08 | 1.05681 | ns | |
| tpcds_q08/datafusion:parquet | 77175398 | 6.93975e+07 | 1.11208 | ns | |
| tpcds_q09/datafusion:parquet | 63553863 | 4.8524e+07 | 1.30974 | ns | 🚨 |
| tpcds_q10/datafusion:parquet | 116581319 | 1.07126e+08 | 1.08826 | ns | |
| tpcds_q11/datafusion:parquet | 246444756 | 2.31243e+08 | 1.06574 | ns | |
| tpcds_q12/datafusion:parquet | 33968718 | 2.83291e+07 | 1.19908 | ns | |
| tpcds_q13/datafusion:parquet | 116966226 | 1.07285e+08 | 1.09024 | ns | |
| tpcds_q14/datafusion:parquet | 331114367 | 2.93325e+08 | 1.12883 | ns | |
| tpcds_q15/datafusion:parquet | 36045374 | 3.29028e+07 | 1.09551 | ns | |
| tpcds_q16/datafusion:parquet | 48780484 | 4.15686e+07 | 1.17349 | ns | |
| tpcds_q17/datafusion:parquet | 113965186 | 1.08828e+08 | 1.04721 | ns | |
| tpcds_q18/datafusion:parquet | 137880168 | 1.29491e+08 | 1.06478 | ns | |
| tpcds_q19/datafusion:parquet | 41991410 | 3.60739e+07 | 1.16404 | ns | |
| tpcds_q20/datafusion:parquet | 31521164 | 2.79025e+07 | 1.12969 | ns | |
| tpcds_q21/datafusion:parquet | 37492879 | 3.30724e+07 | 1.13366 | ns | |
| tpcds_q22/datafusion:parquet | 76742644 | 7.37409e+07 | 1.04071 | ns | |
| tpcds_q23/datafusion:parquet | 261428901 | 2.42511e+08 | 1.07801 | ns | |
| tpcds_q24/datafusion:parquet | 160171180 | 1.41022e+08 | 1.13579 | ns | |
| tpcds_q25/datafusion:parquet | 115144985 | 1.0374e+08 | 1.10994 | ns | |
| tpcds_q26/datafusion:parquet | 102389981 | 9.66071e+07 | 1.05986 | ns | |
| tpcds_q27/datafusion:parquet | 218483718 | 2.04995e+08 | 1.0658 | ns | |
| tpcds_q28/datafusion:parquet | 52385909 | 4.6293e+07 | 1.13162 | ns | |
| tpcds_q29/datafusion:parquet | 118151628 | 1.10901e+08 | 1.06538 | ns | |
| tpcds_q30/datafusion:parquet | 59657791 | 5.06414e+07 | 1.17804 | ns | |
| tpcds_q31/datafusion:parquet | 134948176 | 1.09257e+08 | 1.23514 | ns | |
| tpcds_q32/datafusion:parquet | 33161505 | 2.7174e+07 | 1.22034 | ns | |
| tpcds_q33/datafusion:parquet | 55257679 | 4.05136e+07 | 1.36393 | ns | 🚨 |
| tpcds_q34/datafusion:parquet | 45935308 | 3.87037e+07 | 1.18685 | ns | |
| tpcds_q35/datafusion:parquet | 117196222 | 1.09526e+08 | 1.07003 | ns | |
| tpcds_q36/datafusion:parquet | 110057660 | 1.00234e+08 | 1.09801 | ns | |
| tpcds_q37/datafusion:parquet | 34530312 | 2.64676e+07 | 1.30462 | ns | 🚨 |
| tpcds_q38/datafusion:parquet | 70747258 | 6.22747e+07 | 1.13605 | ns | |
| tpcds_q39/datafusion:parquet | 82239730 | 7.39071e+07 | 1.11274 | ns | |
| tpcds_q40/datafusion:parquet | 40894214 | 3.34542e+07 | 1.22239 | ns | |
| tpcds_q41/datafusion:parquet | 18407867 | 1.24398e+07 | 1.47976 | ns | 🚨 |
| tpcds_q42/datafusion:parquet | 24503110 | 1.9276e+07 | 1.27117 | ns | |
| tpcds_q43/datafusion:parquet | 31518654 | 2.46396e+07 | 1.27919 | ns | |
| tpcds_q44/datafusion:parquet | 70253719 | 6.26832e+07 | 1.12077 | ns | |
| tpcds_q45/datafusion:parquet | 55726676 | 4.86624e+07 | 1.14517 | ns | |
| tpcds_q46/datafusion:parquet | 65188058 | 5.81922e+07 | 1.12022 | ns | |
| tpcds_q47/datafusion:parquet | 249293405 | 2.22527e+08 | 1.12028 | ns | |
| tpcds_q48/datafusion:parquet | 101203939 | 9.86713e+07 | 1.02567 | ns | |
| tpcds_q49/datafusion:parquet | 80330120 | 6.22176e+07 | 1.29112 | ns | |
| tpcds_q50/datafusion:parquet | 80142507 | 7.04044e+07 | 1.13832 | ns | |
| tpcds_q51/datafusion:parquet | 123026375 | 1.11231e+08 | 1.10604 | ns | |
| tpcds_q52/datafusion:parquet | 22976474 | 2.00614e+07 | 1.1453 | ns | |
| tpcds_q53/datafusion:parquet | 39504246 | 3.26917e+07 | 1.20839 | ns | |
| tpcds_q54/datafusion:parquet | 58817007 | 4.47849e+07 | 1.31332 | ns | 🚨 |
| tpcds_q55/datafusion:parquet | 23897885 | 1.99969e+07 | 1.19508 | ns | |
| tpcds_q56/datafusion:parquet | 53801458 | 4.59799e+07 | 1.17011 | ns | |
| tpcds_q57/datafusion:parquet | 162395541 | 1.42857e+08 | 1.13677 | ns | |
| tpcds_q58/datafusion:parquet | 128198249 | 1.14068e+08 | 1.12387 | ns | |
| tpcds_q59/datafusion:parquet | 85329608 | 7.18352e+07 | 1.18785 | ns | |
| tpcds_q60/datafusion:parquet | 55485635 | 4.15675e+07 | 1.33483 | ns | 🚨 |
| tpcds_q61/datafusion:parquet | 74531858 | 6.87908e+07 | 1.08346 | ns | |
| tpcds_q62/datafusion:parquet | 49129865 | 5.65218e+07 | 0.869219 | ns | |
| tpcds_q63/datafusion:parquet | 40209965 | 3.53487e+07 | 1.13752 | ns | |
| tpcds_q64/datafusion:parquet | 690342467 | 6.29261e+08 | 1.09707 | ns | |
| tpcds_q65/datafusion:parquet | 60661004 | 5.00455e+07 | 1.21212 | ns | |
| tpcds_q66/datafusion:parquet | 131138167 | 1.05764e+08 | 1.23991 | ns | |
| tpcds_q67/datafusion:parquet | 142134044 | 1.35551e+08 | 1.04856 | ns | |
| tpcds_q68/datafusion:parquet | 67192304 | 6.04971e+07 | 1.11067 | ns | |
| tpcds_q69/datafusion:parquet | 109381729 | 9.80987e+07 | 1.11502 | ns | |
| tpcds_q70/datafusion:parquet | 141424995 | 1.27779e+08 | 1.1068 | ns | |
| tpcds_q71/datafusion:parquet | 38624274 | 3.12048e+07 | 1.23777 | ns | |
| tpcds_q72/datafusion:parquet | 1637209252 | 1.66959e+09 | 0.980603 | ns | |
| tpcds_q73/datafusion:parquet | 43633308 | 3.9224e+07 | 1.11241 | ns | |
| tpcds_q74/datafusion:parquet | 165405022 | 1.43678e+08 | 1.15122 | ns | |
| tpcds_q75/datafusion:parquet | 154401331 | 1.21723e+08 | 1.26846 | ns | |
| tpcds_q76/datafusion:parquet | 63745928 | 5.66515e+07 | 1.12523 | ns | |
| tpcds_q77/datafusion:parquet | 65366929 | 5.09518e+07 | 1.28292 | ns | |
| tpcds_q78/datafusion:parquet | 199103592 | 1.76973e+08 | 1.12505 | ns | |
| tpcds_q79/datafusion:parquet | 50450559 | 4.09843e+07 | 1.23097 | ns | |
| tpcds_q80/datafusion:parquet | 121188428 | 1.03999e+08 | 1.16528 | ns | |
| tpcds_q81/datafusion:parquet | 59774648 | 5.11912e+07 | 1.16767 | ns | |
| tpcds_q82/datafusion:parquet | 32707282 | 2.9748e+07 | 1.09948 | ns | |
| tpcds_q83/datafusion:parquet | 84092031 | 7.24875e+07 | 1.16009 | ns | |
| tpcds_q84/datafusion:parquet | 63204132 | 5.43414e+07 | 1.16309 | ns | |
| tpcds_q85/datafusion:parquet | 181894071 | 1.7613e+08 | 1.03273 | ns | |
| tpcds_q86/datafusion:parquet | 26891592 | 2.1573e+07 | 1.24654 | ns | |
| tpcds_q87/datafusion:parquet | 71285177 | 6.10795e+07 | 1.16709 | ns | |
| tpcds_q88/datafusion:parquet | 127397718 | 1.05846e+08 | 1.20361 | ns | |
| tpcds_q89/datafusion:parquet | 45388194 | 3.74273e+07 | 1.2127 | ns | |
| tpcds_q90/datafusion:parquet | 35618168 | 3.03614e+07 | 1.17314 | ns | |
| tpcds_q91/datafusion:parquet | 96194009 | 9.39823e+07 | 1.02353 | ns | |
| tpcds_q92/datafusion:parquet | 32373731 | 2.6734e+07 | 1.21096 | ns | |
| tpcds_q93/datafusion:parquet | 39424072 | 3.6168e+07 | 1.09003 | ns | |
| tpcds_q94/datafusion:parquet | 41963057 | 3.55012e+07 | 1.18202 | ns | |
| tpcds_q95/datafusion:parquet | 97048971 | 8.6605e+07 | 1.12059 | ns | |
| tpcds_q96/datafusion:parquet | 29515539 | 2.49982e+07 | 1.18071 | ns | |
| tpcds_q97/datafusion:parquet | 48444030 | 4.08644e+07 | 1.18548 | ns | |
| tpcds_q98/datafusion:parquet | 39299143 | 3.32641e+07 | 1.18143 | ns | |
| tpcds_q99/datafusion:parquet | 59461907 | 5.72769e+07 | 1.03815 | ns | |
| tpcds_q01/datafusion:vortex-file-compressed | 43417683 | 2.64633e+07 | 1.64068 | ns | 🚨 |
| tpcds_q02/datafusion:vortex-file-compressed | 54110917 | 4.64091e+07 | 1.16596 | ns | |
| tpcds_q03/datafusion:vortex-file-compressed | 70082828 | 1.74946e+07 | 4.00596 | ns | 🚨 |
| tpcds_q04/datafusion:vortex-file-compressed | 592136281 | 5.02764e+08 | 1.17776 | ns | |
| tpcds_q05/datafusion:vortex-file-compressed | 55162188 | 4.73486e+07 | 1.16502 | ns | |
| tpcds_q06/datafusion:vortex-file-compressed | 103845369 | 5.7668e+07 | 1.80075 | ns | 🚨 |
| tpcds_q07/datafusion:vortex-file-compressed | 142722400 | 6.1439e+07 | 2.32299 | ns | 🚨 |
| tpcds_q08/datafusion:vortex-file-compressed | 104711965 | 6.57276e+07 | 1.59312 | ns | 🚨 |
| tpcds_q09/datafusion:vortex-file-compressed | 47222933 | 3.65045e+07 | 1.29362 | ns | |
| tpcds_q10/datafusion:vortex-file-compressed | 83795169 | 4.26615e+07 | 1.96419 | ns | 🚨 |
| tpcds_q11/datafusion:vortex-file-compressed | 413528013 | 3.07137e+08 | 1.3464 | ns | 🚨 |
| tpcds_q12/datafusion:vortex-file-compressed | 54651747 | 2.18375e+07 | 2.50265 | ns | 🚨 |
| tpcds_q13/datafusion:vortex-file-compressed | 176266966 | 5.07331e+07 | 3.4744 | ns | 🚨 |
| tpcds_q14/datafusion:vortex-file-compressed | 589841238 | 2.7002e+08 | 2.18444 | ns | 🚨 |
| tpcds_q15/datafusion:vortex-file-compressed | 85953555 | 4.3665e+07 | 1.96848 | ns | 🚨 |
| tpcds_q16/datafusion:vortex-file-compressed | 126876716 | 3.28927e+07 | 3.85729 | ns | 🚨 |
| tpcds_q17/datafusion:vortex-file-compressed | 417227912 | 8.42583e+07 | 4.95177 | ns | 🚨 |
| tpcds_q18/datafusion:vortex-file-compressed | 143437711 | 6.71372e+07 | 2.13649 | ns | 🚨 |
| tpcds_q19/datafusion:vortex-file-compressed | 107367060 | 3.08797e+07 | 3.47695 | ns | 🚨 |
| tpcds_q20/datafusion:vortex-file-compressed | 51674120 | 2.72786e+07 | 1.89431 | ns | 🚨 |
| tpcds_q21/datafusion:vortex-file-compressed | 99791186 | 2.4411e+08 | 0.408796 | ns | 🚀 |
| tpcds_q22/datafusion:vortex-file-compressed | 145650065 | 7.59565e+07 | 1.91755 | ns | 🚨 |
| tpcds_q23/datafusion:vortex-file-compressed | 391968150 | 2.35594e+08 | 1.66374 | ns | 🚨 |
| tpcds_q24/datafusion:vortex-file-compressed | 287819533 | 1.26818e+08 | 2.26955 | ns | 🚨 |
| tpcds_q25/datafusion:vortex-file-compressed | 385600560 | 9.0128e+07 | 4.27837 | ns | 🚨 |
| tpcds_q26/datafusion:vortex-file-compressed | 103821230 | 4.39284e+07 | 2.36342 | ns | 🚨 |
| tpcds_q27/datafusion:vortex-file-compressed | 243703063 | 1.48608e+08 | 1.63991 | ns | 🚨 |
| tpcds_q28/datafusion:vortex-file-compressed | 42782667 | 3.77094e+07 | 1.13453 | ns | |
| tpcds_q29/datafusion:vortex-file-compressed | 418991307 | 8.56012e+07 | 4.89469 | ns | 🚨 |
| tpcds_q30/datafusion:vortex-file-compressed | 58084972 | 3.05135e+07 | 1.90358 | ns | 🚨 |
| tpcds_q31/datafusion:vortex-file-compressed | 291468215 | 1.29891e+08 | 2.24395 | ns | 🚨 |
| tpcds_q32/datafusion:vortex-file-compressed | 38139358 | 2.14498e+07 | 1.77807 | ns | 🚨 |
| tpcds_q33/datafusion:vortex-file-compressed | 188972146 | 3.57604e+07 | 5.28439 | ns | 🚨 |
| tpcds_q34/datafusion:vortex-file-compressed | 112416528 | 3.08306e+07 | 3.64626 | ns | 🚨 |
| tpcds_q35/datafusion:vortex-file-compressed | 100418378 | 5.64491e+07 | 1.77892 | ns | 🚨 |
| tpcds_q36/datafusion:vortex-file-compressed | 240718959 | 7.66553e+07 | 3.14028 | ns | 🚨 |
| tpcds_q37/datafusion:vortex-file-compressed | 63712803 | 3.44232e+07 | 1.85087 | ns | 🚨 |
| tpcds_q38/datafusion:vortex-file-compressed | 244130208 | 4.99598e+07 | 4.88653 | ns | 🚨 |
| tpcds_q39/datafusion:vortex-file-compressed | 145239467 | 3.21754e+08 | 0.4514 | ns | 🚀 |
| tpcds_q40/datafusion:vortex-file-compressed | 73957555 | 6.99325e+07 | 1.05756 | ns | |
| tpcds_q41/datafusion:vortex-file-compressed | 20209762 | 1.37899e+07 | 1.46555 | ns | 🚨 |
| tpcds_q42/datafusion:vortex-file-compressed | 80665311 | 1.81922e+07 | 4.43405 | ns | 🚨 |
| tpcds_q43/datafusion:vortex-file-compressed | 90249788 | 3.29834e+07 | 2.73622 | ns | 🚨 |
| tpcds_q44/datafusion:vortex-file-compressed | 66450050 | 5.8838e+07 | 1.12937 | ns | |
| tpcds_q45/datafusion:vortex-file-compressed | 111645794 | 3.85511e+07 | 2.89604 | ns | 🚨 |
| tpcds_q46/datafusion:vortex-file-compressed | 144729362 | 5.07491e+07 | 2.85186 | ns | 🚨 |
| tpcds_q47/datafusion:vortex-file-compressed | 477584123 | 2.72986e+08 | 1.74948 | ns | 🚨 |
| tpcds_q48/datafusion:vortex-file-compressed | 147881709 | 5.3154e+07 | 2.78214 | ns | 🚨 |
| tpcds_q49/datafusion:vortex-file-compressed | 79640771 | 6.19833e+07 | 1.28487 | ns | |
| tpcds_q50/datafusion:vortex-file-compressed | 205917458 | 5.86653e+07 | 3.51004 | ns | 🚨 |
| tpcds_q51/datafusion:vortex-file-compressed | 131384638 | 1.14053e+08 | 1.15196 | ns | |
| tpcds_q52/datafusion:vortex-file-compressed | 79524924 | 1.83456e+07 | 4.33482 | ns | 🚨 |
| tpcds_q53/datafusion:vortex-file-compressed | 96541405 | 2.60948e+07 | 3.69965 | ns | 🚨 |
| tpcds_q54/datafusion:vortex-file-compressed | 65690519 | 4.06021e+07 | 1.61791 | ns | 🚨 |
| tpcds_q55/datafusion:vortex-file-compressed | 84706173 | 1.82153e+07 | 4.65028 | ns | 🚨 |
| tpcds_q56/datafusion:vortex-file-compressed | 171757373 | 3.75474e+07 | 4.57442 | ns | 🚨 |
| tpcds_q57/datafusion:vortex-file-compressed | 377380397 | 1.91174e+08 | 1.97401 | ns | 🚨 |
| tpcds_q58/datafusion:vortex-file-compressed | 233726959 | 1.07294e+08 | 2.17838 | ns | 🚨 |
| tpcds_q59/datafusion:vortex-file-compressed | 86388117 | 7.88733e+07 | 1.09528 | ns | |
| tpcds_q60/datafusion:vortex-file-compressed | 215473223 | 3.70438e+07 | 5.81671 | ns | 🚨 |
| tpcds_q61/datafusion:vortex-file-compressed | 157308089 | 5.14975e+07 | 3.05468 | ns | 🚨 |
| tpcds_q62/datafusion:vortex-file-compressed | 102675100 | 4.33112e+07 | 2.37063 | ns | 🚨 |
| tpcds_q63/datafusion:vortex-file-compressed | 94705726 | 2.54757e+07 | 3.71749 | ns | 🚨 |
| tpcds_q64/datafusion:vortex-file-compressed | 892449262 | 4.36572e+08 | 2.04422 | ns | 🚨 |
| tpcds_q65/datafusion:vortex-file-compressed | 71606778 | 4.97674e+07 | 1.43883 | ns | 🚨 |
| tpcds_q66/datafusion:vortex-file-compressed | 211999875 | 1.84291e+08 | 1.15035 | ns | |
| tpcds_q67/datafusion:vortex-file-compressed | 197872698 | 1.29647e+08 | 1.52624 | ns | 🚨 |
| tpcds_q68/datafusion:vortex-file-compressed | 158006137 | 4.99279e+07 | 3.16469 | ns | 🚨 |
| tpcds_q69/datafusion:vortex-file-compressed | 86791032 | 4.1632e+07 | 2.08472 | ns | 🚨 |
| tpcds_q70/datafusion:vortex-file-compressed | 196726648 | 1.43114e+08 | 1.37462 | ns | 🚨 |
| tpcds_q71/datafusion:vortex-file-compressed | 49453752 | 2.92779e+07 | 1.68912 | ns | 🚨 |
| tpcds_q72/datafusion:vortex-file-compressed | 740072297 | 3.01141e+09 | 0.245756 | ns | 🚀 |
| tpcds_q73/datafusion:vortex-file-compressed | 109389326 | 3.23615e+07 | 3.38024 | ns | 🚨 |
| tpcds_q74/datafusion:vortex-file-compressed | 410009363 | 1.60017e+08 | 2.56229 | ns | 🚨 |
| tpcds_q75/datafusion:vortex-file-compressed | 347676319 | 1.21364e+08 | 2.86475 | ns | 🚨 |
| tpcds_q76/datafusion:vortex-file-compressed | 153883210 | 3.36256e+07 | 4.57637 | ns | 🚨 |
| tpcds_q77/datafusion:vortex-file-compressed | 124622828 | 4.2049e+07 | 2.96376 | ns | 🚨 |
| tpcds_q78/datafusion:vortex-file-compressed | 236973970 | 2.23544e+08 | 1.06008 | ns | |
| tpcds_q79/datafusion:vortex-file-compressed | 105887551 | 4.18555e+07 | 2.52984 | ns | 🚨 |
| tpcds_q80/datafusion:vortex-file-compressed | 147663823 | 1.32783e+08 | 1.11207 | ns | |
| tpcds_q81/datafusion:vortex-file-compressed | 78858402 | 3.88276e+07 | 2.03099 | ns | 🚨 |
| tpcds_q82/datafusion:vortex-file-compressed | 66208167 | 3.66502e+07 | 1.80649 | ns | 🚨 |
| tpcds_q83/datafusion:vortex-file-compressed | 89327929 | 4.82688e+07 | 1.85064 | ns | 🚨 |
| tpcds_q84/datafusion:vortex-file-compressed | 46799319 | 1.75086e+07 | 2.67293 | ns | 🚨 |
| tpcds_q85/datafusion:vortex-file-compressed | 166885377 | 5.81841e+07 | 2.86823 | ns | 🚨 |
| tpcds_q86/datafusion:vortex-file-compressed | 82486485 | 1.95991e+07 | 4.20868 | ns | 🚨 |
| tpcds_q87/datafusion:vortex-file-compressed | 245238648 | 5.08234e+07 | 4.82531 | ns | 🚨 |
| tpcds_q88/datafusion:vortex-file-compressed | 257756532 | 8.46931e+07 | 3.04342 | ns | 🚨 |
| tpcds_q89/datafusion:vortex-file-compressed | 122614970 | 4.05727e+07 | 3.0221 | ns | 🚨 |
| tpcds_q90/datafusion:vortex-file-compressed | 127845701 | 1.85933e+07 | 6.87589 | ns | 🚨 |
| tpcds_q91/datafusion:vortex-file-compressed | 49012386 | 2.30834e+07 | 2.12328 | ns | 🚨 |
| tpcds_q92/datafusion:vortex-file-compressed | 40051416 | 1.9269e+07 | 2.07854 | ns | 🚨 |
| tpcds_q93/datafusion:vortex-file-compressed | 53545072 | 5.0031e+07 | 1.07024 | ns | |
| tpcds_q94/datafusion:vortex-file-compressed | 108586936 | 2.90797e+07 | 3.73411 | ns | 🚨 |
| tpcds_q95/datafusion:vortex-file-compressed | 230446951 | 7.11547e+07 | 3.23868 | ns | 🚨 |
| tpcds_q96/datafusion:vortex-file-compressed | 76254572 | 1.62031e+07 | 4.70617 | ns | 🚨 |
| tpcds_q97/datafusion:vortex-file-compressed | 48050277 | 3.56716e+07 | 1.34702 | ns | 🚨 |
| tpcds_q98/datafusion:vortex-file-compressed | 56702377 | 3.46941e+07 | 1.63435 | ns | 🚨 |
| tpcds_q99/datafusion:vortex-file-compressed | 116918395 | 7.35633e+07 | 1.58936 | ns | 🚨 |
| tpcds_q01/datafusion:vortex-compact | 44011077 | 2.91804e+07 | 1.50824 | ns | 🚨 |
| tpcds_q02/datafusion:vortex-compact | 55886555 | 4.87276e+07 | 1.14692 | ns | |
| tpcds_q03/datafusion:vortex-compact | 66417635 | 1.8535e+07 | 3.58337 | ns | 🚨 |
| tpcds_q04/datafusion:vortex-compact | 613892759 | 5.26051e+08 | 1.16698 | ns | |
| tpcds_q05/datafusion:vortex-compact | 58451741 | 4.92245e+07 | 1.18745 | ns | |
| tpcds_q06/datafusion:vortex-compact | 107035395 | 5.91322e+07 | 1.8101 | ns | 🚨 |
| tpcds_q07/datafusion:vortex-compact | 145343715 | 6.09546e+07 | 2.38446 | ns | 🚨 |
| tpcds_q08/datafusion:vortex-compact | 107775207 | 7.28158e+07 | 1.48011 | ns | 🚨 |
| tpcds_q09/datafusion:vortex-compact | 47512733 | 3.71411e+07 | 1.27925 | ns | |
| tpcds_q10/datafusion:vortex-compact | 96812579 | 4.60743e+07 | 2.10123 | ns | 🚨 |
| tpcds_q11/datafusion:vortex-compact | 445750998 | 3.17645e+08 | 1.4033 | ns | 🚨 |
| tpcds_q12/datafusion:vortex-compact | 68608153 | 2.42177e+07 | 2.83298 | ns | 🚨 |
| tpcds_q13/datafusion:vortex-compact | 172453016 | 5.03596e+07 | 3.42443 | ns | 🚨 |
| tpcds_q14/datafusion:vortex-compact | 612591827 | 2.74962e+08 | 2.22791 | ns | 🚨 |
| tpcds_q15/datafusion:vortex-compact | 81201856 | 4.41007e+07 | 1.84128 | ns | 🚨 |
| tpcds_q16/datafusion:vortex-compact | 126944351 | 3.42091e+07 | 3.71084 | ns | 🚨 |
| tpcds_q17/datafusion:vortex-compact | 414922529 | 8.7377e+07 | 4.74865 | ns | 🚨 |
| tpcds_q18/datafusion:vortex-compact | 151825020 | 6.74595e+07 | 2.25061 | ns | 🚨 |
| tpcds_q19/datafusion:vortex-compact | 105894798 | 3.32539e+07 | 3.18443 | ns | 🚨 |
| tpcds_q20/datafusion:vortex-compact | 46775439 | 2.81831e+07 | 1.6597 | ns | 🚨 |
| tpcds_q21/datafusion:vortex-compact | 109600321 | 2.45208e+08 | 0.446969 | ns | 🚀 |
| tpcds_q22/datafusion:vortex-compact | 147918058 | 7.89068e+07 | 1.87459 | ns | 🚨 |
| tpcds_q23/datafusion:vortex-compact | 408706785 | 2.43887e+08 | 1.6758 | ns | 🚨 |
| tpcds_q24/datafusion:vortex-compact | 274508742 | 1.31823e+08 | 2.08241 | ns | 🚨 |
| tpcds_q25/datafusion:vortex-compact | 390718483 | 8.97824e+07 | 4.35184 | ns | 🚨 |
| tpcds_q26/datafusion:vortex-compact | 105903115 | 4.24706e+07 | 2.49357 | ns | 🚨 |
| tpcds_q27/datafusion:vortex-compact | 272669877 | 1.40496e+08 | 1.94077 | ns | 🚨 |
| tpcds_q28/datafusion:vortex-compact | 41153903 | 3.75377e+07 | 1.09634 | ns | |
| tpcds_q29/datafusion:vortex-compact | 419255823 | 8.62809e+07 | 4.85919 | ns | 🚨 |
| tpcds_q30/datafusion:vortex-compact | 63689107 | 3.05886e+07 | 2.08212 | ns | 🚨 |
| tpcds_q31/datafusion:vortex-compact | 340216138 | 1.2891e+08 | 2.63919 | ns | 🚨 |
| tpcds_q32/datafusion:vortex-compact | 39728751 | 2.2713e+07 | 1.74916 | ns | 🚨 |
| tpcds_q33/datafusion:vortex-compact | 190860669 | 3.5547e+07 | 5.36925 | ns | 🚨 |
| tpcds_q34/datafusion:vortex-compact | 109343694 | 3.07553e+07 | 3.55528 | ns | 🚨 |
| tpcds_q35/datafusion:vortex-compact | 101273079 | 5.91477e+07 | 1.71221 | ns | 🚨 |
| tpcds_q36/datafusion:vortex-compact | 246107857 | 7.68771e+07 | 3.20132 | ns | 🚨 |
| tpcds_q37/datafusion:vortex-compact | 62796311 | 3.42842e+07 | 1.83164 | ns | 🚨 |
| tpcds_q38/datafusion:vortex-compact | 250418480 | 5.24324e+07 | 4.77603 | ns | 🚨 |
| tpcds_q39/datafusion:vortex-compact | 149052083 | 3.53064e+08 | 0.422167 | ns | 🚀 |
| tpcds_q40/datafusion:vortex-compact | 69507678 | 6.69202e+07 | 1.03867 | ns | |
| tpcds_q41/datafusion:vortex-compact | 20013146 | 1.55139e+07 | 1.29001 | ns | |
| tpcds_q42/datafusion:vortex-compact | 78924434 | 1.84539e+07 | 4.27683 | ns | 🚨 |
| tpcds_q43/datafusion:vortex-compact | 90980524 | 3.22995e+07 | 2.81678 | ns | 🚨 |
| tpcds_q44/datafusion:vortex-compact | 69979326 | 5.98188e+07 | 1.16985 | ns | |
| tpcds_q45/datafusion:vortex-compact | 114214519 | 3.91082e+07 | 2.92047 | ns | 🚨 |
| tpcds_q46/datafusion:vortex-compact | 149914722 | 5.3639e+07 | 2.79488 | ns | 🚨 |
| tpcds_q47/datafusion:vortex-compact | 470485056 | 2.76656e+08 | 1.70061 | ns | 🚨 |
| tpcds_q48/datafusion:vortex-compact | 151400042 | 5.55837e+07 | 2.72382 | ns | 🚨 |
| tpcds_q49/datafusion:vortex-compact | 83134236 | 6.47652e+07 | 1.28362 | ns | |
| tpcds_q50/datafusion:vortex-compact | 189346958 | 5.97935e+07 | 3.16668 | ns | 🚨 |
| tpcds_q51/datafusion:vortex-compact | 139738765 | 1.08576e+08 | 1.28701 | ns | |
| tpcds_q52/datafusion:vortex-compact | 82206392 | 1.86172e+07 | 4.41562 | ns | 🚨 |
| tpcds_q53/datafusion:vortex-compact | 98415099 | 2.60082e+07 | 3.78401 | ns | 🚨 |
| tpcds_q54/datafusion:vortex-compact | 67208929 | 4.2202e+07 | 1.59255 | ns | 🚨 |
| tpcds_q55/datafusion:vortex-compact | 81564976 | 1.88633e+07 | 4.32401 | ns | 🚨 |
| tpcds_q56/datafusion:vortex-compact | 186579064 | 3.77503e+07 | 4.94246 | ns | 🚨 |
| tpcds_q57/datafusion:vortex-compact | 375146113 | 1.90667e+08 | 1.96755 | ns | 🚨 |
| tpcds_q58/datafusion:vortex-compact | 228771031 | 1.08356e+08 | 2.11129 | ns | 🚨 |
| tpcds_q59/datafusion:vortex-compact | 90758654 | 7.80677e+07 | 1.16256 | ns | |
| tpcds_q60/datafusion:vortex-compact | 185389820 | 3.96855e+07 | 4.67147 | ns | 🚨 |
| tpcds_q61/datafusion:vortex-compact | 164407143 | 5.20194e+07 | 3.1605 | ns | 🚨 |
| tpcds_q62/datafusion:vortex-compact | 105084284 | 4.41893e+07 | 2.37805 | ns | 🚨 |
| tpcds_q63/datafusion:vortex-compact | 99951238 | 2.82853e+07 | 3.53368 | ns | 🚨 |
| tpcds_q64/datafusion:vortex-compact | 934645177 | 4.32953e+08 | 2.15877 | ns | 🚨 |
| tpcds_q65/datafusion:vortex-compact | 73886566 | 5.34266e+07 | 1.38296 | ns | 🚨 |
| tpcds_q66/datafusion:vortex-compact | 208108526 | 1.89297e+08 | 1.09938 | ns | |
| tpcds_q67/datafusion:vortex-compact | 202565013 | 1.35752e+08 | 1.49217 | ns | 🚨 |
| tpcds_q68/datafusion:vortex-compact | 149112067 | 5.27661e+07 | 2.82591 | ns | 🚨 |
| tpcds_q69/datafusion:vortex-compact | 88028403 | 3.98876e+07 | 2.20691 | ns | 🚨 |
| tpcds_q70/datafusion:vortex-compact | 204048545 | 1.44442e+08 | 1.41267 | ns | 🚨 |
| tpcds_q71/datafusion:vortex-compact | 48495893 | 3.04063e+07 | 1.59493 | ns | 🚨 |
| tpcds_q72/datafusion:vortex-compact | 746909165 | 3.03586e+09 | 0.246029 | ns | 🚀 |
| tpcds_q73/datafusion:vortex-compact | 117009760 | 3.22598e+07 | 3.6271 | ns | 🚨 |
| tpcds_q74/datafusion:vortex-compact | 372696142 | 1.6094e+08 | 2.31575 | ns | 🚨 |
| tpcds_q75/datafusion:vortex-compact | 328119983 | 1.22134e+08 | 2.68656 | ns | 🚨 |
| tpcds_q76/datafusion:vortex-compact | 147977189 | 3.71079e+07 | 3.98775 | ns | 🚨 |
| tpcds_q77/datafusion:vortex-compact | 130459744 | 4.41818e+07 | 2.9528 | ns | 🚨 |
| tpcds_q78/datafusion:vortex-compact | 239999639 | 2.22867e+08 | 1.07687 | ns | |
| tpcds_q79/datafusion:vortex-compact | 117039606 | 4.17344e+07 | 2.8044 | ns | 🚨 |
| tpcds_q80/datafusion:vortex-compact | 157645974 | 1.32358e+08 | 1.19106 | ns | |
| tpcds_q81/datafusion:vortex-compact | 67231366 | 3.70076e+07 | 1.81669 | ns | 🚨 |
| tpcds_q82/datafusion:vortex-compact | 67523382 | 3.60352e+07 | 1.87382 | ns | 🚨 |
| tpcds_q83/datafusion:vortex-compact | 81159782 | 5.03534e+07 | 1.6118 | ns | 🚨 |
| tpcds_q84/datafusion:vortex-compact | 48586102 | 1.73532e+07 | 2.79983 | ns | 🚨 |
| tpcds_q85/datafusion:vortex-compact | 171766059 | 5.72229e+07 | 3.0017 | ns | 🚨 |
| tpcds_q86/datafusion:vortex-compact | 82734967 | 1.99294e+07 | 4.1514 | ns | 🚨 |
| tpcds_q87/datafusion:vortex-compact | 245825343 | 5.12354e+07 | 4.79796 | ns | 🚨 |
| tpcds_q88/datafusion:vortex-compact | 251051512 | 8.40421e+07 | 2.98721 | ns | 🚨 |
| tpcds_q89/datafusion:vortex-compact | 128225679 | 4.0416e+07 | 3.17265 | ns | 🚨 |
| tpcds_q90/datafusion:vortex-compact | 132445379 | 1.76179e+07 | 7.51768 | ns | 🚨 |
| tpcds_q91/datafusion:vortex-compact | 52695260 | 2.46964e+07 | 2.13372 | ns | 🚨 |
| tpcds_q92/datafusion:vortex-compact | 39937405 | 1.89372e+07 | 2.10894 | ns | 🚨 |
| tpcds_q93/datafusion:vortex-compact | 54514900 | 4.93965e+07 | 1.10362 | ns | |
| tpcds_q94/datafusion:vortex-compact | 113100361 | 3.08723e+07 | 3.66349 | ns | 🚨 |
| tpcds_q95/datafusion:vortex-compact | 230825703 | 7.07551e+07 | 3.26232 | ns | 🚨 |
| tpcds_q96/datafusion:vortex-compact | 76684445 | 1.65123e+07 | 4.64408 | ns | 🚨 |
| tpcds_q97/datafusion:vortex-compact | 49018303 | 3.55552e+07 | 1.37866 | ns | 🚨 |
| tpcds_q98/datafusion:vortex-compact | 65838011 | 3.5545e+07 | 1.85225 | ns | 🚨 |
| tpcds_q99/datafusion:vortex-compact | 113358682 | 7.29417e+07 | 1.5541 | ns | 🚨 |
| tpcds_q01/duckdb:parquet | 46607724 | 4.59157e+07 | 1.01507 | ns | |
| tpcds_q02/duckdb:parquet | 28287915 | 2.89086e+07 | 0.978529 | ns | |
| tpcds_q03/duckdb:parquet | 14024986 | 1.39487e+07 | 1.00547 | ns | |
| tpcds_q04/duckdb:parquet | 132820844 | 1.30611e+08 | 1.01692 | ns | |
| tpcds_q05/duckdb:parquet | 32070429 | 3.10309e+07 | 1.0335 | ns | |
| tpcds_q06/duckdb:parquet | 32785392 | 3.32241e+07 | 0.986797 | ns | |
| tpcds_q07/duckdb:parquet | 28215832 | 2.80088e+07 | 1.00739 | ns | |
| tpcds_q08/duckdb:parquet | 28704863 | 2.86572e+07 | 1.00166 | ns | |
| tpcds_q09/duckdb:parquet | 41916861 | 4.16701e+07 | 1.00592 | ns | |
| tpcds_q10/duckdb:parquet | 39767053 | 4.08952e+07 | 0.972413 | ns | |
| tpcds_q11/duckdb:parquet | 89073923 | 8.97651e+07 | 0.9923 | ns | |
| tpcds_q12/duckdb:parquet | 17832987 | 1.742e+07 | 1.02371 | ns | |
| tpcds_q13/duckdb:parquet | 38232210 | 3.79025e+07 | 1.0087 | ns | |
| tpcds_q14/duckdb:parquet | 103728572 | 1.01805e+08 | 1.01889 | ns | |
| tpcds_q15/duckdb:parquet | 26671818 | 2.71086e+07 | 0.983889 | ns | |
| tpcds_q16/duckdb:parquet | 22476004 | 2.25274e+07 | 0.99772 | ns | |
| tpcds_q17/duckdb:parquet | 39875223 | 3.96161e+07 | 1.00654 | ns | |
| tpcds_q18/duckdb:parquet | 102262629 | 1.02095e+08 | 1.00164 | ns | |
| tpcds_q19/duckdb:parquet | 33199425 | 3.28472e+07 | 1.01072 | ns | |
| tpcds_q20/duckdb:parquet | 17664790 | 1.80807e+07 | 0.976997 | ns | |
| tpcds_q21/duckdb:parquet | 13657644 | 1.36535e+07 | 1.0003 | ns | |
| tpcds_q22/duckdb:parquet | 96881722 | 9.83656e+07 | 0.984915 | ns | |
| tpcds_q23/duckdb:parquet | 99411681 | 9.80456e+07 | 1.01393 | ns | |
| tpcds_q24/duckdb:parquet | 49957368 | 4.94585e+07 | 1.01009 | ns | |
| tpcds_q25/duckdb:parquet | 35863376 | 3.60345e+07 | 0.995251 | ns | |
| tpcds_q26/duckdb:parquet | 38385603 | 3.83601e+07 | 1.00066 | ns | |
| tpcds_q27/duckdb:parquet | 79231385 | 7.95623e+07 | 0.995841 | ns | |
| tpcds_q28/duckdb:parquet | 42985790 | 4.2592e+07 | 1.00925 | ns | |
| tpcds_q29/duckdb:parquet | 37672453 | 3.83188e+07 | 0.983132 | ns | |
| tpcds_q30/duckdb:parquet | 45077260 | 4.49299e+07 | 1.00328 | ns | |
| tpcds_q31/duckdb:parquet | 27374617 | 2.74455e+07 | 0.997418 | ns | |
| tpcds_q32/duckdb:parquet | 12637824 | 1.27314e+07 | 0.992648 | ns | |
| tpcds_q33/duckdb:parquet | 20977194 | 2.07197e+07 | 1.01243 | ns | |
| tpcds_q34/duckdb:parquet | 23942670 | 2.39453e+07 | 0.999889 | ns | |
| tpcds_q35/duckdb:parquet | 69082849 | 6.95381e+07 | 0.993453 | ns | |
| tpcds_q36/duckdb:parquet | 24234041 | 2.44152e+07 | 0.992578 | ns | |
| tpcds_q37/duckdb:parquet | 15811917 | 1.56105e+07 | 1.0129 | ns | |
| tpcds_q38/duckdb:parquet | 35871433 | 3.59028e+07 | 0.999126 | ns | |
| tpcds_q39/duckdb:parquet | 37181705 | 3.72303e+07 | 0.998695 | ns | |
| tpcds_q40/duckdb:parquet | 19803673 | 1.93917e+07 | 1.02125 | ns | |
| tpcds_q41/duckdb:parquet | 9777675 | 9.86961e+06 | 0.990685 | ns | |
| tpcds_q42/duckdb:parquet | 12815321 | 1.28337e+07 | 0.998565 | ns | |
| tpcds_q43/duckdb:parquet | 18949392 | 1.86252e+07 | 1.01741 | ns | |
| tpcds_q44/duckdb:parquet | 28590498 | 2.85702e+07 | 1.00071 | ns | |
| tpcds_q45/duckdb:parquet | 29252700 | 2.92993e+07 | 0.998411 | ns | |
| tpcds_q46/duckdb:parquet | 49682894 | 4.9614e+07 | 1.00139 | ns | |
| tpcds_q47/duckdb:parquet | 60223931 | 5.96281e+07 | 1.00999 | ns | |
| tpcds_q48/duckdb:parquet | 34559144 | 3.39141e+07 | 1.01902 | ns | |
| tpcds_q49/duckdb:parquet | 26752208 | 2.68386e+07 | 0.996782 | ns | |
| tpcds_q50/duckdb:parquet | 28836673 | 2.90242e+07 | 0.993539 | ns | |
| tpcds_q51/duckdb:parquet | 191519357 | 1.93015e+08 | 0.992252 | ns | |
| tpcds_q52/duckdb:parquet | 12980196 | 1.32762e+07 | 0.977704 | ns | |
| tpcds_q53/duckdb:parquet | 20181788 | 2.0726e+07 | 0.973743 | ns | |
| tpcds_q54/duckdb:parquet | 26731267 | 2.61476e+07 | 1.02232 | ns | |
| tpcds_q55/duckdb:parquet | 13058906 | 1.31625e+07 | 0.992128 | ns | |
| tpcds_q56/duckdb:parquet | 23492730 | 2.33283e+07 | 1.00705 | ns | |
| tpcds_q57/duckdb:parquet | 47635858 | 4.72853e+07 | 1.00741 | ns | |
| tpcds_q58/duckdb:parquet | 25946409 | 2.56142e+07 | 1.01297 | ns | |
| tpcds_q59/duckdb:parquet | 39098087 | 3.95537e+07 | 0.988482 | ns | |
| tpcds_q60/duckdb:parquet | 23808528 | 2.40588e+07 | 0.989595 | ns | |
| tpcds_q61/duckdb:parquet | 33590467 | 3.34014e+07 | 1.00566 | ns | |
| tpcds_q62/duckdb:parquet | 13967402 | 1.40653e+07 | 0.993042 | ns | |
| tpcds_q63/duckdb:parquet | 17712349 | 1.75455e+07 | 1.00951 | ns | |
| tpcds_q64/duckdb:parquet | 78932533 | 7.76508e+07 | 1.01651 | ns | |
| tpcds_q65/duckdb:parquet | 30364433 | 2.77975e+07 | 1.09235 | ns | |
| tpcds_q66/duckdb:parquet | 30801053 | 3.03272e+07 | 1.01562 | ns | |
| tpcds_q67/duckdb:parquet | 187475973 | 1.86246e+08 | 1.00661 | ns | |
| tpcds_q68/duckdb:parquet | 39280007 | 3.89281e+07 | 1.00904 | ns | |
| tpcds_q69/duckdb:parquet | 42968008 | 4.24851e+07 | 1.01137 | ns | |
| tpcds_q70/duckdb:parquet | 57016003 | 5.74115e+07 | 0.993112 | ns | |
| tpcds_q71/duckdb:parquet | 21354087 | 2.16474e+07 | 0.986452 | ns | |
| tpcds_q72/duckdb:parquet | 170018750 | 1.70948e+08 | 0.994566 | ns | |
| tpcds_q73/duckdb:parquet | 21388443 | 2.11897e+07 | 1.00938 | ns | |
| tpcds_q74/duckdb:parquet | 55363209 | 5.40435e+07 | 1.02442 | ns | |
| tpcds_q75/duckdb:parquet | 57909775 | 5.57856e+07 | 1.03808 | ns | |
| tpcds_q76/duckdb:parquet | 22083033 | 2.18195e+07 | 1.01208 | ns | |
| tpcds_q77/duckdb:parquet | 23962041 | 2.39115e+07 | 1.00211 | ns | |
| tpcds_q78/duckdb:parquet | 79259548 | 7.91555e+07 | 1.00131 | ns | |
| tpcds_q79/duckdb:parquet | 31922218 | 3.14753e+07 | 1.0142 | ns | |
| tpcds_q80/duckdb:parquet | 44702658 | 4.33813e+07 | 1.03046 | ns | |
| tpcds_q81/duckdb:parquet | 50417531 | 5.06683e+07 | 0.99505 | ns | |
| tpcds_q82/duckdb:parquet | 19789807 | 1.86975e+07 | 1.05842 | ns | |
| tpcds_q83/duckdb:parquet | 18874008 | 1.8789e+07 | 1.00452 | ns | |
| tpcds_q84/duckdb:parquet | 21095114 | 2.15062e+07 | 0.980885 | ns | |
| tpcds_q85/duckdb:parquet | 43683478 | 4.31747e+07 | 1.01178 | ns | |
| tpcds_q86/duckdb:parquet | 38637722 | 3.82845e+07 | 1.00923 | ns | |
| tpcds_q87/duckdb:parquet | 38080929 | 3.76e+07 | 1.01279 | ns | |
| tpcds_q88/duckdb:parquet | 54484362 | 5.42017e+07 | 1.00522 | ns | |
| tpcds_q89/duckdb:parquet | 21959602 | 2.18183e+07 | 1.00647 | ns | |
| tpcds_q90/duckdb:parquet | 9871425 | 1.00854e+07 | 0.97878 | ns | |
| tpcds_q91/duckdb:parquet | 27502636 | 2.81106e+07 | 0.978372 | ns | |
| tpcds_q92/duckdb:parquet | 13865004 | 1.35438e+07 | 1.02371 | ns | |
| tpcds_q93/duckdb:parquet | 33683051 | 3.34572e+07 | 1.00675 | ns | |
| tpcds_q94/duckdb:parquet | 19098955 | 1.84448e+07 | 1.03546 | ns | |
| tpcds_q95/duckdb:parquet | 148386083 | 1.3733e+08 | 1.08051 | ns | |
| tpcds_q96/duckdb:parquet | 11395404 | 1.17022e+07 | 0.973785 | ns | |
| tpcds_q97/duckdb:parquet | 39874221 | 3.77322e+07 | 1.05677 | ns | |
| tpcds_q98/duckdb:parquet | 23820615 | 2.38031e+07 | 1.00073 | ns | |
| tpcds_q99/duckdb:parquet | 24648684 | 2.44855e+07 | 1.00666 | ns | |
| tpcds_q01/duckdb:vortex-file-compressed | 36804812 | 3.49643e+07 | 1.05264 | ns | |
| tpcds_q02/duckdb:vortex-file-compressed | 58929948 | 5.6459e+07 | 1.04377 | ns | |
| tpcds_q03/duckdb:vortex-file-compressed | 24758526 | 2.40829e+07 | 1.02805 | ns | |
| tpcds_q04/duckdb:vortex-file-compressed | 117047527 | 1.15479e+08 | 1.01358 | ns | |
| tpcds_q05/duckdb:vortex-file-compressed | 42322847 | 4.23251e+07 | 0.999947 | ns | |
| tpcds_q06/duckdb:vortex-file-compressed | 39622772 | 3.97634e+07 | 0.996462 | ns | |
| tpcds_q07/duckdb:vortex-file-compressed | 29063565 | 3.00431e+07 | 0.967395 | ns | |
| tpcds_q08/duckdb:vortex-file-compressed | 33675758 | 3.39043e+07 | 0.99326 | ns | |
| tpcds_q09/duckdb:vortex-file-compressed | 37961617 | 3.82761e+07 | 0.991785 | ns | |
| tpcds_q10/duckdb:vortex-file-compressed | 51518913 | 5.04587e+07 | 1.02101 | ns | |
| tpcds_q11/duckdb:vortex-file-compressed | 69998973 | 7.21938e+07 | 0.969598 | ns | |
| tpcds_q12/duckdb:vortex-file-compressed | 19355974 | 1.88437e+07 | 1.02719 | ns | |
| tpcds_q13/duckdb:vortex-file-compressed | 36225424 | 3.69397e+07 | 0.980665 | ns | |
| tpcds_q14/duckdb:vortex-file-compressed | 128936021 | 1.26026e+08 | 1.02309 | ns | |
| tpcds_q15/duckdb:vortex-file-compressed | 30405864 | 3.04311e+07 | 0.999172 | ns | |
| tpcds_q16/duckdb:vortex-file-compressed | 32735699 | 3.23204e+07 | 1.01285 | ns | |
| tpcds_q17/duckdb:vortex-file-compressed | 44014014 | 4.33953e+07 | 1.01426 | ns | |
| tpcds_q18/duckdb:vortex-file-compressed | 103141639 | 1.01102e+08 | 1.02017 | ns | |
| tpcds_q19/duckdb:vortex-file-compressed | 36818036 | 3.68643e+07 | 0.998746 | ns | |
| tpcds_q20/duckdb:vortex-file-compressed | 19654580 | 2.03957e+07 | 0.963664 | ns | |
| tpcds_q21/duckdb:vortex-file-compressed | 19165693 | 2.05285e+07 | 0.933615 | ns | |
| tpcds_q22/duckdb:vortex-file-compressed | 113761729 | 1.10697e+08 | 1.02769 | ns | |
| tpcds_q23/duckdb:vortex-file-compressed | 118112356 | 1.18246e+08 | 0.998871 | ns | |
| tpcds_q24/duckdb:vortex-file-compressed | 56293456 | 5.68836e+07 | 0.989626 | ns | |
| tpcds_q25/duckdb:vortex-file-compressed | 43456794 | 4.22199e+07 | 1.0293 | ns | |
| tpcds_q26/duckdb:vortex-file-compressed | 46697310 | 4.77229e+07 | 0.978509 | ns | |
| tpcds_q27/duckdb:vortex-file-compressed | 80853257 | 8.11328e+07 | 0.996555 | ns | |
| tpcds_q28/duckdb:vortex-file-compressed | 34812537 | 3.60366e+07 | 0.966033 | ns | |
| tpcds_q29/duckdb:vortex-file-compressed | 44605666 | 4.49204e+07 | 0.992994 | ns | |
| tpcds_q30/duckdb:vortex-file-compressed | 37668471 | 3.81873e+07 | 0.986414 | ns | |
| tpcds_q31/duckdb:vortex-file-compressed | 33976078 | 3.72745e+07 | 0.911511 | ns | |
| tpcds_q32/duckdb:vortex-file-compressed | 16498460 | 1.77492e+07 | 0.929531 | ns | |
| tpcds_q33/duckdb:vortex-file-compressed | 28638578 | 3.33813e+07 | 0.857923 | ns | |
| tpcds_q34/duckdb:vortex-file-compressed | 29960148 | 2.79141e+07 | 1.0733 | ns | |
| tpcds_q35/duckdb:vortex-file-compressed | 78375184 | 7.84301e+07 | 0.9993 | ns | |
| tpcds_q36/duckdb:vortex-file-compressed | 28220733 | 2.74564e+07 | 1.02784 | ns | |
| tpcds_q37/duckdb:vortex-file-compressed | 17568023 | 1.71174e+07 | 1.02633 | ns | |
| tpcds_q38/duckdb:vortex-file-compressed | 42778468 | 4.37392e+07 | 0.978034 | ns | |
| tpcds_q39/duckdb:vortex-file-compressed | 43891626 | 4.28915e+07 | 1.02332 | ns | |
| tpcds_q40/duckdb:vortex-file-compressed | 25358298 | 2.59292e+07 | 0.977982 | ns | |
| tpcds_q41/duckdb:vortex-file-compressed | 18474258 | 1.89524e+07 | 0.974771 | ns | |
| tpcds_q42/duckdb:vortex-file-compressed | 13673315 | 1.42514e+07 | 0.959434 | ns | |
| tpcds_q43/duckdb:vortex-file-compressed | 20235634 | 2.01874e+07 | 1.00239 | ns | |
| tpcds_q44/duckdb:vortex-file-compressed | 30169027 | 3.13797e+07 | 0.961418 | ns | |
| tpcds_q45/duckdb:vortex-file-compressed | 33987270 | 3.48481e+07 | 0.975299 | ns | |
| tpcds_q46/duckdb:vortex-file-compressed | 54905273 | 5.49347e+07 | 0.999465 | ns | |
| tpcds_q47/duckdb:vortex-file-compressed | 64615120 | 6.54593e+07 | 0.987104 | ns | |
| tpcds_q48/duckdb:vortex-file-compressed | 33467098 | 3.32544e+07 | 1.0064 | ns | |
| tpcds_q49/duckdb:vortex-file-compressed | 37035247 | 3.76402e+07 | 0.983927 | ns | |
| tpcds_q50/duckdb:vortex-file-compressed | 36298763 | 3.56237e+07 | 1.01895 | ns | |
| tpcds_q51/duckdb:vortex-file-compressed | 115704241 | 1.13953e+08 | 1.01537 | ns | |
| tpcds_q52/duckdb:vortex-file-compressed | 13676140 | 1.4305e+07 | 0.95604 | ns | |
| tpcds_q53/duckdb:vortex-file-compressed | 27153605 | 2.70504e+07 | 1.00381 | ns | |
| tpcds_q54/duckdb:vortex-file-compressed | 35609454 | 3.62298e+07 | 0.982877 | ns | |
| tpcds_q55/duckdb:vortex-file-compressed | 13437103 | 1.37606e+07 | 0.976492 | ns | |
| tpcds_q56/duckdb:vortex-file-compressed | 35531481 | 3.55862e+07 | 0.998463 | ns | |
| tpcds_q57/duckdb:vortex-file-compressed | 60630512 | 6.15717e+07 | 0.984714 | ns | |
| tpcds_q58/duckdb:vortex-file-compressed | 37306252 | 3.73485e+07 | 0.99887 | ns | |
| tpcds_q59/duckdb:vortex-file-compressed | 51447904 | 5.2196e+07 | 0.985668 | ns | |
| tpcds_q60/duckdb:vortex-file-compressed | 33787789 | 3.57379e+07 | 0.945432 | ns | |
| tpcds_q61/duckdb:vortex-file-compressed | 36202949 | 3.81494e+07 | 0.948978 | ns | |
| tpcds_q62/duckdb:vortex-file-compressed | 26225562 | 2.53198e+07 | 1.03577 | ns | |
| tpcds_q63/duckdb:vortex-file-compressed | 26845785 | 2.77232e+07 | 0.96835 | ns | |
| tpcds_q64/duckdb:vortex-file-compressed | 89062604 | 8.94089e+07 | 0.996127 | ns | |
| tpcds_q65/duckdb:vortex-file-compressed | 32035464 | 3.15856e+07 | 1.01424 | ns | |
| tpcds_q66/duckdb:vortex-file-compressed | 32981233 | 3.48186e+07 | 0.947229 | ns | |
| tpcds_q67/duckdb:vortex-file-compressed | 176816116 | 1.75106e+08 | 1.00977 | ns | |
| tpcds_q68/duckdb:vortex-file-compressed | 45288298 | 4.5227e+07 | 1.00135 | ns | |
| tpcds_q69/duckdb:vortex-file-compressed | 51299920 | 5.02152e+07 | 1.0216 | ns | |
| tpcds_q70/duckdb:vortex-file-compressed | 54253561 | 5.3546e+07 | 1.01321 | ns | |
| tpcds_q71/duckdb:vortex-file-compressed | 24532142 | 2.41339e+07 | 1.0165 | ns | |
| tpcds_q72/duckdb:vortex-file-compressed | 172226251 | 1.72697e+08 | 0.997274 | ns | |
| tpcds_q73/duckdb:vortex-file-compressed | 24598614 | 2.56517e+07 | 0.958946 | ns | |
| tpcds_q74/duckdb:vortex-file-compressed | 59558301 | 6.14288e+07 | 0.969549 | ns | |
| tpcds_q75/duckdb:vortex-file-compressed | 68495428 | 6.93849e+07 | 0.98718 | ns | |
| tpcds_q76/duckdb:vortex-file-compressed | 23291989 | 2.29306e+07 | 1.01576 | ns | |
| tpcds_q77/duckdb:vortex-file-compressed | 31862012 | 3.25078e+07 | 0.980134 | ns | |
| tpcds_q78/duckdb:vortex-file-compressed | 90380742 | 9.12655e+07 | 0.990306 | ns | |
| tpcds_q79/duckdb:vortex-file-compressed | 34963896 | 3.57258e+07 | 0.978674 | ns | |
| tpcds_q80/duckdb:vortex-file-compressed | 51811906 | 5.25238e+07 | 0.986447 | ns | |
| tpcds_q81/duckdb:vortex-file-compressed | 40952069 | 4.12405e+07 | 0.993007 | ns | |
| tpcds_q82/duckdb:vortex-file-compressed | 18912468 | 1.9312e+07 | 0.979311 | ns | |
| tpcds_q83/duckdb:vortex-file-compressed | 38983506 | 3.69005e+07 | 1.05645 | ns | |
| tpcds_q84/duckdb:vortex-file-compressed | 23314546 | 2.34346e+07 | 0.994876 | ns | |
| tpcds_q85/duckdb:vortex-file-compressed | 55326772 | 5.51415e+07 | 1.00336 | ns | |
| tpcds_q86/duckdb:vortex-file-compressed | 44927332 | 4.42793e+07 | 1.01464 | ns | |
| tpcds_q87/duckdb:vortex-file-compressed | 46099534 | 4.62312e+07 | 0.997153 | ns | |
| tpcds_q88/duckdb:vortex-file-compressed | 53162329 | 5.25323e+07 | 1.01199 | ns | |
| tpcds_q89/duckdb:vortex-file-compressed | 27188672 | 2.70471e+07 | 1.00523 | ns | |
| tpcds_q90/duckdb:vortex-file-compressed | 18896665 | 1.56475e+07 | 1.20764 | ns | |
| tpcds_q91/duckdb:vortex-file-compressed | 35717353 | 3.47536e+07 | 1.02773 | ns | |
| tpcds_q92/duckdb:vortex-file-compressed | 21706415 | 2.06698e+07 | 1.05015 | ns | |
| tpcds_q93/duckdb:vortex-file-compressed | 32018784 | 3.22476e+07 | 0.992906 | ns | |
| tpcds_q94/duckdb:vortex-file-compressed | 26863020 | 2.61941e+07 | 1.02554 | ns | |
| tpcds_q95/duckdb:vortex-file-compressed | 145758443 | 1.59483e+08 | 0.913944 | ns | |
| tpcds_q96/duckdb:vortex-file-compressed | 12094857 | 1.26873e+07 | 0.953302 | ns | |
| tpcds_q97/duckdb:vortex-file-compressed | 44817126 | 4.45158e+07 | 1.00677 | ns | |
| tpcds_q98/duckdb:vortex-file-compressed | 20315573 | 2.13213e+07 | 0.952829 | ns | |
| tpcds_q99/duckdb:vortex-file-compressed | 39580494 | 3.85321e+07 | 1.02721 | ns | |
| tpcds_q01/duckdb:vortex-compact | 34034956 | 3.38072e+07 | 1.00674 | ns | |
| tpcds_q02/duckdb:vortex-compact | 56415480 | 5.89111e+07 | 0.957637 | ns | |
| tpcds_q03/duckdb:vortex-compact | 23449626 | 2.2999e+07 | 1.01959 | ns | |
| tpcds_q04/duckdb:vortex-compact | 117232588 | 1.13597e+08 | 1.03201 | ns | |
| tpcds_q05/duckdb:vortex-compact | 41983364 | 4.28007e+07 | 0.980904 | ns | |
| tpcds_q06/duckdb:vortex-compact | 39621003 | 4.07244e+07 | 0.972905 | ns | |
| tpcds_q07/duckdb:vortex-compact | 30063298 | 2.96966e+07 | 1.01235 | ns | |
| tpcds_q08/duckdb:vortex-compact | 33629680 | 3.43058e+07 | 0.980292 | ns | |
| tpcds_q09/duckdb:vortex-compact | 38833213 | 3.86401e+07 | 1.005 | ns | |
| tpcds_q10/duckdb:vortex-compact | 49960145 | 4.95461e+07 | 1.00836 | ns | |
| tpcds_q11/duckdb:vortex-compact | 70648618 | 7.14006e+07 | 0.989468 | ns | |
| tpcds_q12/duckdb:vortex-compact | 18496327 | 1.92874e+07 | 0.958986 | ns | |
| tpcds_q13/duckdb:vortex-compact | 36836608 | 3.64296e+07 | 1.01117 | ns | |
| tpcds_q14/duckdb:vortex-compact | 125422208 | 1.25879e+08 | 0.996375 | ns | |
| tpcds_q15/duckdb:vortex-compact | 30815961 | 3.08884e+07 | 0.997653 | ns | |
| tpcds_q16/duckdb:vortex-compact | 32112991 | 3.306e+07 | 0.971355 | ns | |
| tpcds_q17/duckdb:vortex-compact | 42646545 | 4.28142e+07 | 0.996085 | ns | |
| tpcds_q18/duckdb:vortex-compact | 103398290 | 9.77032e+07 | 1.05829 | ns | |
| tpcds_q19/duckdb:vortex-compact | 36382865 | 3.66431e+07 | 0.992899 | ns | |
| tpcds_q20/duckdb:vortex-compact | 19687046 | 2.00491e+07 | 0.981941 | ns | |
| tpcds_q21/duckdb:vortex-compact | 18430940 | 1.76235e+07 | 1.04582 | ns | |
| tpcds_q22/duckdb:vortex-compact | 111531016 | 1.13332e+08 | 0.984105 | ns | |
| tpcds_q23/duckdb:vortex-compact | 113677856 | 1.1551e+08 | 0.984137 | ns | |
| tpcds_q24/duckdb:vortex-compact | 56335965 | 5.80817e+07 | 0.969944 | ns | |
| tpcds_q25/duckdb:vortex-compact | 42024650 | 4.20809e+07 | 0.998664 | ns | |
| tpcds_q26/duckdb:vortex-compact | 47189112 | 4.62219e+07 | 1.02093 | ns | |
| tpcds_q27/duckdb:vortex-compact | 81679857 | 7.96242e+07 | 1.02582 | ns | |
| tpcds_q28/duckdb:vortex-compact | 34793019 | 3.43545e+07 | 1.01277 | ns | |
| tpcds_q29/duckdb:vortex-compact | 42990261 | 4.34209e+07 | 0.990082 | ns | |
| tpcds_q30/duckdb:vortex-compact | 36844439 | 3.63534e+07 | 1.01351 | ns | |
| tpcds_q31/duckdb:vortex-compact | 35002371 | 3.64121e+07 | 0.961285 | ns | |
| tpcds_q32/duckdb:vortex-compact | 16699622 | 1.72056e+07 | 0.97059 | ns | |
| tpcds_q33/duckdb:vortex-compact | 32563307 | 3.08594e+07 | 1.05522 | ns | |
| tpcds_q34/duckdb:vortex-compact | 28593795 | 2.80023e+07 | 1.02112 | ns | |
| tpcds_q35/duckdb:vortex-compact | 79196422 | 7.86821e+07 | 1.00654 | ns | |
| tpcds_q36/duckdb:vortex-compact | 28032527 | 2.82545e+07 | 0.992143 | ns | |
| tpcds_q37/duckdb:vortex-compact | 17041286 | 1.75379e+07 | 0.971681 | ns | |
| tpcds_q38/duckdb:vortex-compact | 42877243 | 4.40133e+07 | 0.974189 | ns | |
| tpcds_q39/duckdb:vortex-compact | 44400165 | 4.30981e+07 | 1.03021 | ns | |
| tpcds_q40/duckdb:vortex-compact | 25219975 | 2.50345e+07 | 1.00741 | ns | |
| tpcds_q41/duckdb:vortex-compact | 18519873 | 1.87919e+07 | 0.985522 | ns | |
| tpcds_q42/duckdb:vortex-compact | 14063234 | 1.37323e+07 | 1.0241 | ns | |
| tpcds_q43/duckdb:vortex-compact | 20751583 | 1.97758e+07 | 1.04934 | ns | |
| tpcds_q44/duckdb:vortex-compact | 30143815 | 3.04552e+07 | 0.989775 | ns | |
| tpcds_q45/duckdb:vortex-compact | 34474042 | 3.42492e+07 | 1.00656 | ns | |
| tpcds_q46/duckdb:vortex-compact | 55143319 | 5.54984e+07 | 0.993602 | ns | |
| tpcds_q47/duckdb:vortex-compact | 64781971 | 6.49833e+07 | 0.996901 | ns | |
| tpcds_q48/duckdb:vortex-compact | 33419240 | 3.38288e+07 | 0.987893 | ns | |
| tpcds_q49/duckdb:vortex-compact | 37412577 | 3.67758e+07 | 1.01732 | ns | |
| tpcds_q50/duckdb:vortex-compact | 35922903 | 3.60976e+07 | 0.99516 | ns | |
| tpcds_q51/duckdb:vortex-compact | 114935301 | 2.01169e+08 | 0.571337 | ns | 🚀 |
| tpcds_q52/duckdb:vortex-compact | 13481107 | 1.39678e+07 | 0.965153 | ns | |
| tpcds_q53/duckdb:vortex-compact | 26979704 | 2.71789e+07 | 0.99267 | ns | |
| tpcds_q54/duckdb:vortex-compact | 34560746 | 3.59321e+07 | 0.961835 | ns | |
| tpcds_q55/duckdb:vortex-compact | 13560713 | 1.35223e+07 | 1.00284 | ns | |
| tpcds_q56/duckdb:vortex-compact | 35774953 | 3.32213e+07 | 1.07687 | ns | |
| tpcds_q57/duckdb:vortex-compact | 59595389 | 5.96969e+07 | 0.9983 | ns | |
| tpcds_q58/duckdb:vortex-compact | 36013836 | 3.6938e+07 | 0.974982 | ns | |
| tpcds_q59/duckdb:vortex-compact | 51955570 | 5.17648e+07 | 1.00369 | ns | |
| tpcds_q60/duckdb:vortex-compact | 31270560 | 3.5257e+07 | 0.886931 | ns | |
| tpcds_q61/duckdb:vortex-compact | 36573926 | 3.73022e+07 | 0.980477 | ns | |
| tpcds_q62/duckdb:vortex-compact | 25176876 | 2.54745e+07 | 0.988317 | ns | |
| tpcds_q63/duckdb:vortex-compact | 26641253 | 2.67294e+07 | 0.996704 | ns | |
| tpcds_q64/duckdb:vortex-compact | 86980208 | 8.79102e+07 | 0.989421 | ns | |
| tpcds_q65/duckdb:vortex-compact | 32929450 | 3.3478e+07 | 0.983613 | ns | |
| tpcds_q66/duckdb:vortex-compact | 35421665 | 3.41093e+07 | 1.03848 | ns | |
| tpcds_q67/duckdb:vortex-compact | 177477592 | 1.7786e+08 | 0.997847 | ns | |
| tpcds_q68/duckdb:vortex-compact | 45419152 | 4.60944e+07 | 0.985352 | ns | |
| tpcds_q69/duckdb:vortex-compact | 50788737 | 4.96702e+07 | 1.02252 | ns | |
| tpcds_q70/duckdb:vortex-compact | 54079195 | 5.35002e+07 | 1.01082 | ns | |
| tpcds_q71/duckdb:vortex-compact | 23410590 | 2.41448e+07 | 0.969591 | ns | |
| tpcds_q72/duckdb:vortex-compact | 171714116 | 1.72359e+08 | 0.996258 | ns | |
| tpcds_q73/duckdb:vortex-compact | 24484093 | 2.49627e+07 | 0.980828 | ns | |
| tpcds_q74/duckdb:vortex-compact | 61002320 | 6.29697e+07 | 0.968757 | ns | |
| tpcds_q75/duckdb:vortex-compact | 69602161 | 6.79657e+07 | 1.02408 | ns | |
| tpcds_q76/duckdb:vortex-compact | 23802813 | 2.3093e+07 | 1.03074 | ns | |
| tpcds_q77/duckdb:vortex-compact | 31038686 | 3.0819e+07 | 1.00713 | ns | |
| tpcds_q78/duckdb:vortex-compact | 94499612 | 9.12781e+07 | 1.03529 | ns | |
| tpcds_q79/duckdb:vortex-compact | 35786085 | 3.53681e+07 | 1.01182 | ns | |
| tpcds_q80/duckdb:vortex-compact | 51795020 | 5.53484e+07 | 0.9358 | ns | |
| tpcds_q81/duckdb:vortex-compact | 41360027 | 3.98176e+07 | 1.03874 | ns | |
| tpcds_q82/duckdb:vortex-compact | 18945920 | 1.92698e+07 | 0.983191 | ns | |
| tpcds_q83/duckdb:vortex-compact | 38657571 | 3.95182e+07 | 0.978222 | ns | |
| tpcds_q84/duckdb:vortex-compact | 24199326 | 2.39005e+07 | 1.0125 | ns | |
| tpcds_q85/duckdb:vortex-compact | 54801168 | 5.52177e+07 | 0.992457 | ns | |
| tpcds_q86/duckdb:vortex-compact | 44316049 | 4.49289e+07 | 0.98636 | ns | |
| tpcds_q87/duckdb:vortex-compact | 45096438 | 4.58011e+07 | 0.984614 | ns | |
| tpcds_q88/duckdb:vortex-compact | 52528801 | 5.17316e+07 | 1.01541 | ns | |
| tpcds_q89/duckdb:vortex-compact | 26929263 | 2.71225e+07 | 0.992874 | ns | |
| tpcds_q90/duckdb:vortex-compact | 18954054 | 1.94538e+07 | 0.97431 | ns | |
| tpcds_q91/duckdb:vortex-compact | 34255278 | 3.44698e+07 | 0.993776 | ns | |
| tpcds_q92/duckdb:vortex-compact | 20324368 | 2.13383e+07 | 0.952483 | ns | |
| tpcds_q93/duckdb:vortex-compact | 31788952 | 3.25104e+07 | 0.97781 | ns | |
| tpcds_q94/duckdb:vortex-compact | 25913104 | 2.72715e+07 | 0.950191 | ns | |
| tpcds_q95/duckdb:vortex-compact | 160190805 | 1.58832e+08 | 1.00856 | ns | |
| tpcds_q96/duckdb:vortex-compact | 12271579 | 1.26892e+07 | 0.967091 | ns | |
| tpcds_q97/duckdb:vortex-compact | 45231986 | 4.46987e+07 | 1.01193 | ns | |
| tpcds_q98/duckdb:vortex-compact | 20178520 | 2.11105e+07 | 0.955853 | ns | |
| tpcds_q99/duckdb:vortex-compact | 40827158 | 3.91264e+07 | 1.04347 | ns | |
| tpcds_q01/duckdb:duckdb | 24385593 | 2.35972e+07 | 1.03341 | ns | |
| tpcds_q02/duckdb:duckdb | 23956927 | 2.47698e+07 | 0.967185 | ns | |
| tpcds_q03/duckdb:duckdb | 10819000 | 1.07317e+07 | 1.00814 | ns | |
| tpcds_q04/duckdb:duckdb | 173781906 | 1.72039e+08 | 1.01013 | ns | |
| tpcds_q05/duckdb:duckdb | 21716610 | 2.17341e+07 | 0.999196 | ns | |
| tpcds_q06/duckdb:duckdb | 28528751 | 2.80364e+07 | 1.01756 | ns | |
| tpcds_q07/duckdb:duckdb | 42373175 | 4.19981e+07 | 1.00893 | ns | |
| tpcds_q08/duckdb:duckdb | 125011952 | 1.23402e+08 | 1.01305 | ns | |
| tpcds_q09/duckdb:duckdb | 19421103 | 1.93785e+07 | 1.0022 | ns | |
| tpcds_q10/duckdb:duckdb | 27622466 | 2.88107e+07 | 0.958758 | ns | |
| tpcds_q11/duckdb:duckdb | 152142630 | 1.53899e+08 | 0.988585 | ns | |
| tpcds_q12/duckdb:duckdb | 14765244 | 1.4583e+07 | 1.0125 | ns | |
| tpcds_q13/duckdb:duckdb | 26762232 | 2.70431e+07 | 0.989613 | ns | |
| tpcds_q14/duckdb:duckdb | 95670740 | 9.40589e+07 | 1.01714 | ns | |
| tpcds_q15/duckdb:duckdb | 23463916 | 2.29499e+07 | 1.0224 | ns | |
| tpcds_q16/duckdb:duckdb | 20266212 | 2.00102e+07 | 1.0128 | ns | |
| tpcds_q17/duckdb:duckdb | 25015580 | 2.51443e+07 | 0.994881 | ns | |
| tpcds_q18/duckdb:duckdb | 49772402 | 4.95266e+07 | 1.00496 | ns | |
| tpcds_q19/duckdb:duckdb | 20166990 | 2.00938e+07 | 1.00364 | ns | |
| tpcds_q20/duckdb:duckdb | 14917062 | 1.42501e+07 | 1.04681 | ns | |
| tpcds_q21/duckdb:duckdb | 7710812 | 7.75388e+06 | 0.994445 | ns | |
| tpcds_q22/duckdb:duckdb | 83019493 | 8.31962e+07 | 0.997877 | ns | |
| tpcds_q23/duckdb:duckdb | 72604943 | 7.2861e+07 | 0.996485 | ns | |
| tpcds_q24/duckdb:duckdb | 26962685 | 2.61027e+07 | 1.03295 | ns | |
| tpcds_q25/duckdb:duckdb | 19346876 | 1.92193e+07 | 1.00664 | ns | |
| tpcds_q26/duckdb:duckdb | 29632388 | 2.96167e+07 | 1.00053 | ns | |
| tpcds_q27/duckdb:duckdb | 52224183 | 5.26991e+07 | 0.990988 | ns | |
| tpcds_q28/duckdb:duckdb | 25113288 | 2.51111e+07 | 1.00009 | ns | |
| tpcds_q29/duckdb:duckdb | 24482223 | 2.45142e+07 | 0.998696 | ns | |
| tpcds_q30/duckdb:duckdb | 32781339 | 3.27039e+07 | 1.00237 | ns | |
| tpcds_q31/duckdb:duckdb | 24791286 | 2.40249e+07 | 1.0319 | ns | |
| tpcds_q32/duckdb:duckdb | 8437938 | 8.45029e+06 | 0.998539 | ns | |
| tpcds_q33/duckdb:duckdb | 16812119 | 1.65219e+07 | 1.01757 | ns | |
| tpcds_q34/duckdb:duckdb | 19184635 | 1.91388e+07 | 1.00239 | ns | |
| tpcds_q35/duckdb:duckdb | 38821302 | 4.08965e+07 | 0.949257 | ns | |
| tpcds_q36/duckdb:duckdb | 77871337 | 7.62212e+07 | 1.02165 | ns | |
| tpcds_q37/duckdb:duckdb | 9376548 | 9.38481e+06 | 0.999119 | ns | |
| tpcds_q38/duckdb:duckdb | 33346717 | 3.29161e+07 | 1.01308 | ns | |
| tpcds_q39/duckdb:duckdb | 36545477 | 3.03488e+07 | 1.20418 | ns | |
| tpcds_q40/duckdb:duckdb | 15532232 | 1.55398e+07 | 0.999512 | ns | |
| tpcds_q41/duckdb:duckdb | 10223749 | 1.04557e+07 | 0.977819 | ns | |
| tpcds_q42/duckdb:duckdb | 9234697 | 9.29485e+06 | 0.993528 | ns | |
| tpcds_q43/duckdb:duckdb | 14667940 | 1.47173e+07 | 0.996647 | ns | |
| tpcds_q44/duckdb:duckdb | 17312044 | 1.76402e+07 | 0.9814 | ns | |
| tpcds_q45/duckdb:duckdb | 19679096 | 1.89587e+07 | 1.038 | ns | |
| tpcds_q46/duckdb:duckdb | 41127179 | 4.0058e+07 | 1.02669 | ns | |
| tpcds_q47/duckdb:duckdb | 54212701 | 5.42801e+07 | 0.998758 | ns | |
| tpcds_q48/duckdb:duckdb | 26386626 | 2.59041e+07 | 1.01863 | ns | |
| tpcds_q49/duckdb:duckdb | 18304635 | 1.78802e+07 | 1.02374 | ns | |
| tpcds_q50/duckdb:duckdb | 17104178 | 1.69935e+07 | 1.00651 | ns | |
| tpcds_q51/duckdb:duckdb | 104808147 | 1.04913e+08 | 0.999003 | ns | |
| tpcds_q52/duckdb:duckdb | 9232615 | 9.39247e+06 | 0.982981 | ns | |
| tpcds_q53/duckdb:duckdb | 16049992 | 1.59396e+07 | 1.00692 | ns | |
| tpcds_q54/duckdb:duckdb | 20125688 | 2.03088e+07 | 0.990983 | ns | |
| tpcds_q55/duckdb:duckdb | 9867545 | 9.67372e+06 | 1.02004 | ns | |
| tpcds_q56/duckdb:duckdb | 17847661 | 1.74839e+07 | 1.02081 | ns | |
| tpcds_q57/duckdb:duckdb | 46253378 | 4.60236e+07 | 1.00499 | ns | |
| tpcds_q58/duckdb:duckdb | 15689390 | 1.66868e+07 | 0.940227 | ns | |
| tpcds_q59/duckdb:duckdb | 38198796 | 3.78553e+07 | 1.00908 | ns | |
| tpcds_q60/duckdb:duckdb | 20427088 | 1.92348e+07 | 1.06199 | ns | |
| tpcds_q61/duckdb:duckdb | 18488600 | 1.87386e+07 | 0.986658 | ns | |
| tpcds_q62/duckdb:duckdb | 10648063 | 1.06917e+07 | 0.99592 | ns | |
| tpcds_q63/duckdb:duckdb | 14154056 | 1.40525e+07 | 1.00722 | ns | |
| tpcds_q64/duckdb:duckdb | 60495954 | 6.08308e+07 | 0.994496 | ns | |
| tpcds_q65/duckdb:duckdb | 37692752 | 3.68771e+07 | 1.02212 | ns | |
| tpcds_q66/duckdb:duckdb | 28698903 | 2.71773e+07 | 1.05599 | ns | |
| tpcds_q67/duckdb:duckdb | 151353395 | 1.52764e+08 | 0.990765 | ns | |
| tpcds_q68/duckdb:duckdb | 28611668 | 2.84692e+07 | 1.00501 | ns | |
| tpcds_q69/duckdb:duckdb | 30633135 | 3.04981e+07 | 1.00443 | ns | |
| tpcds_q70/duckdb:duckdb | 20165131 | 1.98497e+07 | 1.01589 | ns | |
| tpcds_q71/duckdb:duckdb | 16876124 | 1.72011e+07 | 0.981105 | ns | |
| tpcds_q72/duckdb:duckdb | 46438347 | 4.60516e+07 | 1.0084 | ns | |
| tpcds_q73/duckdb:duckdb | 15064646 | 1.51719e+07 | 0.992933 | ns | |
| tpcds_q74/duckdb:duckdb | 107512992 | 1.05718e+08 | 1.01698 | ns | |
| tpcds_q75/duckdb:duckdb | 44008502 | 4.39697e+07 | 1.00088 | ns | |
| tpcds_q76/duckdb:duckdb | 14683023 | 1.49145e+07 | 0.984477 | ns | |
| tpcds_q77/duckdb:duckdb | 14756651 | 1.46672e+07 | 1.0061 | ns | |
| tpcds_q78/duckdb:duckdb | 65911037 | 6.69584e+07 | 0.984358 | ns | |
| tpcds_q79/duckdb:duckdb | 22113451 | 2.18834e+07 | 1.01051 | ns | |
| tpcds_q80/duckdb:duckdb | 31978014 | 3.17687e+07 | 1.00659 | ns | |
| tpcds_q81/duckdb:duckdb | 42194211 | 4.16059e+07 | 1.01414 | ns | |
| tpcds_q82/duckdb:duckdb | 11339694 | 1.13119e+07 | 1.00246 | ns | |
| tpcds_q83/duckdb:duckdb | 10927581 | 1.08782e+07 | 1.00454 | ns | |
| tpcds_q84/duckdb:duckdb | 15118686 | 1.49612e+07 | 1.01052 | ns | |
| tpcds_q85/duckdb:duckdb | 25689925 | 2.60823e+07 | 0.984958 | ns | |
| tpcds_q86/duckdb:duckdb | 13587909 | 1.34492e+07 | 1.01032 | ns | |
| tpcds_q87/duckdb:duckdb | 34427462 | 3.43989e+07 | 1.00083 | ns | |
| tpcds_q88/duckdb:duckdb | 28324275 | 2.72871e+07 | 1.03801 | ns | |
| tpcds_q89/duckdb:duckdb | 18718804 | 1.88822e+07 | 0.991348 | ns | |
| tpcds_q90/duckdb:duckdb | 6713672 | 6.94158e+06 | 0.967167 | ns | |
| tpcds_q91/duckdb:duckdb | 14560571 | 1.52929e+07 | 0.952114 | ns | |
| tpcds_q92/duckdb:duckdb | 10357777 | 1.01256e+07 | 1.02293 | ns | |
| tpcds_q93/duckdb:duckdb | 23941244 | 2.36549e+07 | 1.0121 | ns | |
| tpcds_q94/duckdb:duckdb | 14758356 | 1.51493e+07 | 0.974193 | ns | |
| tpcds_q95/duckdb:duckdb | 125037415 | 1.10634e+08 | 1.13019 | ns | |
| tpcds_q96/duckdb:duckdb | 6136551 | 6.15819e+06 | 0.996486 | ns | |
| tpcds_q97/duckdb:duckdb | 33149089 | 3.23017e+07 | 1.02623 | ns | |
| tpcds_q98/duckdb:duckdb | 19307805 | 1.92722e+07 | 1.00185 | ns | |
| tpcds_q99/duckdb:duckdb | 21336693 | 2.11987e+07 | 1.00651 | ns |
Benchmarks: GitHub Archive (NVMe)
Summary
- Overall: 1.008x ➖
- Vortex: 1.013x ➖
- duckdb:vortex: 1.010x ➖
- datafusion:vortex: 1.015x ➖
- Best: gharchive_q02/duckdb:vortex-file-compressed (0.953x)
- Worst: gharchive_q04/datafusion:vortex-file-compressed (1.093x)
- Significant (>10%): 0↑ 0↓
Detailed Results Table
| name | PR d45a27d4 | base 7541a3b3 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| gharchive_q00/datafusion:parquet | 3138077925 | 3.18848e+09 | 0.984192 | ns | |
| gharchive_q00/datafusion:parquet | 3138077925 | 3.19475e+09 | 0.982261 | ns | |
| gharchive_q01/datafusion:parquet | 70864645 | 6.44436e+07 | 1.09964 | ns | |
| gharchive_q01/datafusion:parquet | 70864645 | 6.55471e+07 | 1.08113 | ns | |
| gharchive_q02/datafusion:parquet | 45037840 | 4.54551e+07 | 0.990821 | ns | |
| gharchive_q02/datafusion:parquet | 45037840 | 4.70777e+07 | 0.95667 | ns | |
| gharchive_q03/datafusion:parquet | 111534668 | 1.07961e+08 | 1.03311 | ns | |
| gharchive_q03/datafusion:parquet | 111534668 | 1.08647e+08 | 1.02658 | ns | |
| gharchive_q04/datafusion:parquet | 80628254 | 8.23376e+07 | 0.97924 | ns | |
| gharchive_q04/datafusion:parquet | 80628254 | 8.24253e+07 | 0.978198 | ns | |
| gharchive_q00/datafusion:vortex-file-compressed | 35094267 | 3.6754e+07 | 0.954843 | ns | |
| gharchive_q00/datafusion:vortex-file-compressed | 35094267 | 3.54843e+07 | 0.98901 | ns | |
| gharchive_q01/datafusion:vortex-file-compressed | 25910286 | 2.51489e+07 | 1.03028 | ns | |
| gharchive_q01/datafusion:vortex-file-compressed | 25910286 | 2.52269e+07 | 1.02709 | ns | |
| gharchive_q02/datafusion:vortex-file-compressed | 26023196 | 2.5096e+07 | 1.03695 | ns | |
| gharchive_q02/datafusion:vortex-file-compressed | 26023196 | 2.56401e+07 | 1.01494 | ns | |
| gharchive_q03/datafusion:vortex-file-compressed | 65854403 | 6.3741e+07 | 1.03316 | ns | |
| gharchive_q03/datafusion:vortex-file-compressed | 65854403 | 6.40018e+07 | 1.02895 | ns | |
| gharchive_q04/datafusion:vortex-file-compressed | 28925047 | 2.64754e+07 | 1.09252 | ns | |
| gharchive_q04/datafusion:vortex-file-compressed | 28925047 | 2.8313e+07 | 1.02162 | ns | |
| gharchive_q00/datafusion:vortex-compact | 48909068 | 4.90722e+07 | 0.996675 | ns | |
| gharchive_q00/datafusion:vortex-compact | 48909068 | 4.85654e+07 | 1.00708 | ns | |
| gharchive_q01/datafusion:vortex-compact | 40688936 | 3.96208e+07 | 1.02696 | ns | |
| gharchive_q01/datafusion:vortex-compact | 40688936 | 3.92012e+07 | 1.03795 | ns | |
| gharchive_q02/datafusion:vortex-compact | 37229881 | 3.81813e+07 | 0.975082 | ns | |
| gharchive_q02/datafusion:vortex-compact | 37229881 | 3.63049e+07 | 1.02548 | ns | |
| gharchive_q03/datafusion:vortex-compact | 78533063 | 7.67403e+07 | 1.02336 | ns | |
| gharchive_q03/datafusion:vortex-compact | 78533063 | 8.05838e+07 | 0.974551 | ns | |
| gharchive_q04/datafusion:vortex-compact | 49297093 | 4.88483e+07 | 1.00919 | ns | |
| gharchive_q04/datafusion:vortex-compact | 49297093 | 4.88077e+07 | 1.01003 | ns | |
| gharchive_q00/duckdb:parquet | 520856504 | 5.39155e+08 | 0.96606 | ns | |
| gharchive_q00/duckdb:parquet | 520856504 | 5.36613e+08 | 0.970638 | ns | |
| gharchive_q01/duckdb:parquet | 114504946 | 1.1625e+08 | 0.984992 | ns | |
| gharchive_q01/duckdb:parquet | 114504946 | 1.1458e+08 | 0.999344 | ns | |
| gharchive_q02/duckdb:parquet | 90621297 | 9.1389e+07 | 0.991599 | ns | |
| gharchive_q02/duckdb:parquet | 90621297 | 9.09266e+07 | 0.996642 | ns | |
| gharchive_q03/duckdb:parquet | 159301409 | 1.64132e+08 | 0.970568 | ns | |
| gharchive_q03/duckdb:parquet | 159301409 | 1.61e+08 | 0.989451 | ns | |
| gharchive_q04/duckdb:parquet | 133160054 | 1.35931e+08 | 0.979615 | ns | |
| gharchive_q04/duckdb:parquet | 133160054 | 1.30677e+08 | 1.019 | ns | |
| gharchive_q00/duckdb:vortex-file-compressed | 54504698 | 5.50513e+07 | 0.990071 | ns | |
| gharchive_q00/duckdb:vortex-file-compressed | 54504698 | 5.31356e+07 | 1.02577 | ns | |
| gharchive_q01/duckdb:vortex-file-compressed | 36583739 | 3.56617e+07 | 1.02585 | ns | |
| gharchive_q01/duckdb:vortex-file-compressed | 36583739 | 3.54243e+07 | 1.03273 | ns | |
| gharchive_q02/duckdb:vortex-file-compressed | 32592188 | 3.41903e+07 | 0.953259 | ns | |
| gharchive_q02/duckdb:vortex-file-compressed | 32592188 | 3.31067e+07 | 0.98446 | ns | |
| gharchive_q03/duckdb:vortex-file-compressed | 130115813 | 1.28625e+08 | 1.01159 | ns | |
| gharchive_q03/duckdb:vortex-file-compressed | 130115813 | 1.29521e+08 | 1.0046 | ns | |
| gharchive_q04/duckdb:vortex-file-compressed | 34826021 | 3.38076e+07 | 1.03012 | ns | |
| gharchive_q04/duckdb:vortex-file-compressed | 34826021 | 3.28754e+07 | 1.05933 | ns | |
| gharchive_q00/duckdb:vortex-compact | 72173237 | 6.82794e+07 | 1.05703 | ns | |
| gharchive_q00/duckdb:vortex-compact | 72173237 | 7.18049e+07 | 1.00513 | ns | |
| gharchive_q01/duckdb:vortex-compact | 48320249 | 4.79269e+07 | 1.00821 | ns | |
| gharchive_q01/duckdb:vortex-compact | 48320249 | 4.86815e+07 | 0.99258 | ns | |
| gharchive_q02/duckdb:vortex-compact | 41308444 | 4.08568e+07 | 1.01105 | ns | |
| gharchive_q02/duckdb:vortex-compact | 41308444 | 4.13393e+07 | 0.999254 | ns | |
| gharchive_q03/duckdb:vortex-compact | 149586892 | 1.5104e+08 | 0.990377 | ns | |
| gharchive_q03/duckdb:vortex-compact | 149586892 | 1.50946e+08 | 0.990994 | ns | |
| gharchive_q04/duckdb:vortex-compact | 52026765 | 5.08555e+07 | 1.02303 | ns | |
| gharchive_q04/duckdb:vortex-compact | 52026765 | 5.10964e+07 | 1.01821 | ns |
Benchmarks: GitHub Archive (S3)
Summary
- Overall: 1.015x ➖
- Vortex: 1.014x ➖
- duckdb:vortex: 1.003x ➖
- datafusion:vortex: 1.025x ➖
- Best: gharchive_q01/duckdb:vortex-file-compressed (0.948x)
- Worst: gharchive_q02/datafusion:vortex-file-compressed (1.091x)
- Significant (>30%): 0↑ 0↓
Detailed Results Table
| name | PR d45a27d4 | base 7541a3b3 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| gharchive_q00/datafusion:parquet | 3148875447 | 3.18848e+09 | 0.987579 | ns | |
| gharchive_q00/datafusion:parquet | 3148875447 | 3.19475e+09 | 0.985641 | ns | |
| gharchive_q01/datafusion:parquet | 66160593 | 6.44436e+07 | 1.02664 | ns | |
| gharchive_q01/datafusion:parquet | 66160593 | 6.55471e+07 | 1.00936 | ns | |
| gharchive_q02/datafusion:parquet | 46880872 | 4.54551e+07 | 1.03137 | ns | |
| gharchive_q02/datafusion:parquet | 46880872 | 4.70777e+07 | 0.995819 | ns | |
| gharchive_q03/datafusion:parquet | 115972972 | 1.07961e+08 | 1.07422 | ns | |
| gharchive_q03/datafusion:parquet | 115972972 | 1.08647e+08 | 1.06743 | ns | |
| gharchive_q04/datafusion:parquet | 82846963 | 8.23376e+07 | 1.00619 | ns | |
| gharchive_q04/datafusion:parquet | 82846963 | 8.24253e+07 | 1.00512 | ns | |
| gharchive_q00/datafusion:vortex-file-compressed | 36909602 | 3.6754e+07 | 1.00423 | ns | |
| gharchive_q00/datafusion:vortex-file-compressed | 36909602 | 3.54843e+07 | 1.04017 | ns | |
| gharchive_q01/datafusion:vortex-file-compressed | 25803712 | 2.51489e+07 | 1.02604 | ns | |
| gharchive_q01/datafusion:vortex-file-compressed | 25803712 | 2.52269e+07 | 1.02287 | ns | |
| gharchive_q02/datafusion:vortex-file-compressed | 27381228 | 2.5096e+07 | 1.09106 | ns | |
| gharchive_q02/datafusion:vortex-file-compressed | 27381228 | 2.56401e+07 | 1.06791 | ns | |
| gharchive_q03/datafusion:vortex-file-compressed | 64296233 | 6.3741e+07 | 1.00871 | ns | |
| gharchive_q03/datafusion:vortex-file-compressed | 64296233 | 6.40018e+07 | 1.0046 | ns | |
| gharchive_q04/datafusion:vortex-file-compressed | 28318166 | 2.64754e+07 | 1.0696 | ns | |
| gharchive_q04/datafusion:vortex-file-compressed | 28318166 | 2.8313e+07 | 1.00018 | ns | |
| gharchive_q00/datafusion:vortex-compact | 49908528 | 4.90722e+07 | 1.01704 | ns | |
| gharchive_q00/datafusion:vortex-compact | 49908528 | 4.85654e+07 | 1.02766 | ns | |
| gharchive_q01/datafusion:vortex-compact | 42303657 | 3.96208e+07 | 1.06771 | ns | |
| gharchive_q01/datafusion:vortex-compact | 42303657 | 3.92012e+07 | 1.07914 | ns | |
| gharchive_q02/datafusion:vortex-compact | 38005746 | 3.81813e+07 | 0.995402 | ns | |
| gharchive_q02/datafusion:vortex-compact | 38005746 | 3.63049e+07 | 1.04685 | ns | |
| gharchive_q03/datafusion:vortex-compact | 78870836 | 7.67403e+07 | 1.02776 | ns | |
| gharchive_q03/datafusion:vortex-compact | 78870836 | 8.05838e+07 | 0.978742 | ns | |
| gharchive_q04/datafusion:vortex-compact | 47109166 | 4.88483e+07 | 0.964396 | ns | |
| gharchive_q04/datafusion:vortex-compact | 47109166 | 4.88077e+07 | 0.9652 | ns | |
| gharchive_q00/duckdb:parquet | 532957586 | 5.39155e+08 | 0.988505 | ns | |
| gharchive_q00/duckdb:parquet | 532957586 | 5.36613e+08 | 0.993189 | ns | |
| gharchive_q01/duckdb:parquet | 116529344 | 1.1625e+08 | 1.00241 | ns | |
| gharchive_q01/duckdb:parquet | 116529344 | 1.1458e+08 | 1.01701 | ns | |
| gharchive_q02/duckdb:parquet | 92572261 | 9.1389e+07 | 1.01295 | ns | |
| gharchive_q02/duckdb:parquet | 92572261 | 9.09266e+07 | 1.0181 | ns | |
| gharchive_q03/duckdb:parquet | 165093839 | 1.64132e+08 | 1.00586 | ns | |
| gharchive_q03/duckdb:parquet | 165093839 | 1.61e+08 | 1.02543 | ns | |
| gharchive_q04/duckdb:parquet | 139505152 | 1.35931e+08 | 1.02629 | ns | |
| gharchive_q04/duckdb:parquet | 139505152 | 1.30677e+08 | 1.06756 | ns | |
| gharchive_q00/duckdb:vortex-file-compressed | 55724704 | 5.50513e+07 | 1.01223 | ns | |
| gharchive_q00/duckdb:vortex-file-compressed | 55724704 | 5.31356e+07 | 1.04873 | ns | |
| gharchive_q01/duckdb:vortex-file-compressed | 33809580 | 3.56617e+07 | 0.948064 | ns | |
| gharchive_q01/duckdb:vortex-file-compressed | 33809580 | 3.54243e+07 | 0.954416 | ns | |
| gharchive_q02/duckdb:vortex-file-compressed | 33878780 | 3.41903e+07 | 0.990889 | ns | |
| gharchive_q02/duckdb:vortex-file-compressed | 33878780 | 3.31067e+07 | 1.02332 | ns | |
| gharchive_q03/duckdb:vortex-file-compressed | 130300854 | 1.28625e+08 | 1.01303 | ns | |
| gharchive_q03/duckdb:vortex-file-compressed | 130300854 | 1.29521e+08 | 1.00602 | ns | |
| gharchive_q04/duckdb:vortex-file-compressed | 34306892 | 3.38076e+07 | 1.01477 | ns | |
| gharchive_q04/duckdb:vortex-file-compressed | 34306892 | 3.28754e+07 | 1.04354 | ns | |
| gharchive_q00/duckdb:vortex-compact | 68168138 | 6.82794e+07 | 0.99837 | ns | |
| gharchive_q00/duckdb:vortex-compact | 68168138 | 7.18049e+07 | 0.949353 | ns | |
| gharchive_q01/duckdb:vortex-compact | 48927751 | 4.79269e+07 | 1.02088 | ns | |
| gharchive_q01/duckdb:vortex-compact | 48927751 | 4.86815e+07 | 1.00506 | ns | |
| gharchive_q02/duckdb:vortex-compact | 41722711 | 4.08568e+07 | 1.02119 | ns | |
| gharchive_q02/duckdb:vortex-compact | 41722711 | 4.13393e+07 | 1.00928 | ns | |
| gharchive_q03/duckdb:vortex-compact | 151321879 | 1.5104e+08 | 1.00186 | ns | |
| gharchive_q03/duckdb:vortex-compact | 151321879 | 1.50946e+08 | 1.00249 | ns | |
| gharchive_q04/duckdb:vortex-compact | 50829815 | 5.08555e+07 | 0.999495 | ns | |
| gharchive_q04/duckdb:vortex-compact | 50829815 | 5.10964e+07 | 0.994782 | ns |
Benchmarks: TPC-H SF=10 on S3
Summary
- Overall: 1.048x ➖
- Vortex: 1.056x ➖
- duckdb:vortex: 0.980x ➖
- datafusion:vortex: 1.139x ➖
- Best: tpch_q22/datafusion:vortex-file-compressed (0.594x)
- Worst: tpch_q09/datafusion:vortex-compact (2.554x)
- Significant (>30%): 1↑ 7↓
Detailed Results Table
| name | PR d45a27d4 | base 7541a3b3 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| tpch_q01/datafusion:parquet | 1312554835 | 1.22064e+09 | 1.0753 | ns | |
| tpch_q02/datafusion:parquet | 667716452 | 6.52187e+08 | 1.02381 | ns | |
| tpch_q03/datafusion:parquet | 990371712 | 9.01943e+08 | 1.09804 | ns | |
| tpch_q04/datafusion:parquet | 584380799 | 5.46216e+08 | 1.06987 | ns | |
| tpch_q05/datafusion:parquet | 1226925841 | 1.03983e+09 | 1.17993 | ns | |
| tpch_q06/datafusion:parquet | 539719306 | 5.26337e+08 | 1.02542 | ns | |
| tpch_q07/datafusion:parquet | 1480124280 | 1.21854e+09 | 1.21467 | ns | |
| tpch_q08/datafusion:parquet | 1440492549 | 1.3291e+09 | 1.08381 | ns | |
| tpch_q09/datafusion:parquet | 1777381249 | 1.59688e+09 | 1.11303 | ns | |
| tpch_q10/datafusion:parquet | 1937365082 | 1.83981e+09 | 1.05303 | ns | |
| tpch_q11/datafusion:parquet | 447840511 | 4.00561e+08 | 1.11803 | ns | |
| tpch_q12/datafusion:parquet | 659159216 | 6.46482e+08 | 1.01961 | ns | |
| tpch_q13/datafusion:parquet | 832236957 | 7.28539e+08 | 1.14234 | ns | |
| tpch_q14/datafusion:parquet | 780253680 | 7.38744e+08 | 1.05619 | ns | |
| tpch_q15/datafusion:parquet | 1289881241 | 1.252e+09 | 1.03025 | ns | |
| tpch_q16/datafusion:parquet | 369428037 | 3.33643e+08 | 1.10726 | ns | |
| tpch_q17/datafusion:parquet | 1486818353 | 1.27554e+09 | 1.16564 | ns | |
| tpch_q18/datafusion:parquet | 1833804506 | 1.63118e+09 | 1.12422 | ns | |
| tpch_q19/datafusion:parquet | 891569174 | 9.32706e+08 | 0.955895 | ns | |
| tpch_q20/datafusion:parquet | 1010595313 | 1.01353e+09 | 0.997109 | ns | |
| tpch_q21/datafusion:parquet | 1683423873 | 1.65932e+09 | 1.01453 | ns | |
| tpch_q22/datafusion:parquet | 759112431 | 7.53175e+08 | 1.00788 | ns | |
| tpch_q01/datafusion:vortex-file-compressed | 704648391 | 6.84512e+08 | 1.02942 | ns | |
| tpch_q02/datafusion:vortex-file-compressed | 662651357 | 4.49015e+08 | 1.47579 | ns | 🚨 |
| tpch_q03/datafusion:vortex-file-compressed | 730043386 | 6.76426e+08 | 1.07927 | ns | |
| tpch_q04/datafusion:vortex-file-compressed | 482814725 | 4.8059e+08 | 1.00463 | ns | |
| tpch_q05/datafusion:vortex-file-compressed | 1139110850 | 9.19268e+08 | 1.23915 | ns | |
| tpch_q06/datafusion:vortex-file-compressed | 537100541 | 5.28115e+08 | 1.01701 | ns | |
| tpch_q07/datafusion:vortex-file-compressed | 1065371277 | 9.22214e+08 | 1.15523 | ns | |
| tpch_q08/datafusion:vortex-file-compressed | 1507877054 | 1.18158e+09 | 1.27616 | ns | |
| tpch_q09/datafusion:vortex-file-compressed | 2093620390 | 1.51439e+09 | 1.38248 | ns | 🚨 |
| tpch_q10/datafusion:vortex-file-compressed | 990507337 | 8.1382e+08 | 1.21711 | ns | |
| tpch_q11/datafusion:vortex-file-compressed | 407563684 | 4.06696e+08 | 1.00213 | ns | |
| tpch_q12/datafusion:vortex-file-compressed | 738154700 | 7.49126e+08 | 0.985354 | ns | |
| tpch_q13/datafusion:vortex-file-compressed | 424204058 | 4.19236e+08 | 1.01185 | ns | |
| tpch_q14/datafusion:vortex-file-compressed | 463748506 | 4.39906e+08 | 1.0542 | ns | |
| tpch_q15/datafusion:vortex-file-compressed | 860162797 | 8.2685e+08 | 1.04029 | ns | |
| tpch_q16/datafusion:vortex-file-compressed | 283817419 | 3.2118e+08 | 0.883672 | ns | |
| tpch_q17/datafusion:vortex-file-compressed | 1333157003 | 1.34556e+09 | 0.990783 | ns | |
| tpch_q18/datafusion:vortex-file-compressed | 1436020238 | 1.44165e+09 | 0.996096 | ns | |
| tpch_q19/datafusion:vortex-file-compressed | 638625127 | 6.35035e+08 | 1.00565 | ns | |
| tpch_q20/datafusion:vortex-file-compressed | 692750459 | 7.23086e+08 | 0.958047 | ns | |
| tpch_q21/datafusion:vortex-file-compressed | 1794050906 | 1.53858e+09 | 1.16604 | ns | |
| tpch_q22/datafusion:vortex-file-compressed | 312732814 | 5.26176e+08 | 0.594351 | ns | 🚀 |
| tpch_q01/datafusion:vortex-compact | 730048122 | 7.06433e+08 | 1.03343 | ns | |
| tpch_q02/datafusion:vortex-compact | 766263008 | 4.81983e+08 | 1.58981 | ns | 🚨 |
| tpch_q03/datafusion:vortex-compact | 774040105 | 6.27426e+08 | 1.23368 | ns | |
| tpch_q04/datafusion:vortex-compact | 453406854 | 4.36146e+08 | 1.03958 | ns | |
| tpch_q05/datafusion:vortex-compact | 997241962 | 8.82509e+08 | 1.13001 | ns | |
| tpch_q06/datafusion:vortex-compact | 496075840 | 4.56285e+08 | 1.08721 | ns | |
| tpch_q07/datafusion:vortex-compact | 1999433058 | 8.67081e+08 | 2.30594 | ns | 🚨 |
| tpch_q08/datafusion:vortex-compact | 2436758390 | 1.13318e+09 | 2.15037 | ns | 🚨 |
| tpch_q09/datafusion:vortex-compact | 3586900472 | 1.40433e+09 | 2.55417 | ns | 🚨 |
| tpch_q10/datafusion:vortex-compact | 1009852795 | 7.76915e+08 | 1.29982 | ns | |
| tpch_q11/datafusion:vortex-compact | 434195019 | 3.9159e+08 | 1.1088 | ns | |
| tpch_q12/datafusion:vortex-compact | 621982844 | 6.65317e+08 | 0.934868 | ns | |
| tpch_q13/datafusion:vortex-compact | 405280611 | 3.9555e+08 | 1.0246 | ns | |
| tpch_q14/datafusion:vortex-compact | 464463610 | 4.86455e+08 | 0.954793 | ns | |
| tpch_q15/datafusion:vortex-compact | 792123334 | 8.23928e+08 | 0.961399 | ns | |
| tpch_q16/datafusion:vortex-compact | 275930413 | 2.57716e+08 | 1.07068 | ns | |
| tpch_q17/datafusion:vortex-compact | 1440042028 | 1.33727e+09 | 1.07685 | ns | |
| tpch_q18/datafusion:vortex-compact | 1363160230 | 1.29214e+09 | 1.05497 | ns | |
| tpch_q19/datafusion:vortex-compact | 606587534 | 6.32412e+08 | 0.959164 | ns | |
| tpch_q20/datafusion:vortex-compact | 657532628 | 6.30108e+08 | 1.04352 | ns | |
| tpch_q21/datafusion:vortex-compact | 2477405344 | 1.38644e+09 | 1.78689 | ns | 🚨 |
| tpch_q22/datafusion:vortex-compact | 334916237 | 3.20701e+08 | 1.04432 | ns | |
| tpch_q01/duckdb:parquet | 905387164 | 8.69736e+08 | 1.04099 | ns | |
| tpch_q02/duckdb:parquet | 1250001820 | 1.227e+09 | 1.01875 | ns | |
| tpch_q03/duckdb:parquet | 1360164111 | 1.51072e+09 | 0.900344 | ns | |
| tpch_q04/duckdb:parquet | 835478731 | 8.72769e+08 | 0.957273 | ns | |
| tpch_q05/duckdb:parquet | 1659441465 | 1.71521e+09 | 0.967485 | ns | |
| tpch_q06/duckdb:parquet | 592576753 | 5.57188e+08 | 1.06351 | ns | |
| tpch_q07/duckdb:parquet | 1376394667 | 1.44467e+09 | 0.952743 | ns | |
| tpch_q08/duckdb:parquet | 1924336944 | 2.03131e+09 | 0.947337 | ns | |
| tpch_q09/duckdb:parquet | 1986538164 | 1.89987e+09 | 1.04562 | ns | |
| tpch_q10/duckdb:parquet | 2580528158 | 2.73044e+09 | 0.945096 | ns | |
| tpch_q11/duckdb:parquet | 723314873 | 7.07656e+08 | 1.02213 | ns | |
| tpch_q12/duckdb:parquet | 809936457 | 8.73128e+08 | 0.927626 | ns | |
| tpch_q13/duckdb:parquet | 1020152261 | 1.09899e+09 | 0.928266 | ns | |
| tpch_q14/duckdb:parquet | 1081335782 | 1.09024e+09 | 0.991836 | ns | |
| tpch_q15/duckdb:parquet | 887148187 | 8.625e+08 | 1.02858 | ns | |
| tpch_q16/duckdb:parquet | 614248036 | 6.42275e+08 | 0.956363 | ns | |
| tpch_q17/duckdb:parquet | 1109284005 | 1.07139e+09 | 1.03537 | ns | |
| tpch_q18/duckdb:parquet | 1045829245 | 1.08427e+09 | 0.964549 | ns | |
| tpch_q19/duckdb:parquet | 1279997201 | 1.27738e+09 | 1.00205 | ns | |
| tpch_q20/duckdb:parquet | 1420540090 | 1.35324e+09 | 1.04973 | ns | |
| tpch_q21/duckdb:parquet | 1505186879 | 1.49044e+09 | 1.0099 | ns | |
| tpch_q22/duckdb:parquet | 859969732 | 8.20006e+08 | 1.04874 | ns | |
| tpch_q01/duckdb:vortex-file-compressed | 702290996 | 7.63214e+08 | 0.920175 | ns | |
| tpch_q02/duckdb:vortex-file-compressed | 1023624985 | 1.00552e+09 | 1.018 | ns | |
| tpch_q03/duckdb:vortex-file-compressed | 1149677189 | 1.15907e+09 | 0.991893 | ns | |
| tpch_q04/duckdb:vortex-file-compressed | 667051513 | 6.80271e+08 | 0.980568 | ns | |
| tpch_q05/duckdb:vortex-file-compressed | 1141114437 | 1.15592e+09 | 0.98719 | ns | |
| tpch_q06/duckdb:vortex-file-compressed | 806989827 | 8.578e+08 | 0.940767 | ns | |
| tpch_q07/duckdb:vortex-file-compressed | 1161581853 | 1.18484e+09 | 0.98037 | ns | |
| tpch_q08/duckdb:vortex-file-compressed | 1554114945 | 1.55731e+09 | 0.997949 | ns | |
| tpch_q09/duckdb:vortex-file-compressed | 1610021464 | 1.62689e+09 | 0.989631 | ns | |
| tpch_q10/duckdb:vortex-file-compressed | 1288971040 | 1.30315e+09 | 0.989118 | ns | |
| tpch_q11/duckdb:vortex-file-compressed | 826950142 | 7.58066e+08 | 1.09087 | ns | |
| tpch_q12/duckdb:vortex-file-compressed | 800656167 | 7.65967e+08 | 1.04529 | ns | |
| tpch_q13/duckdb:vortex-file-compressed | 1042286532 | 1.09508e+09 | 0.951792 | ns | |
| tpch_q14/duckdb:vortex-file-compressed | 808991347 | 8.58186e+08 | 0.942676 | ns | |
| tpch_q15/duckdb:vortex-file-compressed | 628222240 | 6.64933e+08 | 0.94479 | ns | |
| tpch_q16/duckdb:vortex-file-compressed | 561953854 | 5.60883e+08 | 1.00191 | ns | |
| tpch_q17/duckdb:vortex-file-compressed | 1128475468 | 1.12956e+09 | 0.999036 | ns | |
| tpch_q18/duckdb:vortex-file-compressed | 1133838805 | 1.15685e+09 | 0.980111 | ns | |
| tpch_q19/duckdb:vortex-file-compressed | 830366816 | 8.46921e+08 | 0.980454 | ns | |
| tpch_q20/duckdb:vortex-file-compressed | 1199350420 | 1.22061e+09 | 0.982584 | ns | |
| tpch_q21/duckdb:vortex-file-compressed | 1925755236 | 2.00669e+09 | 0.959667 | ns | |
| tpch_q22/duckdb:vortex-file-compressed | 491888228 | 4.93977e+08 | 0.995771 | ns | |
| tpch_q01/duckdb:vortex-compact | 710824852 | 7.15991e+08 | 0.992785 | ns | |
| tpch_q02/duckdb:vortex-compact | 851725754 | 8.5588e+08 | 0.995147 | ns | |
| tpch_q03/duckdb:vortex-compact | 958842407 | 1.01147e+09 | 0.947966 | ns | |
| tpch_q04/duckdb:vortex-compact | 571906980 | 5.67083e+08 | 1.00851 | ns | |
| tpch_q05/duckdb:vortex-compact | 1013526577 | 1.06802e+09 | 0.948981 | ns | |
| tpch_q06/duckdb:vortex-compact | 694684964 | 7.32908e+08 | 0.947848 | ns | |
| tpch_q07/duckdb:vortex-compact | 1075972899 | 1.07165e+09 | 1.00404 | ns | |
| tpch_q08/duckdb:vortex-compact | 1410451724 | 1.4514e+09 | 0.971787 | ns | |
| tpch_q09/duckdb:vortex-compact | 1379088054 | 1.44495e+09 | 0.954421 | ns | |
| tpch_q10/duckdb:vortex-compact | 1183757215 | 1.36232e+09 | 0.868927 | ns | |
| tpch_q11/duckdb:vortex-compact | 621838761 | 6.27118e+08 | 0.991581 | ns | |
| tpch_q12/duckdb:vortex-compact | 735953790 | 7.52358e+08 | 0.978196 | ns | |
| tpch_q13/duckdb:vortex-compact | 737440411 | 7.23389e+08 | 1.01943 | ns | |
| tpch_q14/duckdb:vortex-compact | 779160659 | 7.74569e+08 | 1.00593 | ns | |
| tpch_q15/duckdb:vortex-compact | 600215347 | 6.17683e+08 | 0.971721 | ns | |
| tpch_q16/duckdb:vortex-compact | 448697515 | 4.65765e+08 | 0.963355 | ns | |
| tpch_q17/duckdb:vortex-compact | 1062788625 | 1.03028e+09 | 1.03156 | ns | |
| tpch_q18/duckdb:vortex-compact | 878884867 | 8.71475e+08 | 1.0085 | ns | |
| tpch_q19/duckdb:vortex-compact | 774564282 | 8.24421e+08 | 0.939525 | ns | |
| tpch_q20/duckdb:vortex-compact | 1081084351 | 1.09991e+09 | 0.982888 | ns | |
| tpch_q21/duckdb:vortex-compact | 1628417869 | 1.75547e+09 | 0.927625 | ns | |
| tpch_q22/duckdb:vortex-compact | 486829449 | 4.84754e+08 | 1.00428 | ns |
Benchmarks: Clickbench on NVME
Summary
- Overall: 1.045x ➖
- Vortex: 1.041x ➖
- duckdb:vortex: 0.990x ➖
- datafusion:vortex: 1.093x ➖
- Best: clickbench_q23/duckdb:vortex-compact (0.642x)
- Worst: clickbench_q00/datafusion:vortex-compact (1.855x)
- Significant (>10%): 7↑ 24↓
Detailed Results Table
| name | PR d45a27d4 | base 7541a3b3 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| clickbench_q00/datafusion:parquet | 3313511 | 1.68437e+06 | 1.96721 | ns | 🚨 |
| clickbench_q01/datafusion:parquet | 30091622 | 2.68668e+07 | 1.12003 | ns | |
| clickbench_q02/datafusion:parquet | 66745556 | 6.40248e+07 | 1.0425 | ns | |
| clickbench_q03/datafusion:parquet | 61388205 | 5.31806e+07 | 1.15433 | ns | |
| clickbench_q04/datafusion:parquet | 397923720 | 3.57402e+08 | 1.11338 | ns | |
| clickbench_q05/datafusion:parquet | 394627621 | 3.66607e+08 | 1.07643 | ns | |
| clickbench_q06/datafusion:parquet | 3457766 | 1.74044e+06 | 1.98672 | ns | 🚨 |
| clickbench_q07/datafusion:parquet | 38525677 | 3.03454e+07 | 1.26957 | ns | |
| clickbench_q08/datafusion:parquet | 493582083 | 4.63305e+08 | 1.06535 | ns | |
| clickbench_q09/datafusion:parquet | 748629183 | 6.91173e+08 | 1.08313 | ns | |
| clickbench_q10/datafusion:parquet | 144322348 | 1.32818e+08 | 1.08661 | ns | |
| clickbench_q11/datafusion:parquet | 173433133 | 1.58674e+08 | 1.09301 | ns | |
| clickbench_q12/datafusion:parquet | 414354579 | 3.81186e+08 | 1.08701 | ns | |
| clickbench_q13/datafusion:parquet | 624276200 | 5.42889e+08 | 1.14991 | ns | |
| clickbench_q14/datafusion:parquet | 413492081 | 3.70109e+08 | 1.11722 | ns | |
| clickbench_q15/datafusion:parquet | 485131126 | 4.17375e+08 | 1.16234 | ns | |
| clickbench_q16/datafusion:parquet | 884229984 | 7.70068e+08 | 1.14825 | ns | |
| clickbench_q17/datafusion:parquet | 878754683 | 7.50196e+08 | 1.17137 | ns | |
| clickbench_q18/datafusion:parquet | 1662875811 | 1.43751e+09 | 1.15678 | ns | |
| clickbench_q19/datafusion:parquet | 47849559 | 4.17354e+07 | 1.1465 | ns | |
| clickbench_q20/datafusion:parquet | 725551814 | 6.42584e+08 | 1.12912 | ns | |
| clickbench_q21/datafusion:parquet | 829958109 | 7.13894e+08 | 1.16258 | ns | |
| clickbench_q22/datafusion:parquet | 1206943179 | 1.06937e+09 | 1.12865 | ns | |
| clickbench_q23/datafusion:parquet | 4758107064 | 4.21549e+09 | 1.12872 | ns | |
| clickbench_q24/datafusion:parquet | 120763072 | 1.06613e+08 | 1.13272 | ns | |
| clickbench_q25/datafusion:parquet | 170072871 | 1.54675e+08 | 1.09955 | ns | |
| clickbench_q26/datafusion:parquet | 118852734 | 1.12171e+08 | 1.05957 | ns | |
| clickbench_q27/datafusion:parquet | 1111654139 | 1.0405e+09 | 1.06838 | ns | |
| clickbench_q28/datafusion:parquet | 5989476315 | 5.80431e+09 | 1.0319 | ns | |
| clickbench_q29/datafusion:parquet | 257860491 | 2.54492e+08 | 1.01324 | ns | |
| clickbench_q30/datafusion:parquet | 399654927 | 3.69752e+08 | 1.08087 | ns | |
| clickbench_q31/datafusion:parquet | 448402691 | 4.06499e+08 | 1.10309 | ns | |
| clickbench_q32/datafusion:parquet | 1448206145 | 1.24761e+09 | 1.16079 | ns | |
| clickbench_q33/datafusion:parquet | 1759388506 | 1.58264e+09 | 1.11168 | ns | |
| clickbench_q34/datafusion:parquet | 1737510273 | 1.5716e+09 | 1.10557 | ns | |
| clickbench_q35/datafusion:parquet | 647937497 | 5.86851e+08 | 1.10409 | ns | |
| clickbench_q36/datafusion:parquet | 178107630 | 1.65969e+08 | 1.07314 | ns | |
| clickbench_q37/datafusion:parquet | 71819431 | 6.4237e+07 | 1.11804 | ns | |
| clickbench_q38/datafusion:parquet | 100429920 | 9.5784e+07 | 1.0485 | ns | |
| clickbench_q39/datafusion:parquet | 322053957 | 3.09357e+08 | 1.04104 | ns | |
| clickbench_q40/datafusion:parquet | 42089547 | 3.88789e+07 | 1.08258 | ns | |
| clickbench_q41/datafusion:parquet | 38562074 | 3.33664e+07 | 1.15572 | ns | |
| clickbench_q42/datafusion:parquet | 39808040 | 3.60351e+07 | 1.1047 | ns | |
| clickbench_q00/datafusion:vortex-file-compressed | 3491618 | 1.9271e+06 | 1.81185 | ns | 🚨 |
| clickbench_q01/datafusion:vortex-file-compressed | 15290576 | 1.25243e+07 | 1.22087 | ns | |
| clickbench_q02/datafusion:vortex-file-compressed | 32227860 | 2.9636e+07 | 1.08746 | ns | |
| clickbench_q03/datafusion:vortex-file-compressed | 34861450 | 3.13894e+07 | 1.11061 | ns | |
| clickbench_q04/datafusion:vortex-file-compressed | 322117418 | 3.11394e+08 | 1.03444 | ns | |
| clickbench_q05/datafusion:vortex-file-compressed | 332876891 | 3.18514e+08 | 1.04509 | ns | |
| clickbench_q06/datafusion:vortex-file-compressed | 3304779 | 1.89748e+06 | 1.74167 | ns | 🚨 |
| clickbench_q07/datafusion:vortex-file-compressed | 19923153 | 1.58823e+07 | 1.25442 | ns | |
| clickbench_q08/datafusion:vortex-file-compressed | 393846798 | 3.80307e+08 | 1.0356 | ns | |
| clickbench_q09/datafusion:vortex-file-compressed | 571351021 | 5.53184e+08 | 1.03284 | ns | |
| clickbench_q10/datafusion:vortex-file-compressed | 74449125 | 6.8321e+07 | 1.0897 | ns | |
| clickbench_q11/datafusion:vortex-file-compressed | 91293068 | 8.33614e+07 | 1.09515 | ns | |
| clickbench_q12/datafusion:vortex-file-compressed | 279802501 | 2.76811e+08 | 1.01081 | ns | |
| clickbench_q13/datafusion:vortex-file-compressed | 453160866 | 4.20246e+08 | 1.07832 | ns | |
| clickbench_q14/datafusion:vortex-file-compressed | 263564213 | 2.47653e+08 | 1.06425 | ns | |
| clickbench_q15/datafusion:vortex-file-compressed | 383684416 | 3.63495e+08 | 1.05554 | ns | |
| clickbench_q16/datafusion:vortex-file-compressed | 766383262 | 7.30875e+08 | 1.04858 | ns | |
| clickbench_q17/datafusion:vortex-file-compressed | 755664413 | 7.20681e+08 | 1.04854 | ns | |
| clickbench_q18/datafusion:vortex-file-compressed | 1443048979 | 1.38663e+09 | 1.04069 | ns | |
| clickbench_q19/datafusion:vortex-file-compressed | 25395656 | 2.07725e+07 | 1.22256 | ns | |
| clickbench_q20/datafusion:vortex-file-compressed | 332475833 | 3.18028e+08 | 1.04543 | ns | |
| clickbench_q21/datafusion:vortex-file-compressed | 394128054 | 3.72102e+08 | 1.05919 | ns | |
| clickbench_q22/datafusion:vortex-file-compressed | 556112664 | 5.30506e+08 | 1.04827 | ns | |
| clickbench_q23/datafusion:vortex-file-compressed | 1230899070 | 1.54281e+09 | 0.797831 | ns | |
| clickbench_q24/datafusion:vortex-file-compressed | 62422531 | 6.67702e+07 | 0.934887 | ns | |
| clickbench_q25/datafusion:vortex-file-compressed | 68729514 | 6.07343e+07 | 1.13164 | ns | |
| clickbench_q26/datafusion:vortex-file-compressed | 76785653 | 6.13425e+07 | 1.25175 | ns | |
| clickbench_q27/datafusion:vortex-file-compressed | 825337561 | 7.80431e+08 | 1.05754 | ns | |
| clickbench_q28/datafusion:vortex-file-compressed | 6860924999 | 6.81102e+09 | 1.00733 | ns | |
| clickbench_q29/datafusion:vortex-file-compressed | 257457221 | 2.50619e+08 | 1.02729 | ns | |
| clickbench_q30/datafusion:vortex-file-compressed | 283282810 | 2.74897e+08 | 1.03051 | ns | |
| clickbench_q31/datafusion:vortex-file-compressed | 319740428 | 3.07399e+08 | 1.04015 | ns | |
| clickbench_q32/datafusion:vortex-file-compressed | 1397053934 | 1.30046e+09 | 1.07427 | ns | |
| clickbench_q33/datafusion:vortex-file-compressed | 1476278855 | 1.40496e+09 | 1.05077 | ns | |
| clickbench_q34/datafusion:vortex-file-compressed | 1451610938 | 1.40485e+09 | 1.03328 | ns | |
| clickbench_q35/datafusion:vortex-file-compressed | 570288597 | 5.48125e+08 | 1.04044 | ns | |
| clickbench_q36/datafusion:vortex-file-compressed | 86446049 | 8.1239e+07 | 1.0641 | ns | |
| clickbench_q37/datafusion:vortex-file-compressed | 42162670 | 4.00243e+07 | 1.05343 | ns | |
| clickbench_q38/datafusion:vortex-file-compressed | 24238955 | 2.09793e+07 | 1.15538 | ns | |
| clickbench_q39/datafusion:vortex-file-compressed | 175186535 | 1.67061e+08 | 1.04864 | ns | |
| clickbench_q40/datafusion:vortex-file-compressed | 24547939 | 1.99652e+07 | 1.22954 | ns | |
| clickbench_q41/datafusion:vortex-file-compressed | 21297822 | 1.77519e+07 | 1.19975 | ns | |
| clickbench_q42/datafusion:vortex-file-compressed | 25807652 | 2.18803e+07 | 1.17949 | ns | |
| clickbench_q00/datafusion:vortex-compact | 3472277 | 1.8719e+06 | 1.85495 | ns | 🚨 |
| clickbench_q01/datafusion:vortex-compact | 15840471 | 1.17088e+07 | 1.35287 | ns | 🚨 |
| clickbench_q02/datafusion:vortex-compact | 33743456 | 3.05199e+07 | 1.10562 | ns | |
| clickbench_q03/datafusion:vortex-compact | 36407644 | 3.31856e+07 | 1.09709 | ns | |
| clickbench_q04/datafusion:vortex-compact | 328443599 | 3.2274e+08 | 1.01767 | ns | |
| clickbench_q05/datafusion:vortex-compact | 342407761 | 3.33661e+08 | 1.02622 | ns | |
| clickbench_q06/datafusion:vortex-compact | 3479937 | 2.03947e+06 | 1.70629 | ns | 🚨 |
| clickbench_q07/datafusion:vortex-compact | 21121292 | 1.66748e+07 | 1.26666 | ns | |
| clickbench_q08/datafusion:vortex-compact | 399849951 | 4.0223e+08 | 0.994082 | ns | |
| clickbench_q09/datafusion:vortex-compact | 613198778 | 5.89407e+08 | 1.04036 | ns | |
| clickbench_q10/datafusion:vortex-compact | 79947687 | 7.12552e+07 | 1.12199 | ns | |
| clickbench_q11/datafusion:vortex-compact | 94663749 | 8.52248e+07 | 1.11075 | ns | |
| clickbench_q12/datafusion:vortex-compact | 285552375 | 2.77095e+08 | 1.03052 | ns | |
| clickbench_q13/datafusion:vortex-compact | 450425886 | 4.26973e+08 | 1.05493 | ns | |
| clickbench_q14/datafusion:vortex-compact | 275462912 | 2.5646e+08 | 1.0741 | ns | |
| clickbench_q15/datafusion:vortex-compact | 386649821 | 3.82219e+08 | 1.01159 | ns | |
| clickbench_q16/datafusion:vortex-compact | 768304951 | 7.47442e+08 | 1.02791 | ns | |
| clickbench_q17/datafusion:vortex-compact | 770155720 | 7.35274e+08 | 1.04744 | ns | |
| clickbench_q18/datafusion:vortex-compact | 1432097210 | 1.40583e+09 | 1.01868 | ns | |
| clickbench_q19/datafusion:vortex-compact | 24517052 | 2.23726e+07 | 1.09585 | ns | |
| clickbench_q20/datafusion:vortex-compact | 339094323 | 3.32123e+08 | 1.02099 | ns | |
| clickbench_q21/datafusion:vortex-compact | 397494330 | 3.88432e+08 | 1.02333 | ns | |
| clickbench_q22/datafusion:vortex-compact | 577473782 | 5.56202e+08 | 1.03825 | ns | |
| clickbench_q23/datafusion:vortex-compact | 1317591427 | 1.49411e+09 | 0.88186 | ns | |
| clickbench_q24/datafusion:vortex-compact | 62706843 | 6.49808e+07 | 0.965006 | ns | |
| clickbench_q25/datafusion:vortex-compact | 66415441 | 6.71322e+07 | 0.989323 | ns | |
| clickbench_q26/datafusion:vortex-compact | 77178731 | 6.31183e+07 | 1.22276 | ns | |
| clickbench_q27/datafusion:vortex-compact | 790524535 | 7.97687e+08 | 0.991021 | ns | |
| clickbench_q28/datafusion:vortex-compact | 6878021284 | 6.74498e+09 | 1.01972 | ns | |
| clickbench_q29/datafusion:vortex-compact | 259565784 | 2.6554e+08 | 0.977501 | ns | |
| clickbench_q30/datafusion:vortex-compact | 294627705 | 2.77828e+08 | 1.06047 | ns | |
| clickbench_q31/datafusion:vortex-compact | 328142827 | 3.08124e+08 | 1.06497 | ns | |
| clickbench_q32/datafusion:vortex-compact | 1266247691 | 1.34372e+09 | 0.942344 | ns | |
| clickbench_q33/datafusion:vortex-compact | 1444322487 | 1.39864e+09 | 1.03266 | ns | |
| clickbench_q34/datafusion:vortex-compact | 1466470032 | 1.39752e+09 | 1.04934 | ns | |
| clickbench_q35/datafusion:vortex-compact | 565166878 | 5.4471e+08 | 1.03756 | ns | |
| clickbench_q36/datafusion:vortex-compact | 92098151 | 8.45612e+07 | 1.08913 | ns | |
| clickbench_q37/datafusion:vortex-compact | 42377573 | 3.85965e+07 | 1.09796 | ns | |
| clickbench_q38/datafusion:vortex-compact | 25421273 | 2.14023e+07 | 1.18778 | ns | |
| clickbench_q39/datafusion:vortex-compact | 177385620 | 1.76264e+08 | 1.00636 | ns | |
| clickbench_q40/datafusion:vortex-compact | 23505061 | 2.0694e+07 | 1.13584 | ns | |
| clickbench_q41/datafusion:vortex-compact | 21961157 | 1.8298e+07 | 1.20019 | ns | |
| clickbench_q42/datafusion:vortex-compact | 26276492 | 2.25125e+07 | 1.1672 | ns | |
| clickbench_q00/duckdb:parquet | 123241314 | 1.23044e+08 | 1.00161 | ns | |
| clickbench_q01/duckdb:parquet | 51158031 | 5.06141e+07 | 1.01075 | ns | |
| clickbench_q02/duckdb:parquet | 63631928 | 6.39244e+07 | 0.995425 | ns | |
| clickbench_q03/duckdb:parquet | 61395428 | 6.16856e+07 | 0.995297 | ns | |
| clickbench_q04/duckdb:parquet | 201406128 | 1.98521e+08 | 1.01453 | ns | |
| clickbench_q05/duckdb:parquet | 271463751 | 2.67236e+08 | 1.01582 | ns | |
| clickbench_q06/duckdb:parquet | 61188764 | 6.10594e+07 | 1.00212 | ns | |
| clickbench_q07/duckdb:parquet | 55421822 | 5.57976e+07 | 0.993265 | ns | |
| clickbench_q08/duckdb:parquet | 267791964 | 2.62991e+08 | 1.01825 | ns | |
| clickbench_q09/duckdb:parquet | 390788736 | 3.8858e+08 | 1.00568 | ns | |
| clickbench_q10/duckdb:parquet | 94738322 | 9.33533e+07 | 1.01484 | ns | |
| clickbench_q11/duckdb:parquet | 106746834 | 1.07261e+08 | 0.995207 | ns | |
| clickbench_q12/duckdb:parquet | 289669803 | 2.83648e+08 | 1.02123 | ns | |
| clickbench_q13/duckdb:parquet | 479472851 | 4.66565e+08 | 1.02767 | ns | |
| clickbench_q14/duckdb:parquet | 323200298 | 3.17133e+08 | 1.01913 | ns | |
| clickbench_q15/duckdb:parquet | 239522822 | 2.35742e+08 | 1.01604 | ns | |
| clickbench_q16/duckdb:parquet | 569974919 | 5.62598e+08 | 1.01311 | ns | |
| clickbench_q17/duckdb:parquet | 476249061 | 4.72933e+08 | 1.00701 | ns | |
| clickbench_q18/duckdb:parquet | 988167866 | 9.8715e+08 | 1.00103 | ns | |
| clickbench_q19/duckdb:parquet | 47612718 | 5.11336e+07 | 0.931144 | ns | |
| clickbench_q20/duckdb:parquet | 404377314 | 4.08695e+08 | 0.989435 | ns | |
| clickbench_q21/duckdb:parquet | 528909032 | 5.25297e+08 | 1.00688 | ns | |
| clickbench_q22/duckdb:parquet | 919065977 | 9.06157e+08 | 1.01425 | ns | |
| clickbench_q23/duckdb:parquet | 279641215 | 2.71845e+08 | 1.02868 | ns | |
| clickbench_q24/duckdb:parquet | 80262716 | 7.76448e+07 | 1.03372 | ns | |
| clickbench_q25/duckdb:parquet | 138218734 | 1.38847e+08 | 0.995477 | ns | |
| clickbench_q26/duckdb:parquet | 53699618 | 5.27825e+07 | 1.01738 | ns | |
| clickbench_q27/duckdb:parquet | 616941163 | 6.09931e+08 | 1.01149 | ns | |
| clickbench_q28/duckdb:parquet | 4869701416 | 4.88691e+09 | 0.996479 | ns | |
| clickbench_q29/duckdb:parquet | 61520410 | 6.23705e+07 | 0.98637 | ns | |
| clickbench_q30/duckdb:parquet | 308592640 | 3.02963e+08 | 1.01858 | ns | |
| clickbench_q31/duckdb:parquet | 348326682 | 3.42796e+08 | 1.01613 | ns | |
| clickbench_q32/duckdb:parquet | 1059634066 | 1.03578e+09 | 1.02303 | ns | |
| clickbench_q33/duckdb:parquet | 1051593375 | 1.04398e+09 | 1.00729 | ns | |
| clickbench_q34/duckdb:parquet | 1097879749 | 1.09411e+09 | 1.00345 | ns | |
| clickbench_q35/duckdb:parquet | 348682879 | 3.45224e+08 | 1.01002 | ns | |
| clickbench_q36/duckdb:parquet | 61712171 | 6.13182e+07 | 1.00642 | ns | |
| clickbench_q37/duckdb:parquet | 49073500 | 5.07256e+07 | 0.96743 | ns | |
| clickbench_q38/duckdb:parquet | 52342513 | 5.15155e+07 | 1.01605 | ns | |
| clickbench_q39/duckdb:parquet | 93745503 | 9.30397e+07 | 1.00759 | ns | |
| clickbench_q40/duckdb:parquet | 55011286 | 5.43642e+07 | 1.0119 | ns | |
| clickbench_q41/duckdb:parquet | 57107069 | 5.84668e+07 | 0.976743 | ns | |
| clickbench_q42/duckdb:parquet | 44138842 | 4.26238e+07 | 1.03555 | ns | |
| clickbench_q00/duckdb:vortex-file-compressed | 12891482 | 1.30549e+07 | 0.987482 | ns | |
| clickbench_q01/duckdb:vortex-file-compressed | 24671475 | 2.48551e+07 | 0.992612 | ns | |
| clickbench_q02/duckdb:vortex-file-compressed | 35137159 | 3.61008e+07 | 0.973308 | ns | |
| clickbench_q03/duckdb:vortex-file-compressed | 40464886 | 4.01134e+07 | 1.00876 | ns | |
| clickbench_q04/duckdb:vortex-file-compressed | 185236812 | 1.7578e+08 | 1.0538 | ns | |
| clickbench_q05/duckdb:vortex-file-compressed | 203888482 | 1.95301e+08 | 1.04397 | ns | |
| clickbench_q06/duckdb:vortex-file-compressed | 40909941 | 3.96013e+07 | 1.03304 | ns | |
| clickbench_q07/duckdb:vortex-file-compressed | 26622193 | 2.56899e+07 | 1.03629 | ns | |
| clickbench_q08/duckdb:vortex-file-compressed | 269684342 | 2.66905e+08 | 1.01041 | ns | |
| clickbench_q09/duckdb:vortex-file-compressed | 361927974 | 4.08961e+08 | 0.884993 | ns | |
| clickbench_q10/duckdb:vortex-file-compressed | 79128311 | 8.71793e+07 | 0.90765 | ns | |
| clickbench_q11/duckdb:vortex-file-compressed | 89613890 | 9.88166e+07 | 0.90687 | ns | |
| clickbench_q12/duckdb:vortex-file-compressed | 216623431 | 2.44945e+08 | 0.884377 | ns | |
| clickbench_q13/duckdb:vortex-file-compressed | 484341710 | 5.80669e+08 | 0.83411 | ns | |
| clickbench_q14/duckdb:vortex-file-compressed | 308066334 | 3.30803e+08 | 0.931269 | ns | |
| clickbench_q15/duckdb:vortex-file-compressed | 223935389 | 2.40916e+08 | 0.929516 | ns | |
| clickbench_q16/duckdb:vortex-file-compressed | 999618064 | 1.08728e+09 | 0.919373 | ns | |
| clickbench_q17/duckdb:vortex-file-compressed | 921265214 | 9.6967e+08 | 0.950081 | ns | |
| clickbench_q18/duckdb:vortex-file-compressed | 1617208203 | 1.65773e+09 | 0.975555 | ns | |
| clickbench_q19/duckdb:vortex-file-compressed | 33321464 | 3.24568e+07 | 1.02664 | ns | |
| clickbench_q20/duckdb:vortex-file-compressed | 377575763 | 3.73103e+08 | 1.01199 | ns | |
| clickbench_q21/duckdb:vortex-file-compressed | 388048052 | 4.01721e+08 | 0.965963 | ns | |
| clickbench_q22/duckdb:vortex-file-compressed | 632930403 | 6.40873e+08 | 0.987607 | ns | |
| clickbench_q23/duckdb:vortex-file-compressed | 1190053860 | 1.25789e+09 | 0.946074 | ns | |
| clickbench_q24/duckdb:vortex-file-compressed | 70945542 | 6.82933e+07 | 1.03884 | ns | |
| clickbench_q25/duckdb:vortex-file-compressed | 73812027 | 7.31497e+07 | 1.00905 | ns | |
| clickbench_q26/duckdb:vortex-file-compressed | 61038273 | 5.98772e+07 | 1.01939 | ns | |
| clickbench_q27/duckdb:vortex-file-compressed | 464703233 | 4.52933e+08 | 1.02599 | ns | |
| clickbench_q28/duckdb:vortex-file-compressed | 3150057276 | 3.18422e+09 | 0.989271 | ns | |
| clickbench_q29/duckdb:vortex-file-compressed | 38466091 | 4.01262e+07 | 0.958627 | ns | |
| clickbench_q30/duckdb:vortex-file-compressed | 216153013 | 2.17995e+08 | 0.99155 | ns | |
| clickbench_q31/duckdb:vortex-file-compressed | 282253821 | 2.78078e+08 | 1.01502 | ns | |
| clickbench_q32/duckdb:vortex-file-compressed | 1130856807 | 1.13192e+09 | 0.999063 | ns | |
| clickbench_q33/duckdb:vortex-file-compressed | 1092066923 | 1.06242e+09 | 1.0279 | ns | |
| clickbench_q34/duckdb:vortex-file-compressed | 1573046432 | 1.58013e+09 | 0.995514 | ns | |
| clickbench_q35/duckdb:vortex-file-compressed | 368170117 | 3.66468e+08 | 1.00465 | ns | |
| clickbench_q36/duckdb:vortex-file-compressed | 31277221 | 3.07622e+07 | 1.01674 | ns | |
| clickbench_q37/duckdb:vortex-file-compressed | 23435458 | 2.34626e+07 | 0.998844 | ns | |
| clickbench_q38/duckdb:vortex-file-compressed | 24948341 | 2.40225e+07 | 1.03854 | ns | |
| clickbench_q39/duckdb:vortex-file-compressed | 49210877 | 4.75546e+07 | 1.03483 | ns | |
| clickbench_q40/duckdb:vortex-file-compressed | 23660781 | 2.36173e+07 | 1.00184 | ns | |
| clickbench_q41/duckdb:vortex-file-compressed | 23812846 | 2.38884e+07 | 0.996835 | ns | |
| clickbench_q42/duckdb:vortex-file-compressed | 24905753 | 2.6183e+07 | 0.951217 | ns | |
| clickbench_q00/duckdb:vortex-compact | 15600052 | 1.64172e+07 | 0.950226 | ns | |
| clickbench_q01/duckdb:vortex-compact | 44014357 | 4.23192e+07 | 1.04006 | ns | |
| clickbench_q02/duckdb:vortex-compact | 53384756 | 5.10238e+07 | 1.04627 | ns | |
| clickbench_q03/duckdb:vortex-compact | 50874910 | 4.98146e+07 | 1.02128 | ns | |
| clickbench_q04/duckdb:vortex-compact | 218114398 | 2.17466e+08 | 1.00298 | ns | |
| clickbench_q05/duckdb:vortex-compact | 236043930 | 2.33048e+08 | 1.01286 | ns | |
| clickbench_q06/duckdb:vortex-compact | 42250294 | 4.20322e+07 | 1.00519 | ns | |
| clickbench_q07/duckdb:vortex-compact | 56514792 | 5.52956e+07 | 1.02205 | ns | |
| clickbench_q08/duckdb:vortex-compact | 290049662 | 2.87131e+08 | 1.01017 | ns | |
| clickbench_q09/duckdb:vortex-compact | 413650365 | 4.11764e+08 | 1.00458 | ns | |
| clickbench_q10/duckdb:vortex-compact | 125567650 | 1.26611e+08 | 0.991758 | ns | |
| clickbench_q11/duckdb:vortex-compact | 145309879 | 1.47376e+08 | 0.985978 | ns | |
| clickbench_q12/duckdb:vortex-compact | 277668276 | 2.74079e+08 | 1.0131 | ns | |
| clickbench_q13/duckdb:vortex-compact | 552204284 | 5.34357e+08 | 1.0334 | ns | |
| clickbench_q14/duckdb:vortex-compact | 377439422 | 3.69282e+08 | 1.02209 | ns | |
| clickbench_q15/duckdb:vortex-compact | 261355887 | 2.52767e+08 | 1.03398 | ns | |
| clickbench_q16/duckdb:vortex-compact | 1082518863 | 1.04837e+09 | 1.03258 | ns | |
| clickbench_q17/duckdb:vortex-compact | 967139576 | 9.72088e+08 | 0.994909 | ns | |
| clickbench_q18/duckdb:vortex-compact | 1592286491 | 1.54082e+09 | 1.0334 | ns | |
| clickbench_q19/duckdb:vortex-compact | 34172246 | 3.27815e+07 | 1.04242 | ns | |
| clickbench_q20/duckdb:vortex-compact | 450312944 | 4.35447e+08 | 1.03414 | ns | |
| clickbench_q21/duckdb:vortex-compact | 506138522 | 4.91278e+08 | 1.03025 | ns | |
| clickbench_q22/duckdb:vortex-compact | 865286345 | 8.3139e+08 | 1.04077 | ns | |
| clickbench_q23/duckdb:vortex-compact | 1034264209 | 1.6122e+09 | 0.641522 | ns | 🚀 |
| clickbench_q24/duckdb:vortex-compact | 73153520 | 9.0006e+07 | 0.812763 | ns | |
| clickbench_q25/duckdb:vortex-compact | 134989534 | 1.3407e+08 | 1.00686 | ns | |
| clickbench_q26/duckdb:vortex-compact | 77045510 | 7.80211e+07 | 0.987495 | ns | |
| clickbench_q27/duckdb:vortex-compact | 619960526 | 6.14746e+08 | 1.00848 | ns | |
| clickbench_q28/duckdb:vortex-compact | 3214275857 | 3.19731e+09 | 1.00531 | ns | |
| clickbench_q29/duckdb:vortex-compact | 45489061 | 4.51733e+07 | 1.00699 | ns | |
| clickbench_q30/duckdb:vortex-compact | 302334343 | 2.9681e+08 | 1.01861 | ns | |
| clickbench_q31/duckdb:vortex-compact | 360250593 | 3.5608e+08 | 1.01171 | ns | |
| clickbench_q32/duckdb:vortex-compact | 1159928611 | 1.1447e+09 | 1.01331 | ns | |
| clickbench_q33/duckdb:vortex-compact | 1136183409 | 1.1616e+09 | 0.97812 | ns | |
| clickbench_q34/duckdb:vortex-compact | 1669419831 | 1.6301e+09 | 1.02412 | ns | |
| clickbench_q35/duckdb:vortex-compact | 369636574 | 3.66761e+08 | 1.00784 | ns | |
| clickbench_q36/duckdb:vortex-compact | 36281129 | 3.41872e+07 | 1.06125 | ns | |
| clickbench_q37/duckdb:vortex-compact | 28713691 | 2.83417e+07 | 1.01313 | ns | |
| clickbench_q38/duckdb:vortex-compact | 29434321 | 2.89777e+07 | 1.01576 | ns | |
| clickbench_q39/duckdb:vortex-compact | 53509651 | 5.31188e+07 | 1.00736 | ns | |
| clickbench_q40/duckdb:vortex-compact | 30751669 | 3.13973e+07 | 0.979436 | ns | |
| clickbench_q41/duckdb:vortex-compact | 28131723 | 2.91318e+07 | 0.96567 | ns | |
| clickbench_q42/duckdb:vortex-compact | 28932382 | 2.73975e+07 | 1.05602 | ns | |
| clickbench_q00/duckdb:duckdb | 18736674 | 1.76788e+07 | 1.05984 | ns | |
| clickbench_q01/duckdb:duckdb | 37111432 | 3.81962e+07 | 0.971601 | ns | |
| clickbench_q02/duckdb:duckdb | 46446750 | 4.6076e+07 | 1.00805 | ns | |
| clickbench_q03/duckdb:duckdb | 47992613 | 4.82522e+07 | 0.99462 | ns | |
| clickbench_q04/duckdb:duckdb | 191628068 | 1.90027e+08 | 1.00842 | ns | |
| clickbench_q05/duckdb:duckdb | 303348203 | 2.96395e+08 | 1.02346 | ns | |
| clickbench_q06/duckdb:duckdb | 36306630 | 3.5965e+07 | 1.0095 | ns | |
| clickbench_q07/duckdb:duckdb | 38420773 | 3.81358e+07 | 1.00747 | ns | |
| clickbench_q08/duckdb:duckdb | 252627724 | 2.51167e+08 | 1.00581 | ns | |
| clickbench_q09/duckdb:duckdb | 366086160 | 3.64055e+08 | 1.00558 | ns | |
| clickbench_q10/duckdb:duckdb | 113683983 | 1.11695e+08 | 1.01781 | ns | |
| clickbench_q11/duckdb:duckdb | 122643918 | 1.20296e+08 | 1.01952 | ns | |
| clickbench_q12/duckdb:duckdb | 268325301 | 2.67098e+08 | 1.00459 | ns | |
| clickbench_q13/duckdb:duckdb | 452956764 | 4.45624e+08 | 1.01646 | ns | |
| clickbench_q14/duckdb:duckdb | 292863413 | 2.91138e+08 | 1.00593 | ns | |
| clickbench_q15/duckdb:duckdb | 222747708 | 2.19158e+08 | 1.01638 | ns | |
| clickbench_q16/duckdb:duckdb | 545265440 | 5.4491e+08 | 1.00065 | ns | |
| clickbench_q17/duckdb:duckdb | 460051788 | 4.60438e+08 | 0.999161 | ns | |
| clickbench_q18/duckdb:duckdb | 952310242 | 9.44049e+08 | 1.00875 | ns | |
| clickbench_q19/duckdb:duckdb | 37103958 | 3.70525e+07 | 1.00139 | ns | |
| clickbench_q20/duckdb:duckdb | 456989542 | 4.50397e+08 | 1.01464 | ns | |
| clickbench_q21/duckdb:duckdb | 482339866 | 4.76702e+08 | 1.01183 | ns | |
| clickbench_q22/duckdb:duckdb | 555252986 | 5.33495e+08 | 1.04078 | ns | |
| clickbench_q23/duckdb:duckdb | 276064966 | 2.32707e+08 | 1.18632 | ns | |
| clickbench_q24/duckdb:duckdb | 49282448 | 4.93726e+07 | 0.998175 | ns | |
| clickbench_q25/duckdb:duckdb | 112161889 | 1.11677e+08 | 1.00434 | ns | |
| clickbench_q26/duckdb:duckdb | 46770954 | 4.66831e+07 | 1.00188 | ns | |
| clickbench_q27/duckdb:duckdb | 533892711 | 5.35098e+08 | 0.997748 | ns | |
| clickbench_q28/duckdb:duckdb | 4529358355 | 4.46987e+09 | 1.01331 | ns | |
| clickbench_q29/duckdb:duckdb | 49744826 | 4.96057e+07 | 1.0028 | ns | |
| clickbench_q30/duckdb:duckdb | 271716109 | 2.69067e+08 | 1.00985 | ns | |
| clickbench_q31/duckdb:duckdb | 342550827 | 3.37739e+08 | 1.01425 | ns | |
| clickbench_q32/duckdb:duckdb | 1027000343 | 1.01196e+09 | 1.01486 | ns | |
| clickbench_q33/duckdb:duckdb | 1090253120 | 1.05516e+09 | 1.03326 | ns | |
| clickbench_q34/duckdb:duckdb | 1167297230 | 1.13141e+09 | 1.03172 | ns | |
| clickbench_q35/duckdb:duckdb | 268839622 | 2.66588e+08 | 1.00845 | ns | |
| clickbench_q36/duckdb:duckdb | 44716630 | 4.44813e+07 | 1.00529 | ns | |
| clickbench_q37/duckdb:duckdb | 33204729 | 3.24572e+07 | 1.02303 | ns | |
| clickbench_q38/duckdb:duckdb | 34549062 | 3.40219e+07 | 1.0155 | ns | |
| clickbench_q39/duckdb:duckdb | 71801046 | 7.0495e+07 | 1.01853 | ns | |
| clickbench_q40/duckdb:duckdb | 33362463 | 3.25987e+07 | 1.02343 | ns | |
| clickbench_q41/duckdb:duckdb | 33816758 | 3.28566e+07 | 1.02922 | ns | |
| clickbench_q42/duckdb:duckdb | 32747318 | 3.21426e+07 | 1.01881 | ns |
Benchmarks: Statistical and Population Genetics
Summary
- Overall: 0.994x ➖
- Vortex: 1.004x ➖
- duckdb:vortex: 1.004x ➖
- Best: statpopgen_q01/duckdb:vortex-file-compressed (0.927x)
- Worst: statpopgen_q01/duckdb:vortex-compact (1.271x)
- Significant (>10%): 0↑ 1↓
Detailed Results Table
| name | PR d45a27d4 | base 45cd6c14 | ratio (PR/base) | unit | remark |
|---|---|---|---|---|---|
| statpopgen_q00/duckdb:parquet | 199237900 | 2.19978e+08 | 0.905717 | ns | |
| statpopgen_q01/duckdb:parquet | 337463068 | 3.61331e+08 | 0.933945 | ns | |
| statpopgen_q02/duckdb:parquet | 653120563 | 6.76475e+08 | 0.965476 | ns | |
| statpopgen_q03/duckdb:parquet | 1079922428 | 1.0926e+09 | 0.9884 | ns | |
| statpopgen_q04/duckdb:parquet | 1101648596 | 1.09274e+09 | 1.00815 | ns | |
| statpopgen_q05/duckdb:parquet | 714944244 | 7.26112e+08 | 0.98462 | ns | |
| statpopgen_q06/duckdb:parquet | 1300559111 | 1.31859e+09 | 0.986329 | ns | |
| statpopgen_q07/duckdb:parquet | 825758270 | 8.55374e+08 | 0.965376 | ns | |
| statpopgen_q08/duckdb:parquet | 832818725 | 8.57469e+08 | 0.971252 | ns | |
| statpopgen_q09/duckdb:parquet | 911795394 | 9.13544e+08 | 0.998086 | ns | |
| statpopgen_q10/duckdb:parquet | 2133880670 | 2.07913e+09 | 1.02633 | ns | |
| statpopgen_q00/duckdb:vortex-file-compressed | 12730501 | 1.27053e+07 | 1.00198 | ns | |
| statpopgen_q01/duckdb:vortex-file-compressed | 94532676 | 1.01993e+08 | 0.926855 | ns | |
| statpopgen_q02/duckdb:vortex-file-compressed | 1163177751 | 1.16344e+09 | 0.999773 | ns | |
| statpopgen_q03/duckdb:vortex-file-compressed | 2779593486 | 2.77589e+09 | 1.00133 | ns | |
| statpopgen_q04/duckdb:vortex-file-compressed | 2767964218 | 2.79365e+09 | 0.990807 | ns | |
| statpopgen_q05/duckdb:vortex-file-compressed | 1252402146 | 1.27605e+09 | 0.981468 | ns | |
| statpopgen_q06/duckdb:vortex-file-compressed | 1931851252 | 1.96149e+09 | 0.984891 | ns | |
| statpopgen_q07/duckdb:vortex-file-compressed | 429507188 | 4.39588e+08 | 0.977067 | ns | |
| statpopgen_q08/duckdb:vortex-file-compressed | 442321313 | 4.5403e+08 | 0.974212 | ns | |
| statpopgen_q09/duckdb:vortex-file-compressed | 2513206218 | 2.54876e+09 | 0.98605 | ns | |
| statpopgen_q10/duckdb:vortex-file-compressed | 4084526335 | 4.11831e+09 | 0.991798 | ns | |
| statpopgen_q00/duckdb:vortex-compact | 12773828 | 1.32969e+07 | 0.960663 | ns | |
| statpopgen_q01/duckdb:vortex-compact | 289821052 | 2.28091e+08 | 1.27064 | ns | |
| statpopgen_q02/duckdb:vortex-compact | 552576427 | 5.4069e+08 | 1.02198 | ns | |
| statpopgen_q03/duckdb:vortex-compact | 2212297798 | 2.21215e+09 | 1.00007 | ns | |
| statpopgen_q04/duckdb:vortex-compact | 2216417782 | 2.21201e+09 | 1.00199 | ns | |
| statpopgen_q05/duckdb:vortex-compact | 592289677 | 5.73094e+08 | 1.03349 | ns | |
| statpopgen_q06/duckdb:vortex-compact | 1526661487 | 1.5214e+09 | 1.00346 | ns | |
| statpopgen_q07/duckdb:vortex-compact | 2938815278 | 2.90208e+09 | 1.01266 | ns | |
| statpopgen_q08/duckdb:vortex-compact | 136882634477 | 1.36345e+11 | 1.00395 | ns | |
| statpopgen_q09/duckdb:vortex-compact | 1981410246 | 1.98145e+09 | 0.999982 | ns | |
| statpopgen_q10/duckdb:vortex-compact | 3787820310 | 3.78648e+09 | 1.00035 | ns |
CodSpeed Performance Report
Merging #5205 will improve performances by ×3.2
Comparing adamg/dynamic-expr-take-2 (3bc2a67) with develop (28f5b3d)[^unexpected-base]
[^unexpected-base]: No successful run was found on develop (ee4b921) during the generation of this report, so 28f5b3d was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Summary
⚡ 44 improvements
✅ 1274 untouched
🆕 7 new
⏩ 155 skipped[^skipped]
Benchmarks breakdown
:information_source: Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks. [^skipped]: 155 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.
Codecov Report
:x: Patch coverage is 97.50000% with 2 lines in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 84.30%. Comparing base (45cd6c1) to head (d45a27d).
| Files with missing lines | Patch % | Lines |
|---|---|---|
| vortex-datafusion/src/convert/exprs.rs | 95.00% | 1 Missing :warning: |
| vortex-datafusion/src/persistent/source.rs | 96.00% | 1 Missing :warning: |
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
:rocket: New features to boost your workflow:
- :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
- :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
Was going to add tests, but than I ran into this issue which took me a while to repro.
@AdamGS anything I can do to help here? Is the holdup benchmarks?
Yeah it's basically me wanting to dive into the benchmarks. There are some cases here that I expected it to make more of a difference, and obviously some regressions too. Just got busy with other stuff and taking some time off now but once I'm back at work I'm planning on picking this back up
Okay just let me know if I can help!
I agree the benchmark results are surprising but I'm not sure where it's coming from, how much could be benchmark noise, etc.