Upgrade DF to 51

[AdamGS]

Testing the upgrade to DF 51.

• https://github.com/apache/datafusion/issues/17558#issuecomment-3487645051

[codspeed-hq[bot]]

CodSpeed Performance Report

Merging #5189 will improve performances by 12.71%

_{Comparing adamg/df-51 (cb25f3c) with develop (ec5c119)}

Summary

⚡ 1 improvement
✅ 1157 untouched
⏩ 617 skipped[^skipped]

Benchmarks breakdown

	Benchmark	BASE	HEAD	Change
⚡	encode_specialized	2.7 ms	2.4 ms	+12.71%
[^skipped]: 617 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

[github-actions[bot]]

Benchmarks: FineWeb NVMe

Summary

• Overall: 1.011x ➖
• Vortex: 1.009x ➖
• duckdb:vortex: 1.014x ➖
• datafusion:vortex: 1.005x ➖
• Best: fineweb_q06/duckdb:vortex-file-compressed (0.846x)
• Worst: fineweb_q08/duckdb:vortex-compact (1.239x)
• Significant (>10%): 1↑ 5↓

Detailed Results Table

name	PR cb25f3c0	base 69377e1f	ratio (PR/base)	unit	remark
fineweb_q00/datafusion:parquet	6481988	6.42952e+06	1.00816	ns
fineweb_q00/datafusion:parquet	6481988	6.3414e+06	1.02217	ns
fineweb_q01/datafusion:parquet	308830693	3.06704e+08	1.00693	ns
fineweb_q01/datafusion:parquet	308830693	3.08897e+08	0.999787	ns
fineweb_q02/datafusion:parquet	302374377	3.02821e+08	0.998525	ns
fineweb_q02/datafusion:parquet	302374377	3.02972e+08	0.998029	ns
fineweb_q03/datafusion:parquet	296013384	2.94819e+08	1.00405	ns
fineweb_q03/datafusion:parquet	296013384	2.95427e+08	1.00199	ns
fineweb_q04/datafusion:parquet	324707019	3.27714e+08	0.990823	ns
fineweb_q04/datafusion:parquet	324707019	3.26641e+08	0.99408	ns
fineweb_q05/datafusion:parquet	312850740	3.14792e+08	0.993834	ns
fineweb_q05/datafusion:parquet	312850740	3.16384e+08	0.988833	ns
fineweb_q06/datafusion:parquet	302887441	3.06896e+08	0.986937	ns
fineweb_q06/datafusion:parquet	302887441	3.05166e+08	0.992535	ns
fineweb_q07/datafusion:parquet	298026991	3.02085e+08	0.986565	ns
fineweb_q07/datafusion:parquet	298026991	2.99806e+08	0.994067	ns
fineweb_q08/datafusion:parquet	297195858	2.98097e+08	0.996976	ns
fineweb_q08/datafusion:parquet	297195858	2.98151e+08	0.996796	ns
fineweb_q00/datafusion:vortex-file-compressed	4539276	4.75925e+06	0.95378	ns
fineweb_q00/datafusion:vortex-file-compressed	4539276	4.20675e+06	1.07905	ns
fineweb_q01/datafusion:vortex-file-compressed	32922540	2.94128e+07	1.11933	ns	🚨
fineweb_q01/datafusion:vortex-file-compressed	32922540	2.91618e+07	1.12896	ns	🚨
fineweb_q02/datafusion:vortex-file-compressed	29787022	3.15143e+07	0.94519	ns
fineweb_q02/datafusion:vortex-file-compressed	29787022	3.23163e+07	0.921735	ns
fineweb_q03/datafusion:vortex-file-compressed	78000216	8.34758e+07	0.934405	ns
fineweb_q03/datafusion:vortex-file-compressed	78000216	7.62385e+07	1.02311	ns
fineweb_q04/datafusion:vortex-file-compressed	213064431	2.24768e+08	0.947929	ns
fineweb_q04/datafusion:vortex-file-compressed	213064431	2.11501e+08	1.00739	ns
fineweb_q05/datafusion:vortex-file-compressed	191288511	1.94482e+08	0.983579	ns
fineweb_q05/datafusion:vortex-file-compressed	191288511	1.95552e+08	0.978197	ns
fineweb_q06/datafusion:vortex-file-compressed	69252608	6.9497e+07	0.996484	ns
fineweb_q06/datafusion:vortex-file-compressed	69252608	7.05192e+07	0.982039	ns
fineweb_q07/datafusion:vortex-file-compressed	73251299	7.25593e+07	1.00954	ns
fineweb_q07/datafusion:vortex-file-compressed	73251299	7.14716e+07	1.0249	ns
fineweb_q08/datafusion:vortex-file-compressed	31919879	3.46977e+07	0.919942	ns
fineweb_q08/datafusion:vortex-file-compressed	31919879	3.10142e+07	1.0292	ns
fineweb_q00/datafusion:vortex-compact	5090168	4.89568e+06	1.03973	ns
fineweb_q00/datafusion:vortex-compact	5090168	4.47983e+06	1.13624	ns	🚨
fineweb_q01/datafusion:vortex-compact	159910810	1.71357e+08	0.933205	ns
fineweb_q01/datafusion:vortex-compact	159910810	1.62115e+08	0.986404	ns
fineweb_q02/datafusion:vortex-compact	161893654	1.65491e+08	0.97826	ns
fineweb_q02/datafusion:vortex-compact	161893654	1.63074e+08	0.99276	ns
fineweb_q03/datafusion:vortex-compact	1403644764	1.38393e+09	1.01424	ns
fineweb_q03/datafusion:vortex-compact	1403644764	1.37464e+09	1.0211	ns
fineweb_q04/datafusion:vortex-compact	1621691631	1.6392e+09	0.98932	ns
fineweb_q04/datafusion:vortex-compact	1621691631	1.61721e+09	1.00277	ns
fineweb_q05/datafusion:vortex-compact	1244573268	1.24702e+09	0.998035	ns
fineweb_q05/datafusion:vortex-compact	1244573268	1.22615e+09	1.01502	ns
fineweb_q06/datafusion:vortex-compact	640481501	6.20338e+08	1.03247	ns
fineweb_q06/datafusion:vortex-compact	640481501	6.36361e+08	1.00648	ns
fineweb_q07/datafusion:vortex-compact	680696374	6.59576e+08	1.03202	ns
fineweb_q07/datafusion:vortex-compact	680696374	6.58156e+08	1.03425	ns
fineweb_q08/datafusion:vortex-compact	27856908	2.80001e+07	0.994887	ns
fineweb_q08/datafusion:vortex-compact	27856908	2.72963e+07	1.02054	ns
fineweb_q00/duckdb:parquet	30718220	2.82751e+07	1.08641	ns
fineweb_q00/duckdb:parquet	30718220	2.84383e+07	1.08017	ns
fineweb_q01/duckdb:parquet	99030169	9.41884e+07	1.05141	ns
fineweb_q01/duckdb:parquet	99030169	9.44044e+07	1.049	ns
fineweb_q02/duckdb:parquet	104266924	1.00811e+08	1.03428	ns
fineweb_q02/duckdb:parquet	104266924	1.00946e+08	1.0329	ns
fineweb_q03/duckdb:parquet	310245275	3.06069e+08	1.01365	ns
fineweb_q03/duckdb:parquet	310245275	3.05568e+08	1.01531	ns
fineweb_q04/duckdb:parquet	434190428	4.28188e+08	1.01402	ns
fineweb_q04/duckdb:parquet	434190428	4.29337e+08	1.0113	ns
fineweb_q05/duckdb:parquet	406202320	4.03198e+08	1.00745	ns
fineweb_q05/duckdb:parquet	406202320	4.03023e+08	1.00789	ns
fineweb_q06/duckdb:parquet	205457343	1.99768e+08	1.02848	ns
fineweb_q06/duckdb:parquet	205457343	1.99644e+08	1.02912	ns
fineweb_q07/duckdb:parquet	216347694	2.12956e+08	1.01593	ns
fineweb_q07/duckdb:parquet	216347694	2.12017e+08	1.02043	ns
fineweb_q08/duckdb:parquet	61834950	5.97957e+07	1.0341	ns
fineweb_q08/duckdb:parquet	61834950	5.88243e+07	1.05118	ns
fineweb_q00/duckdb:vortex-file-compressed	4920949	4.59684e+06	1.07051	ns
fineweb_q00/duckdb:vortex-file-compressed	4920949	4.65298e+06	1.05759	ns
fineweb_q01/duckdb:vortex-file-compressed	23656702	2.36468e+07	1.00042	ns
fineweb_q01/duckdb:vortex-file-compressed	23656702	2.40788e+07	0.982469	ns
fineweb_q02/duckdb:vortex-file-compressed	33235789	3.33808e+07	0.995656	ns
fineweb_q02/duckdb:vortex-file-compressed	33235789	3.3804e+07	0.983192	ns
fineweb_q03/duckdb:vortex-file-compressed	105161200	1.05385e+08	0.997879	ns
fineweb_q03/duckdb:vortex-file-compressed	105161200	1.09024e+08	0.96457	ns
fineweb_q04/duckdb:vortex-file-compressed	192090843	1.90714e+08	1.00722	ns
fineweb_q04/duckdb:vortex-file-compressed	192090843	1.9238e+08	0.998496	ns
fineweb_q05/duckdb:vortex-file-compressed	176271926	1.74709e+08	1.00894	ns
fineweb_q05/duckdb:vortex-file-compressed	176271926	1.75099e+08	1.0067	ns
fineweb_q06/duckdb:vortex-file-compressed	55621131	5.57735e+07	0.997268	ns
fineweb_q06/duckdb:vortex-file-compressed	55621131	6.57333e+07	0.846163	ns	🚀
fineweb_q07/duckdb:vortex-file-compressed	59489750	5.91955e+07	1.00497	ns
fineweb_q07/duckdb:vortex-file-compressed	59489750	6.05656e+07	0.982237	ns
fineweb_q08/duckdb:vortex-file-compressed	9730274	9.53552e+06	1.02042	ns
fineweb_q08/duckdb:vortex-file-compressed	9730274	8.80109e+06	1.10558	ns	🚨
fineweb_q00/duckdb:vortex-compact	6111941	6.06302e+06	1.00807	ns
fineweb_q00/duckdb:vortex-compact	6111941	6.20032e+06	0.985747	ns
fineweb_q01/duckdb:vortex-compact	97232037	1.00664e+08	0.965911	ns
fineweb_q01/duckdb:vortex-compact	97232037	8.89636e+07	1.09294	ns
fineweb_q02/duckdb:vortex-compact	104268317	1.01306e+08	1.02924	ns
fineweb_q02/duckdb:vortex-compact	104268317	9.52993e+07	1.09411	ns
fineweb_q03/duckdb:vortex-compact	851999607	8.46757e+08	1.00619	ns
fineweb_q03/duckdb:vortex-compact	851999607	8.51196e+08	1.00094	ns
fineweb_q04/duckdb:vortex-compact	897786201	8.89924e+08	1.00883	ns
fineweb_q04/duckdb:vortex-compact	897786201	8.87992e+08	1.01103	ns
fineweb_q05/duckdb:vortex-compact	792104552	7.90588e+08	1.00192	ns
fineweb_q05/duckdb:vortex-compact	792104552	7.98459e+08	0.992041	ns
fineweb_q06/duckdb:vortex-compact	449796957	4.51395e+08	0.99646	ns
fineweb_q06/duckdb:vortex-compact	449796957	4.48318e+08	1.0033	ns
fineweb_q07/duckdb:vortex-compact	465370566	4.54851e+08	1.02313	ns
fineweb_q07/duckdb:vortex-compact	465370566	4.52624e+08	1.02816	ns
fineweb_q08/duckdb:vortex-compact	9991921	9.5796e+06	1.04304	ns
fineweb_q08/duckdb:vortex-compact	9991921	8.06239e+06	1.23932	ns	🚨

[github-actions[bot]]

Benchmarks: FineWeb S3

Summary

• Overall: no data
• Vortex: no vortex data
• duckdb:vortex: no duckdb:vortex data
• datafusion:vortex: no datafusion:vortex data
• Best: No valid vortex comparisons
• Worst: No valid vortex comparisons
• Significant (>30%): 0↑ 0↓

Detailed Results Table

name	PR cb25f3c0	base 69377e1f	ratio (PR/base)	unit	remark
fineweb_q00/datafusion:parquet	874560140	nan	nan	nan
fineweb_q01/datafusion:parquet	1600871090	nan	nan	nan
fineweb_q02/datafusion:parquet	1594184008	nan	nan	nan
fineweb_q03/datafusion:parquet	1587556981	nan	nan	nan
fineweb_q04/datafusion:parquet	1655352183	nan	nan	nan
fineweb_q05/datafusion:parquet	1679638423	nan	nan	nan
fineweb_q06/datafusion:parquet	1659655281	nan	nan	nan
fineweb_q07/datafusion:parquet	1603695803	nan	nan	nan
fineweb_q08/datafusion:parquet	1725128678	nan	nan	nan
fineweb_q00/datafusion:vortex-file-compressed	30814397	nan	nan	nan
fineweb_q01/datafusion:vortex-file-compressed	527666812	nan	nan	nan
fineweb_q02/datafusion:vortex-file-compressed	342311816	nan	nan	nan
fineweb_q03/datafusion:vortex-file-compressed	1416514137	nan	nan	nan
fineweb_q04/datafusion:vortex-file-compressed	1406505072	nan	nan	nan
fineweb_q05/datafusion:vortex-file-compressed	1360397599	nan	nan	nan
fineweb_q06/datafusion:vortex-file-compressed	1611171705	nan	nan	nan
fineweb_q07/datafusion:vortex-file-compressed	1417826295	nan	nan	nan
fineweb_q08/datafusion:vortex-file-compressed	555720596	nan	nan	nan
fineweb_q00/datafusion:vortex-compact	35826616	nan	nan	nan
fineweb_q01/datafusion:vortex-compact	440528904	nan	nan	nan
fineweb_q02/datafusion:vortex-compact	461959834	nan	nan	nan
fineweb_q03/datafusion:vortex-compact	1688056001	nan	nan	nan
fineweb_q04/datafusion:vortex-compact	2033873500	nan	nan	nan
fineweb_q05/datafusion:vortex-compact	1649960988	nan	nan	nan
fineweb_q06/datafusion:vortex-compact	1266463128	nan	nan	nan
fineweb_q07/datafusion:vortex-compact	1124892361	nan	nan	nan
fineweb_q08/datafusion:vortex-compact	403817079	nan	nan	nan
fineweb_q00/duckdb:parquet	1057720197	nan	nan	nan
fineweb_q01/duckdb:parquet	2228426175	nan	nan	nan
fineweb_q02/duckdb:parquet	2237445224	nan	nan	nan
fineweb_q03/duckdb:parquet	7248163146	nan	nan	nan
fineweb_q04/duckdb:parquet	1806198295	nan	nan	nan
fineweb_q05/duckdb:parquet	3862998807	nan	nan	nan
fineweb_q06/duckdb:parquet	5069990334	nan	nan	nan
fineweb_q07/duckdb:parquet	5473480015	nan	nan	nan
fineweb_q08/duckdb:parquet	1003287825	nan	nan	nan
fineweb_q00/duckdb:vortex-file-compressed	86872355	nan	nan	nan
fineweb_q01/duckdb:vortex-file-compressed	519840236	nan	nan	nan
fineweb_q02/duckdb:vortex-file-compressed	558325227	nan	nan	nan
fineweb_q03/duckdb:vortex-file-compressed	1546802299	nan	nan	nan
fineweb_q04/duckdb:vortex-file-compressed	1602755641	nan	nan	nan
fineweb_q05/duckdb:vortex-file-compressed	1691486245	nan	nan	nan
fineweb_q06/duckdb:vortex-file-compressed	1790574935	nan	nan	nan
fineweb_q07/duckdb:vortex-file-compressed	1562195282	nan	nan	nan
fineweb_q08/duckdb:vortex-file-compressed	631720252	nan	nan	nan
fineweb_q00/duckdb:vortex-compact	84751644	nan	nan	nan
fineweb_q01/duckdb:vortex-compact	478159717	nan	nan	nan
fineweb_q02/duckdb:vortex-compact	647393281	nan	nan	nan
fineweb_q03/duckdb:vortex-compact	1741832574	nan	nan	nan
fineweb_q04/duckdb:vortex-compact	1850780437	nan	nan	nan
fineweb_q05/duckdb:vortex-compact	1627553390	nan	nan	nan
fineweb_q06/duckdb:vortex-compact	1553477477	nan	nan	nan
fineweb_q07/duckdb:vortex-compact	1477008444	nan	nan	nan
fineweb_q08/duckdb:vortex-compact	520065235	nan	nan	nan

[github-actions[bot]]

Benchmarks: GitHub Archive (NVMe)

Summary

• Overall: 0.993x ➖
• Vortex: 0.991x ➖
• duckdb:vortex: 1.000x ➖
• datafusion:vortex: 0.982x ➖
• Best: gharchive_q02/datafusion:vortex-compact (0.916x)
• Worst: gharchive_q00/duckdb:vortex-compact (1.059x)
• Significant (>10%): 0↑ 0↓

Detailed Results Table

name	PR fd582cd7	base 7541a3b3	ratio (PR/base)	unit	remark
gharchive_q00/datafusion:parquet	3228013600	3.18848e+09	1.0124	ns
gharchive_q00/datafusion:parquet	3228013600	3.19475e+09	1.01041	ns
gharchive_q01/datafusion:parquet	66628525	6.44436e+07	1.0339	ns
gharchive_q01/datafusion:parquet	66628525	6.55471e+07	1.0165	ns
gharchive_q02/datafusion:parquet	45999487	4.54551e+07	1.01198	ns
gharchive_q02/datafusion:parquet	45999487	4.70777e+07	0.977097	ns
gharchive_q03/datafusion:parquet	112799269	1.07961e+08	1.04482	ns
gharchive_q03/datafusion:parquet	112799269	1.08647e+08	1.03822	ns
gharchive_q04/datafusion:parquet	81236777	8.23376e+07	0.986631	ns
gharchive_q04/datafusion:parquet	81236777	8.24253e+07	0.98558	ns
gharchive_q00/datafusion:vortex-file-compressed	35482368	3.6754e+07	0.965402	ns
gharchive_q00/datafusion:vortex-file-compressed	35482368	3.54843e+07	0.999947	ns
gharchive_q01/datafusion:vortex-file-compressed	24205939	2.51489e+07	0.962505	ns
gharchive_q01/datafusion:vortex-file-compressed	24205939	2.52269e+07	0.95953	ns
gharchive_q02/datafusion:vortex-file-compressed	26410772	2.5096e+07	1.05239	ns
gharchive_q02/datafusion:vortex-file-compressed	26410772	2.56401e+07	1.03006	ns
gharchive_q03/datafusion:vortex-file-compressed	64222414	6.3741e+07	1.00755	ns
gharchive_q03/datafusion:vortex-file-compressed	64222414	6.40018e+07	1.00345	ns
gharchive_q04/datafusion:vortex-file-compressed	26727624	2.64754e+07	1.00952	ns
gharchive_q04/datafusion:vortex-file-compressed	26727624	2.8313e+07	0.944006	ns
gharchive_q00/datafusion:vortex-compact	47540118	4.90722e+07	0.968778	ns
gharchive_q00/datafusion:vortex-compact	47540118	4.85654e+07	0.978889	ns
gharchive_q01/datafusion:vortex-compact	39634199	3.96208e+07	1.00034	ns
gharchive_q01/datafusion:vortex-compact	39634199	3.92012e+07	1.01105	ns
gharchive_q02/datafusion:vortex-compact	34992524	3.81813e+07	0.916484	ns
gharchive_q02/datafusion:vortex-compact	34992524	3.63049e+07	0.963852	ns
gharchive_q03/datafusion:vortex-compact	77185406	7.67403e+07	1.0058	ns
gharchive_q03/datafusion:vortex-compact	77185406	8.05838e+07	0.957827	ns
gharchive_q04/datafusion:vortex-compact	46790202	4.88483e+07	0.957867	ns
gharchive_q04/datafusion:vortex-compact	46790202	4.88077e+07	0.958665	ns
gharchive_q00/duckdb:parquet	513485073	5.39155e+08	0.952388	ns
gharchive_q00/duckdb:parquet	513485073	5.36613e+08	0.956901	ns
gharchive_q01/duckdb:parquet	114782870	1.1625e+08	0.987383	ns
gharchive_q01/duckdb:parquet	114782870	1.1458e+08	1.00177	ns
gharchive_q02/duckdb:parquet	90209114	9.1389e+07	0.987089	ns
gharchive_q02/duckdb:parquet	90209114	9.09266e+07	0.992109	ns
gharchive_q03/duckdb:parquet	163669204	1.64132e+08	0.99718	ns
gharchive_q03/duckdb:parquet	163669204	1.61e+08	1.01658	ns
gharchive_q04/duckdb:parquet	131214548	1.35931e+08	0.965303	ns
gharchive_q04/duckdb:parquet	131214548	1.30677e+08	1.00411	ns
gharchive_q00/duckdb:vortex-file-compressed	54007452	5.50513e+07	0.981039	ns
gharchive_q00/duckdb:vortex-file-compressed	54007452	5.31356e+07	1.01641	ns
gharchive_q01/duckdb:vortex-file-compressed	34631610	3.56617e+07	0.971114	ns
gharchive_q01/duckdb:vortex-file-compressed	34631610	3.54243e+07	0.977622	ns
gharchive_q02/duckdb:vortex-file-compressed	32574993	3.41903e+07	0.952756	ns
gharchive_q02/duckdb:vortex-file-compressed	32574993	3.31067e+07	0.983941	ns
gharchive_q03/duckdb:vortex-file-compressed	129248112	1.28625e+08	1.00484	ns
gharchive_q03/duckdb:vortex-file-compressed	129248112	1.29521e+08	0.997897	ns
gharchive_q04/duckdb:vortex-file-compressed	34065981	3.38076e+07	1.00764	ns
gharchive_q04/duckdb:vortex-file-compressed	34065981	3.28754e+07	1.03621	ns
gharchive_q00/duckdb:vortex-compact	72286817	6.82794e+07	1.05869	ns
gharchive_q00/duckdb:vortex-compact	72286817	7.18049e+07	1.00671	ns
gharchive_q01/duckdb:vortex-compact	48820814	4.79269e+07	1.01865	ns
gharchive_q01/duckdb:vortex-compact	48820814	4.86815e+07	1.00286	ns
gharchive_q02/duckdb:vortex-compact	40898986	4.08568e+07	1.00103	ns
gharchive_q02/duckdb:vortex-compact	40898986	4.13393e+07	0.989349	ns
gharchive_q03/duckdb:vortex-compact	150427576	1.5104e+08	0.995943	ns
gharchive_q03/duckdb:vortex-compact	150427576	1.50946e+08	0.996564	ns
gharchive_q04/duckdb:vortex-compact	50915233	5.08555e+07	1.00117	ns
gharchive_q04/duckdb:vortex-compact	50915233	5.10964e+07	0.996454	ns

[github-actions[bot]]

Benchmarks: GitHub Archive (S3)

Summary

• Overall: 1.005x ➖
• Vortex: 1.000x ➖
• duckdb:vortex: 1.002x ➖
• datafusion:vortex: 0.998x ➖
• Best: gharchive_q02/datafusion:vortex-compact (0.946x)
• Worst: gharchive_q00/duckdb:vortex-file-compressed (1.086x)
• Significant (>30%): 0↑ 0↓

Detailed Results Table

name	PR fd582cd7	base 7541a3b3	ratio (PR/base)	unit	remark
gharchive_q00/datafusion:parquet	3289865163	3.18848e+09	1.0318	ns
gharchive_q00/datafusion:parquet	3289865163	3.19475e+09	1.02977	ns
gharchive_q01/datafusion:parquet	67885383	6.44436e+07	1.05341	ns
gharchive_q01/datafusion:parquet	67885383	6.55471e+07	1.03567	ns
gharchive_q02/datafusion:parquet	46596359	4.54551e+07	1.02511	ns
gharchive_q02/datafusion:parquet	46596359	4.70777e+07	0.989775	ns
gharchive_q03/datafusion:parquet	110711000	1.07961e+08	1.02548	ns
gharchive_q03/datafusion:parquet	110711000	1.08647e+08	1.019	ns
gharchive_q04/datafusion:parquet	84588051	8.23376e+07	1.02733	ns
gharchive_q04/datafusion:parquet	84588051	8.24253e+07	1.02624	ns
gharchive_q00/datafusion:vortex-file-compressed	35597090	3.6754e+07	0.968523	ns
gharchive_q00/datafusion:vortex-file-compressed	35597090	3.54843e+07	1.00318	ns
gharchive_q01/datafusion:vortex-file-compressed	25880366	2.51489e+07	1.02909	ns
gharchive_q01/datafusion:vortex-file-compressed	25880366	2.52269e+07	1.0259	ns
gharchive_q02/datafusion:vortex-file-compressed	25250207	2.5096e+07	1.00614	ns
gharchive_q02/datafusion:vortex-file-compressed	25250207	2.56401e+07	0.984793	ns
gharchive_q03/datafusion:vortex-file-compressed	64038829	6.3741e+07	1.00467	ns
gharchive_q03/datafusion:vortex-file-compressed	64038829	6.40018e+07	1.00058	ns
gharchive_q04/datafusion:vortex-file-compressed	27661966	2.64754e+07	1.04482	ns
gharchive_q04/datafusion:vortex-file-compressed	27661966	2.8313e+07	0.977007	ns
gharchive_q00/datafusion:vortex-compact	49923707	4.90722e+07	1.01735	ns
gharchive_q00/datafusion:vortex-compact	49923707	4.85654e+07	1.02797	ns
gharchive_q01/datafusion:vortex-compact	39112442	3.96208e+07	0.98717	ns
gharchive_q01/datafusion:vortex-compact	39112442	3.92012e+07	0.997736	ns
gharchive_q02/datafusion:vortex-compact	36117599	3.81813e+07	0.94595	ns
gharchive_q02/datafusion:vortex-compact	36117599	3.63049e+07	0.994842	ns
gharchive_q03/datafusion:vortex-compact	80058564	7.67403e+07	1.04324	ns
gharchive_q03/datafusion:vortex-compact	80058564	8.05838e+07	0.993481	ns
gharchive_q04/datafusion:vortex-compact	46734222	4.88483e+07	0.956721	ns
gharchive_q04/datafusion:vortex-compact	46734222	4.88077e+07	0.957518	ns
gharchive_q00/duckdb:parquet	536723329	5.39155e+08	0.99549	ns
gharchive_q00/duckdb:parquet	536723329	5.36613e+08	1.00021	ns
gharchive_q01/duckdb:parquet	115102132	1.1625e+08	0.990129	ns
gharchive_q01/duckdb:parquet	115102132	1.1458e+08	1.00456	ns
gharchive_q02/duckdb:parquet	90177726	9.1389e+07	0.986746	ns
gharchive_q02/duckdb:parquet	90177726	9.09266e+07	0.991764	ns
gharchive_q03/duckdb:parquet	162606122	1.64132e+08	0.990703	ns
gharchive_q03/duckdb:parquet	162606122	1.61e+08	1.00998	ns
gharchive_q04/duckdb:parquet	136151102	1.35931e+08	1.00162	ns
gharchive_q04/duckdb:parquet	136151102	1.30677e+08	1.04189	ns
gharchive_q00/duckdb:vortex-file-compressed	57723622	5.50513e+07	1.04854	ns
gharchive_q00/duckdb:vortex-file-compressed	57723622	5.31356e+07	1.08635	ns
gharchive_q01/duckdb:vortex-file-compressed	34525996	3.56617e+07	0.968153	ns
gharchive_q01/duckdb:vortex-file-compressed	34525996	3.54243e+07	0.97464	ns
gharchive_q02/duckdb:vortex-file-compressed	32582135	3.41903e+07	0.952965	ns
gharchive_q02/duckdb:vortex-file-compressed	32582135	3.31067e+07	0.984157	ns
gharchive_q03/duckdb:vortex-file-compressed	129150805	1.28625e+08	1.00409	ns
gharchive_q03/duckdb:vortex-file-compressed	129150805	1.29521e+08	0.997145	ns
gharchive_q04/duckdb:vortex-file-compressed	33637536	3.38076e+07	0.99497	ns
gharchive_q04/duckdb:vortex-file-compressed	33637536	3.28754e+07	1.02318	ns
gharchive_q00/duckdb:vortex-compact	69466301	6.82794e+07	1.01738	ns
gharchive_q00/duckdb:vortex-compact	69466301	7.18049e+07	0.967432	ns
gharchive_q01/duckdb:vortex-compact	48401267	4.79269e+07	1.0099	ns
gharchive_q01/duckdb:vortex-compact	48401267	4.86815e+07	0.994244	ns
gharchive_q02/duckdb:vortex-compact	41346364	4.08568e+07	1.01198	ns
gharchive_q02/duckdb:vortex-compact	41346364	4.13393e+07	1.00017	ns
gharchive_q03/duckdb:vortex-compact	150902226	1.5104e+08	0.999085	ns
gharchive_q03/duckdb:vortex-compact	150902226	1.50946e+08	0.999708	ns
gharchive_q04/duckdb:vortex-compact	51565485	5.08555e+07	1.01396	ns
gharchive_q04/duckdb:vortex-compact	51565485	5.10964e+07	1.00918	ns

[github-actions[bot]]

Benchmarks: Clickbench on NVME

Summary

• Overall: 1.037x ➖
• Vortex: 1.053x ➖
• duckdb:vortex: 1.009x ➖
• datafusion:vortex: 1.098x ➖
• Best: clickbench_q26/duckdb:vortex-compact (0.879x)
• Worst: clickbench_q10/datafusion:vortex-compact (1.225x)
• Significant (>10%): 1↑ 58↓

Detailed Results Table

name	PR cb25f3c0	base 69377e1f	ratio (PR/base)	unit	remark
clickbench_q00/datafusion:parquet	2009642	1.71997e+06	1.16842	ns	🚨
clickbench_q01/datafusion:parquet	23069681	2.61175e+07	0.883304	ns	🚀
clickbench_q02/datafusion:parquet	58679980	5.99328e+07	0.979096	ns
clickbench_q03/datafusion:parquet	53064092	5.41991e+07	0.979058	ns
clickbench_q04/datafusion:parquet	405389193	3.66208e+08	1.10699	ns	🚨
clickbench_q05/datafusion:parquet	421397700	3.74888e+08	1.12406	ns	🚨
clickbench_q06/datafusion:parquet	1739091	1.81188e+06	0.959824	ns
clickbench_q07/datafusion:parquet	29578866	3.0859e+07	0.958518	ns
clickbench_q08/datafusion:parquet	504438932	4.57571e+08	1.10243	ns	🚨
clickbench_q09/datafusion:parquet	748497794	6.8161e+08	1.09813	ns
clickbench_q10/datafusion:parquet	139671638	1.32497e+08	1.05415	ns
clickbench_q11/datafusion:parquet	171568219	1.53233e+08	1.11965	ns	🚨
clickbench_q12/datafusion:parquet	407033757	3.87008e+08	1.05174	ns
clickbench_q13/datafusion:parquet	579504362	5.39232e+08	1.07468	ns
clickbench_q14/datafusion:parquet	398684393	3.81529e+08	1.04496	ns
clickbench_q15/datafusion:parquet	463343742	4.26026e+08	1.0876	ns
clickbench_q16/datafusion:parquet	920676335	7.80164e+08	1.18011	ns	🚨
clickbench_q17/datafusion:parquet	869994616	7.65323e+08	1.13677	ns	🚨
clickbench_q18/datafusion:parquet	1633273926	1.45036e+09	1.12612	ns	🚨
clickbench_q19/datafusion:parquet	40561130	4.18175e+07	0.969956	ns
clickbench_q20/datafusion:parquet	713267026	6.49649e+08	1.09793	ns
clickbench_q21/datafusion:parquet	827178588	7.36928e+08	1.12247	ns	🚨
clickbench_q22/datafusion:parquet	1230761479	1.08055e+09	1.13901	ns	🚨
clickbench_q23/datafusion:parquet	4753646909	4.33961e+09	1.09541	ns
clickbench_q24/datafusion:parquet	110719539	1.14866e+08	0.963904	ns
clickbench_q25/datafusion:parquet	155386519	1.57367e+08	0.987412	ns
clickbench_q26/datafusion:parquet	107655562	1.09245e+08	0.985452	ns
clickbench_q27/datafusion:parquet	1176450025	1.04506e+09	1.12573	ns	🚨
clickbench_q28/datafusion:parquet	6335902852	5.74646e+09	1.10257	ns	🚨
clickbench_q29/datafusion:parquet	277153122	2.42847e+08	1.14126	ns	🚨
clickbench_q30/datafusion:parquet	411930757	3.68837e+08	1.11684	ns	🚨
clickbench_q31/datafusion:parquet	477131306	4.20967e+08	1.13342	ns	🚨
clickbench_q32/datafusion:parquet	1477015241	1.41024e+09	1.04735	ns
clickbench_q33/datafusion:parquet	1862175192	1.62873e+09	1.14333	ns	🚨
clickbench_q34/datafusion:parquet	1831062060	1.61252e+09	1.13552	ns	🚨
clickbench_q35/datafusion:parquet	674047380	6.06055e+08	1.11219	ns	🚨
clickbench_q36/datafusion:parquet	158791780	1.72372e+08	0.921216	ns
clickbench_q37/datafusion:parquet	63929262	6.27173e+07	1.01932	ns
clickbench_q38/datafusion:parquet	104637238	1.00141e+08	1.0449	ns
clickbench_q39/datafusion:parquet	310753649	3.26416e+08	0.952018	ns
clickbench_q40/datafusion:parquet	36430698	3.70795e+07	0.982502	ns
clickbench_q41/datafusion:parquet	34674448	3.35431e+07	1.03373	ns
clickbench_q42/datafusion:parquet	37248327	3.67937e+07	1.01236	ns
clickbench_q00/datafusion:vortex-file-compressed	2109218	2.02267e+06	1.04279	ns
clickbench_q01/datafusion:vortex-file-compressed	13581468	1.18211e+07	1.14892	ns	🚨
clickbench_q02/datafusion:vortex-file-compressed	34279119	2.89994e+07	1.18206	ns	🚨
clickbench_q03/datafusion:vortex-file-compressed	35389842	3.1997e+07	1.10604	ns	🚨
clickbench_q04/datafusion:vortex-file-compressed	352307999	3.20392e+08	1.09962	ns
clickbench_q05/datafusion:vortex-file-compressed	363089841	3.27892e+08	1.10735	ns	🚨
clickbench_q06/datafusion:vortex-file-compressed	2059959	1.90855e+06	1.07933	ns
clickbench_q07/datafusion:vortex-file-compressed	18767580	1.6602e+07	1.13044	ns	🚨
clickbench_q08/datafusion:vortex-file-compressed	438436723	3.88346e+08	1.12898	ns	🚨
clickbench_q09/datafusion:vortex-file-compressed	642638869	5.62457e+08	1.14256	ns	🚨
clickbench_q10/datafusion:vortex-file-compressed	80630491	7.09989e+07	1.13566	ns	🚨
clickbench_q11/datafusion:vortex-file-compressed	97593692	8.16975e+07	1.19457	ns	🚨
clickbench_q12/datafusion:vortex-file-compressed	309220513	2.73292e+08	1.13147	ns	🚨
clickbench_q13/datafusion:vortex-file-compressed	467369758	4.26737e+08	1.09522	ns
clickbench_q14/datafusion:vortex-file-compressed	284554410	2.55267e+08	1.11473	ns	🚨
clickbench_q15/datafusion:vortex-file-compressed	416000821	3.72934e+08	1.11548	ns	🚨
clickbench_q16/datafusion:vortex-file-compressed	850266718	7.45067e+08	1.1412	ns	🚨
clickbench_q17/datafusion:vortex-file-compressed	839584413	7.33872e+08	1.14405	ns	🚨
clickbench_q18/datafusion:vortex-file-compressed	1592308834	1.43739e+09	1.10778	ns	🚨
clickbench_q19/datafusion:vortex-file-compressed	24618601	2.14404e+07	1.14823	ns	🚨
clickbench_q20/datafusion:vortex-file-compressed	369111186	3.22212e+08	1.14556	ns	🚨
clickbench_q21/datafusion:vortex-file-compressed	434852320	3.79008e+08	1.14734	ns	🚨
clickbench_q22/datafusion:vortex-file-compressed	630631534	5.40023e+08	1.16779	ns	🚨
clickbench_q23/datafusion:vortex-file-compressed	1769078117	1.551e+09	1.1406	ns	🚨
clickbench_q24/datafusion:vortex-file-compressed	76156890	6.24953e+07	1.2186	ns	🚨
clickbench_q25/datafusion:vortex-file-compressed	71452359	6.08891e+07	1.17348	ns	🚨
clickbench_q26/datafusion:vortex-file-compressed	72965880	6.3265e+07	1.15334	ns	🚨
clickbench_q27/datafusion:vortex-file-compressed	892283246	8.00847e+08	1.11417	ns	🚨
clickbench_q28/datafusion:vortex-file-compressed	7265682792	6.79319e+09	1.06955	ns
clickbench_q29/datafusion:vortex-file-compressed	276746800	2.45684e+08	1.12643	ns	🚨
clickbench_q30/datafusion:vortex-file-compressed	319508239	2.74485e+08	1.16403	ns	🚨
clickbench_q31/datafusion:vortex-file-compressed	363099980	3.1583e+08	1.14967	ns	🚨
clickbench_q32/datafusion:vortex-file-compressed	1451583874	1.45291e+09	0.999088	ns
clickbench_q33/datafusion:vortex-file-compressed	1664374647	1.5077e+09	1.10392	ns	🚨
clickbench_q34/datafusion:vortex-file-compressed	1639133987	1.44292e+09	1.13598	ns	🚨
clickbench_q35/datafusion:vortex-file-compressed	632488098	5.43168e+08	1.16444	ns	🚨
clickbench_q36/datafusion:vortex-file-compressed	92256896	8.35578e+07	1.10411	ns	🚨
clickbench_q37/datafusion:vortex-file-compressed	41704220	3.95668e+07	1.05402	ns
clickbench_q38/datafusion:vortex-file-compressed	23781201	2.08823e+07	1.13882	ns	🚨
clickbench_q39/datafusion:vortex-file-compressed	171157252	1.71908e+08	0.995633	ns
clickbench_q40/datafusion:vortex-file-compressed	22372018	2.05072e+07	1.09093	ns
clickbench_q41/datafusion:vortex-file-compressed	20192680	1.85091e+07	1.09096	ns
clickbench_q42/datafusion:vortex-file-compressed	23026001	2.1429e+07	1.07453	ns
clickbench_q00/datafusion:vortex-compact	1918901	1.96492e+06	0.976582	ns
clickbench_q01/datafusion:vortex-compact	13699826	1.25081e+07	1.09528	ns
clickbench_q02/datafusion:vortex-compact	35039105	3.05005e+07	1.1488	ns	🚨
clickbench_q03/datafusion:vortex-compact	37440999	3.3692e+07	1.11127	ns	🚨
clickbench_q04/datafusion:vortex-compact	363828642	3.23393e+08	1.12503	ns	🚨
clickbench_q05/datafusion:vortex-compact	384783974	3.40582e+08	1.12978	ns	🚨
clickbench_q06/datafusion:vortex-compact	2008895	1.94171e+06	1.0346	ns
clickbench_q07/datafusion:vortex-compact	20688224	1.70538e+07	1.21311	ns	🚨
clickbench_q08/datafusion:vortex-compact	459021025	4.0066e+08	1.14566	ns	🚨
clickbench_q09/datafusion:vortex-compact	673600232	5.9081e+08	1.14013	ns	🚨
clickbench_q10/datafusion:vortex-compact	87067648	7.11036e+07	1.22452	ns	🚨
clickbench_q11/datafusion:vortex-compact	102603809	8.52558e+07	1.20348	ns	🚨
clickbench_q12/datafusion:vortex-compact	331824737	2.86993e+08	1.15621	ns	🚨
clickbench_q13/datafusion:vortex-compact	502428151	4.35722e+08	1.15309	ns	🚨
clickbench_q14/datafusion:vortex-compact	304247228	2.61372e+08	1.16404	ns	🚨
clickbench_q15/datafusion:vortex-compact	430460154	3.79348e+08	1.13474	ns	🚨
clickbench_q16/datafusion:vortex-compact	868999820	7.64286e+08	1.13701	ns	🚨
clickbench_q17/datafusion:vortex-compact	860578863	7.56264e+08	1.13793	ns	🚨
clickbench_q18/datafusion:vortex-compact	1614453489	1.4065e+09	1.14785	ns	🚨
clickbench_q19/datafusion:vortex-compact	25724775	2.13307e+07	1.206	ns	🚨
clickbench_q20/datafusion:vortex-compact	376137561	3.31023e+08	1.13629	ns	🚨
clickbench_q21/datafusion:vortex-compact	441750001	3.94319e+08	1.12029	ns	🚨
clickbench_q22/datafusion:vortex-compact	592412823	5.69259e+08	1.04067	ns
clickbench_q23/datafusion:vortex-compact	1502954883	1.52504e+09	0.98552	ns
clickbench_q24/datafusion:vortex-compact	70682924	6.71799e+07	1.05214	ns
clickbench_q25/datafusion:vortex-compact	65736549	6.43623e+07	1.02135	ns
clickbench_q26/datafusion:vortex-compact	66274243	6.56531e+07	1.00946	ns
clickbench_q27/datafusion:vortex-compact	797889221	8.0121e+08	0.995855	ns
clickbench_q28/datafusion:vortex-compact	6814141993	6.69948e+09	1.01711	ns
clickbench_q29/datafusion:vortex-compact	258706875	2.52747e+08	1.02358	ns
clickbench_q30/datafusion:vortex-compact	285458890	2.79544e+08	1.02116	ns
clickbench_q31/datafusion:vortex-compact	321801686	3.20124e+08	1.00524	ns
clickbench_q32/datafusion:vortex-compact	1247332345	1.24371e+09	1.00292	ns
clickbench_q33/datafusion:vortex-compact	1440411001	1.4254e+09	1.01053	ns
clickbench_q34/datafusion:vortex-compact	1430632237	1.4339e+09	0.997721	ns
clickbench_q35/datafusion:vortex-compact	564309087	5.6553e+08	0.99784	ns
clickbench_q36/datafusion:vortex-compact	84319662	8.4403e+07	0.999012	ns
clickbench_q37/datafusion:vortex-compact	40287614	3.96729e+07	1.01549	ns
clickbench_q38/datafusion:vortex-compact	23033365	2.16798e+07	1.06244	ns
clickbench_q39/datafusion:vortex-compact	164139686	1.78686e+08	0.918591	ns
clickbench_q40/datafusion:vortex-compact	22139430	2.01021e+07	1.10135	ns	🚨
clickbench_q41/datafusion:vortex-compact	20092951	1.81814e+07	1.10514	ns	🚨
clickbench_q42/datafusion:vortex-compact	22661470	2.26628e+07	0.999942	ns
clickbench_q00/duckdb:parquet	124745955	1.24845e+08	0.999204	ns
clickbench_q01/duckdb:parquet	51437863	5.0175e+07	1.02517	ns
clickbench_q02/duckdb:parquet	65708469	6.43634e+07	1.0209	ns
clickbench_q03/duckdb:parquet	64021869	6.25062e+07	1.02425	ns
clickbench_q04/duckdb:parquet	201193469	1.99453e+08	1.00872	ns
clickbench_q05/duckdb:parquet	269636108	2.69476e+08	1.00059	ns
clickbench_q06/duckdb:parquet	61739204	6.11131e+07	1.01025	ns
clickbench_q07/duckdb:parquet	55772431	5.40687e+07	1.03151	ns
clickbench_q08/duckdb:parquet	262704074	2.6438e+08	0.993662	ns
clickbench_q09/duckdb:parquet	390352619	3.88333e+08	1.0052	ns
clickbench_q10/duckdb:parquet	95235305	9.42378e+07	1.01058	ns
clickbench_q11/duckdb:parquet	106942041	1.05579e+08	1.01291	ns
clickbench_q12/duckdb:parquet	286683121	2.85559e+08	1.00394	ns
clickbench_q13/duckdb:parquet	470074867	4.7221e+08	0.995478	ns
clickbench_q14/duckdb:parquet	321228087	3.21105e+08	1.00038	ns
clickbench_q15/duckdb:parquet	237329996	2.36498e+08	1.00352	ns
clickbench_q16/duckdb:parquet	567705068	5.6768e+08	1.00004	ns
clickbench_q17/duckdb:parquet	473323898	4.7332e+08	1.00001	ns
clickbench_q18/duckdb:parquet	978210120	9.78586e+08	0.999616	ns
clickbench_q19/duckdb:parquet	48318721	4.72072e+07	1.02355	ns
clickbench_q20/duckdb:parquet	406689361	4.06197e+08	1.00121	ns
clickbench_q21/duckdb:parquet	522810791	5.21847e+08	1.00185	ns
clickbench_q22/duckdb:parquet	910266440	9.07125e+08	1.00346	ns
clickbench_q23/duckdb:parquet	274139935	2.82527e+08	0.970315	ns
clickbench_q24/duckdb:parquet	80958663	7.75815e+07	1.04353	ns
clickbench_q25/duckdb:parquet	139626450	1.39882e+08	0.998176	ns
clickbench_q26/duckdb:parquet	53832123	5.22878e+07	1.02954	ns
clickbench_q27/duckdb:parquet	615951535	6.17581e+08	0.997361	ns
clickbench_q28/duckdb:parquet	4873689372	4.83374e+09	1.00827	ns
clickbench_q29/duckdb:parquet	62893534	6.23207e+07	1.00919	ns
clickbench_q30/duckdb:parquet	306420826	3.0942e+08	0.990308	ns
clickbench_q31/duckdb:parquet	344516073	3.45328e+08	0.997648	ns
clickbench_q32/duckdb:parquet	1044446839	1.04335e+09	1.00105	ns
clickbench_q33/duckdb:parquet	1059026706	1.05968e+09	0.999384	ns
clickbench_q34/duckdb:parquet	1103173837	1.09594e+09	1.0066	ns
clickbench_q35/duckdb:parquet	353528455	3.48441e+08	1.0146	ns
clickbench_q36/duckdb:parquet	60848498	6.00955e+07	1.01253	ns
clickbench_q37/duckdb:parquet	48460190	4.92603e+07	0.983757	ns
clickbench_q38/duckdb:parquet	50705417	5.11924e+07	0.990488	ns
clickbench_q39/duckdb:parquet	94080344	1.04797e+08	0.897735	ns	🚀
clickbench_q40/duckdb:parquet	55200630	5.44401e+07	1.01397	ns
clickbench_q41/duckdb:parquet	56721157	5.58398e+07	1.01578	ns
clickbench_q42/duckdb:parquet	44204671	4.14405e+07	1.0667	ns
clickbench_q00/duckdb:vortex-file-compressed	15080148	1.3658e+07	1.10413	ns	🚨
clickbench_q01/duckdb:vortex-file-compressed	24543557	2.46685e+07	0.994937	ns
clickbench_q02/duckdb:vortex-file-compressed	37006973	3.63836e+07	1.01713	ns
clickbench_q03/duckdb:vortex-file-compressed	42618576	4.08097e+07	1.04432	ns
clickbench_q04/duckdb:vortex-file-compressed	204989647	1.76087e+08	1.16414	ns	🚨
clickbench_q05/duckdb:vortex-file-compressed	207772365	2.02289e+08	1.02711	ns
clickbench_q06/duckdb:vortex-file-compressed	40885260	3.96342e+07	1.03156	ns
clickbench_q07/duckdb:vortex-file-compressed	26177493	2.49023e+07	1.05121	ns
clickbench_q08/duckdb:vortex-file-compressed	264475961	2.67706e+08	0.987933	ns
clickbench_q09/duckdb:vortex-file-compressed	351471651	3.52968e+08	0.995761	ns
clickbench_q10/duckdb:vortex-file-compressed	81365297	7.78904e+07	1.04461	ns
clickbench_q11/duckdb:vortex-file-compressed	90438298	8.72035e+07	1.0371	ns
clickbench_q12/duckdb:vortex-file-compressed	210601905	2.12978e+08	0.988844	ns
clickbench_q13/duckdb:vortex-file-compressed	466945506	4.69459e+08	0.994645	ns
clickbench_q14/duckdb:vortex-file-compressed	295318484	2.95976e+08	0.997777	ns
clickbench_q15/duckdb:vortex-file-compressed	214173361	2.15009e+08	0.996112	ns
clickbench_q16/duckdb:vortex-file-compressed	1004432169	9.68988e+08	1.03658	ns
clickbench_q17/duckdb:vortex-file-compressed	893715547	8.77903e+08	1.01801	ns
clickbench_q18/duckdb:vortex-file-compressed	1537498463	1.52436e+09	1.00862	ns
clickbench_q19/duckdb:vortex-file-compressed	31933904	3.09685e+07	1.03117	ns
clickbench_q20/duckdb:vortex-file-compressed	357054401	3.58213e+08	0.996766	ns
clickbench_q21/duckdb:vortex-file-compressed	392851164	3.76435e+08	1.04361	ns
clickbench_q22/duckdb:vortex-file-compressed	595071578	5.82782e+08	1.02109	ns
clickbench_q23/duckdb:vortex-file-compressed	1195719698	1.06711e+09	1.12052	ns	🚨
clickbench_q24/duckdb:vortex-file-compressed	61429676	5.35345e+07	1.14748	ns	🚨
clickbench_q25/duckdb:vortex-file-compressed	72759126	7.11716e+07	1.02231	ns
clickbench_q26/duckdb:vortex-file-compressed	53384724	5.62217e+07	0.949539	ns
clickbench_q27/duckdb:vortex-file-compressed	449562679	4.45579e+08	1.00894	ns
clickbench_q28/duckdb:vortex-file-compressed	3157635911	3.13172e+09	1.00828	ns
clickbench_q29/duckdb:vortex-file-compressed	38734167	3.88575e+07	0.996826	ns
clickbench_q30/duckdb:vortex-file-compressed	212146750	2.18099e+08	0.972708	ns
clickbench_q31/duckdb:vortex-file-compressed	283599078	2.79951e+08	1.01303	ns
clickbench_q32/duckdb:vortex-file-compressed	1143504104	1.13443e+09	1.008	ns
clickbench_q33/duckdb:vortex-file-compressed	1088336528	1.07388e+09	1.01346	ns
clickbench_q34/duckdb:vortex-file-compressed	1573505937	1.55356e+09	1.01284	ns
clickbench_q35/duckdb:vortex-file-compressed	365423748	3.72096e+08	0.98207	ns
clickbench_q36/duckdb:vortex-file-compressed	30951865	3.1297e+07	0.988973	ns
clickbench_q37/duckdb:vortex-file-compressed	23217349	2.40865e+07	0.963917	ns
clickbench_q38/duckdb:vortex-file-compressed	24634815	2.45647e+07	1.00286	ns
clickbench_q39/duckdb:vortex-file-compressed	48053624	4.83454e+07	0.993965	ns
clickbench_q40/duckdb:vortex-file-compressed	22001496	2.21536e+07	0.993134	ns
clickbench_q41/duckdb:vortex-file-compressed	22266809	2.22566e+07	1.00046	ns
clickbench_q42/duckdb:vortex-file-compressed	27247480	2.60604e+07	1.04555	ns
clickbench_q00/duckdb:vortex-compact	15976116	1.52798e+07	1.04557	ns
clickbench_q01/duckdb:vortex-compact	46643864	4.39552e+07	1.06117	ns
clickbench_q02/duckdb:vortex-compact	52249996	5.1161e+07	1.02128	ns
clickbench_q03/duckdb:vortex-compact	50247873	4.96704e+07	1.01163	ns
clickbench_q04/duckdb:vortex-compact	213876629	2.14859e+08	0.995428	ns
clickbench_q05/duckdb:vortex-compact	231913695	2.40628e+08	0.963787	ns
clickbench_q06/duckdb:vortex-compact	41656648	4.22594e+07	0.985737	ns
clickbench_q07/duckdb:vortex-compact	55951791	5.58142e+07	1.00246	ns
clickbench_q08/duckdb:vortex-compact	284632593	2.87226e+08	0.990971	ns
clickbench_q09/duckdb:vortex-compact	410184737	4.13421e+08	0.992173	ns
clickbench_q10/duckdb:vortex-compact	124755738	1.25283e+08	0.99579	ns
clickbench_q11/duckdb:vortex-compact	147050342	1.4459e+08	1.01701	ns
clickbench_q12/duckdb:vortex-compact	273786119	2.74154e+08	0.998658	ns
clickbench_q13/duckdb:vortex-compact	535515678	5.40394e+08	0.990974	ns
clickbench_q14/duckdb:vortex-compact	366885697	3.74195e+08	0.980467	ns
clickbench_q15/duckdb:vortex-compact	253955428	2.5479e+08	0.996723	ns
clickbench_q16/duckdb:vortex-compact	1037758457	1.04125e+09	0.996644	ns
clickbench_q17/duckdb:vortex-compact	940968765	9.33616e+08	1.00788	ns
clickbench_q18/duckdb:vortex-compact	1539284846	1.56624e+09	0.982789	ns
clickbench_q19/duckdb:vortex-compact	33797225	3.44533e+07	0.980958	ns
clickbench_q20/duckdb:vortex-compact	432743102	4.35092e+08	0.994601	ns
clickbench_q21/duckdb:vortex-compact	492732697	4.86948e+08	1.01188	ns
clickbench_q22/duckdb:vortex-compact	826896779	8.2174e+08	1.00628	ns
clickbench_q23/duckdb:vortex-compact	1600424447	1.71776e+09	0.931691	ns
clickbench_q24/duckdb:vortex-compact	97946615	1.01867e+08	0.961518	ns
clickbench_q25/duckdb:vortex-compact	134310349	1.34893e+08	0.995683	ns
clickbench_q26/duckdb:vortex-compact	74087017	8.43235e+07	0.878604	ns	🚀
clickbench_q27/duckdb:vortex-compact	607687558	6.11677e+08	0.993477	ns
clickbench_q28/duckdb:vortex-compact	3237581584	3.21905e+09	1.00576	ns
clickbench_q29/duckdb:vortex-compact	47908497	4.75594e+07	1.00734	ns
clickbench_q30/duckdb:vortex-compact	299401717	2.97552e+08	1.00622	ns
clickbench_q31/duckdb:vortex-compact	359021738	3.54255e+08	1.01345	ns
clickbench_q32/duckdb:vortex-compact	1171862972	1.15696e+09	1.01288	ns
clickbench_q33/duckdb:vortex-compact	1127915216	1.13662e+09	0.992345	ns
clickbench_q34/duckdb:vortex-compact	1654952718	1.65923e+09	0.997421	ns
clickbench_q35/duckdb:vortex-compact	365926986	3.68455e+08	0.99314	ns
clickbench_q36/duckdb:vortex-compact	34515658	3.535e+07	0.976396	ns
clickbench_q37/duckdb:vortex-compact	28808514	2.85994e+07	1.00731	ns
clickbench_q38/duckdb:vortex-compact	28428676	2.87393e+07	0.989193	ns
clickbench_q39/duckdb:vortex-compact	53404945	5.33052e+07	1.00187	ns
clickbench_q40/duckdb:vortex-compact	34180888	3.07123e+07	1.11294	ns	🚨
clickbench_q41/duckdb:vortex-compact	30523290	2.89666e+07	1.05374	ns
clickbench_q42/duckdb:vortex-compact	28623951	2.86807e+07	0.998021	ns
clickbench_q00/duckdb:duckdb	19056668	1.86486e+07	1.02188	ns
clickbench_q01/duckdb:duckdb	37791253	3.78952e+07	0.997258	ns
clickbench_q02/duckdb:duckdb	45908148	4.61123e+07	0.995572	ns
clickbench_q03/duckdb:duckdb	47881199	4.81372e+07	0.994682	ns
clickbench_q04/duckdb:duckdb	199589098	1.90531e+08	1.04754	ns
clickbench_q05/duckdb:duckdb	297486085	2.97993e+08	0.9983	ns
clickbench_q06/duckdb:duckdb	36512149	3.60464e+07	1.01292	ns
clickbench_q07/duckdb:duckdb	38704187	3.86206e+07	1.00217	ns
clickbench_q08/duckdb:duckdb	247917426	2.51487e+08	0.985805	ns
clickbench_q09/duckdb:duckdb	362407008	3.65054e+08	0.992748	ns
clickbench_q10/duckdb:duckdb	110224952	1.14044e+08	0.966511	ns
clickbench_q11/duckdb:duckdb	120795263	1.25181e+08	0.964963	ns
clickbench_q12/duckdb:duckdb	263697711	2.68931e+08	0.980541	ns
clickbench_q13/duckdb:duckdb	448038654	4.47349e+08	1.00154	ns
clickbench_q14/duckdb:duckdb	287009636	2.91617e+08	0.984202	ns
clickbench_q15/duckdb:duckdb	219971758	2.20056e+08	0.999619	ns
clickbench_q16/duckdb:duckdb	538544930	5.45425e+08	0.987386	ns
clickbench_q17/duckdb:duckdb	454696711	4.59548e+08	0.989444	ns
clickbench_q18/duckdb:duckdb	946489081	9.48648e+08	0.997724	ns
clickbench_q19/duckdb:duckdb	37213509	3.73554e+07	0.996202	ns
clickbench_q20/duckdb:duckdb	443809959	4.51051e+08	0.983947	ns
clickbench_q21/duckdb:duckdb	468593590	4.7775e+08	0.980834	ns
clickbench_q22/duckdb:duckdb	533918774	5.43014e+08	0.98325	ns
clickbench_q23/duckdb:duckdb	232804608	2.76333e+08	0.842478	ns	🚀
clickbench_q24/duckdb:duckdb	48096281	4.95257e+07	0.971138	ns
clickbench_q25/duckdb:duckdb	111291794	1.1179e+08	0.995547	ns
clickbench_q26/duckdb:duckdb	46079669	4.74974e+07	0.970152	ns
clickbench_q27/duckdb:duckdb	525595316	5.33011e+08	0.986086	ns
clickbench_q28/duckdb:duckdb	4478875131	4.48874e+09	0.997802	ns
clickbench_q29/duckdb:duckdb	50272181	4.98244e+07	1.00899	ns
clickbench_q30/duckdb:duckdb	268957203	2.70477e+08	0.994381	ns
clickbench_q31/duckdb:duckdb	335953211	3.40999e+08	0.985202	ns
clickbench_q32/duckdb:duckdb	1020379395	1.02048e+09	0.999903	ns
clickbench_q33/duckdb:duckdb	1059974193	1.07066e+09	0.990015	ns
clickbench_q34/duckdb:duckdb	1134695961	1.14642e+09	0.989769	ns
clickbench_q35/duckdb:duckdb	264156039	2.66299e+08	0.991951	ns
clickbench_q36/duckdb:duckdb	43047503	4.51757e+07	0.95289	ns
clickbench_q37/duckdb:duckdb	32816447	3.27892e+07	1.00083	ns
clickbench_q38/duckdb:duckdb	33829127	3.42717e+07	0.987086	ns
clickbench_q39/duckdb:duckdb	71907775	7.25579e+07	0.99104	ns
clickbench_q40/duckdb:duckdb	33306391	3.28618e+07	1.01353	ns
clickbench_q41/duckdb:duckdb	33766742	3.34411e+07	1.00974	ns
clickbench_q42/duckdb:duckdb	32784392	3.24412e+07	1.01058	ns

[github-actions[bot]]

Benchmarks: Statistical and Population Genetics

Summary

• Overall: 1.025x ➖
• Vortex: 0.966x ➖
• duckdb:vortex: 0.966x ➖
• Best: statpopgen_q08/duckdb:vortex-compact (0.032x)
• Worst: statpopgen_q07/duckdb:vortex-file-compressed (1.704x)
• Significant (>10%): 2↑ 13↓

Detailed Results Table

name	PR cb25f3c0	base 69377e1f	ratio (PR/base)	unit	remark
statpopgen_q00/duckdb:parquet	249867427	1.97188e+08	1.26716	ns	🚨
statpopgen_q01/duckdb:parquet	412401898	3.33158e+08	1.23786	ns	🚨
statpopgen_q02/duckdb:parquet	782055728	6.51684e+08	1.20005	ns	🚨
statpopgen_q03/duckdb:parquet	1242951494	1.08182e+09	1.14894	ns	🚨
statpopgen_q04/duckdb:parquet	1234821525	1.07042e+09	1.15358	ns	🚨
statpopgen_q05/duckdb:parquet	807121537	7.08091e+08	1.13986	ns	🚨
statpopgen_q06/duckdb:parquet	1413151597	1.29238e+09	1.09345	ns
statpopgen_q07/duckdb:parquet	925426890	8.41506e+08	1.09973	ns
statpopgen_q08/duckdb:parquet	931147785	8.3031e+08	1.12145	ns	🚨
statpopgen_q09/duckdb:parquet	1025923117	8.98524e+08	1.14179	ns	🚨
statpopgen_q10/duckdb:parquet	2324203262	2.08653e+09	1.11391	ns	🚨
statpopgen_q00/duckdb:vortex-file-compressed	15371357	1.28899e+07	1.19251	ns	🚨
statpopgen_q01/duckdb:vortex-file-compressed	131098795	9.98649e+07	1.31276	ns	🚨
statpopgen_q02/duckdb:vortex-file-compressed	1353178110	1.18856e+09	1.1385	ns	🚨
statpopgen_q03/duckdb:vortex-file-compressed	3151344793	2.79512e+09	1.12744	ns	🚨
statpopgen_q04/duckdb:vortex-file-compressed	3101024415	2.81368e+09	1.10212	ns	🚨
statpopgen_q05/duckdb:vortex-file-compressed	1415874373	1.26949e+09	1.11531	ns	🚨
statpopgen_q06/duckdb:vortex-file-compressed	2073646006	1.96353e+09	1.05608	ns
statpopgen_q07/duckdb:vortex-file-compressed	733547888	4.30513e+08	1.70389	ns	🚨
statpopgen_q08/duckdb:vortex-file-compressed	739699774	4.40894e+08	1.67773	ns	🚨
statpopgen_q09/duckdb:vortex-file-compressed	2821701495	2.55184e+09	1.10575	ns	🚨
statpopgen_q10/duckdb:vortex-file-compressed	4532726687	4.11279e+09	1.10211	ns	🚨
statpopgen_q00/duckdb:vortex-compact	14695351	1.33046e+07	1.10453	ns	🚨
statpopgen_q01/duckdb:vortex-compact	367652861	2.38613e+08	1.54079	ns	🚨
statpopgen_q02/duckdb:vortex-compact	676870851	5.70239e+08	1.18699	ns	🚨
statpopgen_q03/duckdb:vortex-compact	2438758890	2.29114e+09	1.06443	ns
statpopgen_q04/duckdb:vortex-compact	2382231996	2.29905e+09	1.03618	ns
statpopgen_q05/duckdb:vortex-compact	624102961	6.38547e+08	0.97738	ns
statpopgen_q06/duckdb:vortex-compact	1536392307	1.57235e+09	0.977134	ns
statpopgen_q07/duckdb:vortex-compact	1880360042	2.88915e+09	0.650836	ns	🚀
statpopgen_q08/duckdb:vortex-compact	4283258456	1.35273e+11	0.0316639	ns	🚀
statpopgen_q09/duckdb:vortex-compact	2173206148	2.01902e+09	1.07637	ns
statpopgen_q10/duckdb:vortex-compact	4087184100	3.78922e+09	1.07864	ns

[github-actions[bot]]

Benchmarks: TPC-H SF=1 on NVME

Summary

• Overall: 1.040x ➖
• Vortex: 1.060x ➖
• duckdb:vortex: 1.029x ➖
• datafusion:vortex: 1.092x ➖
• Best: tpch_q18/datafusion:vortex-file-compressed (0.894x)
• Worst: tpch_q14/datafusion:vortex-file-compressed (1.202x)
• Significant (>10%): 1↑ 22↓

Detailed Results Table

name	PR cb25f3c0	base 69377e1f	ratio (PR/base)	unit	remark
tpch_q01/datafusion:arrow	51057136	6.37823e+07	0.80049	ns	🚀
tpch_q02/datafusion:arrow	16931082	1.83469e+07	0.922832	ns
tpch_q03/datafusion:arrow	17852997	2.27288e+07	0.785478	ns	🚀
tpch_q04/datafusion:arrow	14477870	1.28011e+07	1.13098	ns	🚨
tpch_q05/datafusion:arrow	38852177	3.38327e+07	1.14836	ns	🚨
tpch_q06/datafusion:arrow	7323335	9.28694e+06	0.788563	ns	🚀
tpch_q07/datafusion:arrow	147708317	5.20889e+07	2.8357	ns	🚨
tpch_q08/datafusion:arrow	18150798	1.92137e+07	0.94468	ns
tpch_q09/datafusion:arrow	51703430	3.22567e+07	1.60287	ns	🚨
tpch_q10/datafusion:arrow	32781405	2.80205e+07	1.16991	ns	🚨
tpch_q11/datafusion:arrow	8873381	3.93595e+07	0.225445	ns	🚀
tpch_q12/datafusion:arrow	19712991	1.94739e+07	1.01228	ns
tpch_q13/datafusion:arrow	18466037	1.82349e+07	1.01267	ns
tpch_q14/datafusion:arrow	7622290	7.37461e+06	1.03359	ns
tpch_q15/datafusion:arrow	14533320	1.33225e+07	1.09088	ns
tpch_q16/datafusion:arrow	16519590	1.51412e+07	1.09103	ns
tpch_q17/datafusion:arrow	52757827	4.94962e+07	1.0659	ns
tpch_q18/datafusion:arrow	86043016	1.03801e+08	0.828921	ns	🚀
tpch_q19/datafusion:arrow	15669294	1.66729e+07	0.939807	ns
tpch_q20/datafusion:arrow	19247409	2.22928e+07	0.86339	ns	🚀
tpch_q21/datafusion:arrow	263982407	7.64821e+07	3.45156	ns	🚨
tpch_q22/datafusion:arrow	11725575	1.04546e+07	1.12157	ns	🚨
tpch_q01/datafusion:parquet	166747148	1.88344e+08	0.885331	ns	🚀
tpch_q02/datafusion:parquet	96895265	9.40921e+07	1.02979	ns
tpch_q03/datafusion:parquet	78068760	9.19128e+07	0.849378	ns	🚀
tpch_q04/datafusion:parquet	61158982	5.62892e+07	1.08651	ns
tpch_q05/datafusion:parquet	117432506	1.07747e+08	1.08989	ns
tpch_q06/datafusion:parquet	46666545	3.40672e+07	1.36984	ns	🚨
tpch_q07/datafusion:parquet	140591623	1.32938e+08	1.05758	ns
tpch_q08/datafusion:parquet	118979874	1.28619e+08	0.925056	ns
tpch_q09/datafusion:parquet	166106210	1.56597e+08	1.06072	ns
tpch_q10/datafusion:parquet	142049093	1.3235e+08	1.07328	ns
tpch_q11/datafusion:parquet	78282081	6.96484e+07	1.12396	ns	🚨
tpch_q12/datafusion:parquet	88558299	8.58607e+07	1.03142	ns
tpch_q13/datafusion:parquet	209758877	2.0316e+08	1.03248	ns
tpch_q14/datafusion:parquet	57168576	5.14102e+07	1.11201	ns	🚨
tpch_q15/datafusion:parquet	69099840	6.06306e+07	1.13969	ns	🚨
tpch_q16/datafusion:parquet	55423196	4.83999e+07	1.14511	ns	🚨
tpch_q17/datafusion:parquet	155939278	1.38894e+08	1.12273	ns	🚨
tpch_q18/datafusion:parquet	184759669	1.90472e+08	0.970009	ns
tpch_q19/datafusion:parquet	96935981	1.03557e+08	0.93606	ns
tpch_q20/datafusion:parquet	85585760	7.33973e+07	1.16606	ns	🚨
tpch_q21/datafusion:parquet	150398942	1.46582e+08	1.02604	ns
tpch_q22/datafusion:parquet	69099109	6.97245e+07	0.99103	ns
tpch_q01/datafusion:vortex-file-compressed	66273782	6.43452e+07	1.02997	ns
tpch_q02/datafusion:vortex-file-compressed	44776364	3.85819e+07	1.16055	ns	🚨
tpch_q03/datafusion:vortex-file-compressed	29076679	2.69712e+07	1.07806	ns
tpch_q04/datafusion:vortex-file-compressed	20117112	1.87204e+07	1.07461	ns
tpch_q05/datafusion:vortex-file-compressed	77069095	6.76295e+07	1.13958	ns	🚨
tpch_q06/datafusion:vortex-file-compressed	11685141	9.90302e+06	1.17996	ns	🚨
tpch_q07/datafusion:vortex-file-compressed	83730805	7.47989e+07	1.11941	ns	🚨
tpch_q08/datafusion:vortex-file-compressed	50734819	4.48219e+07	1.13192	ns	🚨
tpch_q09/datafusion:vortex-file-compressed	67701156	6.2455e+07	1.084	ns
tpch_q10/datafusion:vortex-file-compressed	57522572	4.87316e+07	1.1804	ns	🚨
tpch_q11/datafusion:vortex-file-compressed	29676570	2.71952e+07	1.09124	ns
tpch_q12/datafusion:vortex-file-compressed	25594329	2.34547e+07	1.09122	ns
tpch_q13/datafusion:vortex-file-compressed	30041578	2.99867e+07	1.00183	ns
tpch_q14/datafusion:vortex-file-compressed	17296088	1.43945e+07	1.20157	ns	🚨
tpch_q15/datafusion:vortex-file-compressed	26560140	2.22746e+07	1.1924	ns	🚨
tpch_q16/datafusion:vortex-file-compressed	24924380	2.25262e+07	1.10646	ns	🚨
tpch_q17/datafusion:vortex-file-compressed	64967870	6.10723e+07	1.06379	ns
tpch_q18/datafusion:vortex-file-compressed	88607539	9.91377e+07	0.893782	ns	🚀
tpch_q19/datafusion:vortex-file-compressed	24266285	2.22486e+07	1.09069	ns
tpch_q20/datafusion:vortex-file-compressed	33068121	2.85572e+07	1.15796	ns	🚨
tpch_q21/datafusion:vortex-file-compressed	77740541	7.43551e+07	1.04553	ns
tpch_q22/datafusion:vortex-file-compressed	18580913	1.77019e+07	1.04966	ns
tpch_q01/datafusion:vortex-compact	70502839	6.78463e+07	1.03915	ns
tpch_q02/datafusion:vortex-compact	48909834	4.33728e+07	1.12766	ns	🚨
tpch_q03/datafusion:vortex-compact	33425043	2.95045e+07	1.13288	ns	🚨
tpch_q04/datafusion:vortex-compact	23771959	2.27129e+07	1.04663	ns
tpch_q05/datafusion:vortex-compact	82647624	7.03497e+07	1.17481	ns	🚨
tpch_q06/datafusion:vortex-compact	17686950	1.59415e+07	1.10949	ns	🚨
tpch_q07/datafusion:vortex-compact	88295952	8.06168e+07	1.09526	ns
tpch_q08/datafusion:vortex-compact	56517156	4.99876e+07	1.13062	ns	🚨
tpch_q09/datafusion:vortex-compact	74671634	6.56311e+07	1.13775	ns	🚨
tpch_q10/datafusion:vortex-compact	56609697	5.04592e+07	1.12189	ns	🚨
tpch_q11/datafusion:vortex-compact	30606425	2.88324e+07	1.06153	ns
tpch_q12/datafusion:vortex-compact	35125962	3.0379e+07	1.15626	ns	🚨
tpch_q13/datafusion:vortex-compact	36846358	3.61411e+07	1.01951	ns
tpch_q14/datafusion:vortex-compact	22127095	1.91652e+07	1.15454	ns	🚨
tpch_q15/datafusion:vortex-compact	36937678	3.3383e+07	1.10648	ns	🚨
tpch_q16/datafusion:vortex-compact	29576362	2.84928e+07	1.03803	ns
tpch_q17/datafusion:vortex-compact	71342833	6.70016e+07	1.06479	ns
tpch_q18/datafusion:vortex-compact	90554476	9.85109e+07	0.919233	ns
tpch_q19/datafusion:vortex-compact	40105941	3.69153e+07	1.08643	ns
tpch_q20/datafusion:vortex-compact	41308893	3.47746e+07	1.1879	ns	🚨
tpch_q21/datafusion:vortex-compact	83623784	8.25407e+07	1.01312	ns
tpch_q22/datafusion:vortex-compact	17623083	1.64726e+07	1.06984	ns
tpch_q01/duckdb:parquet	80386824	8.04618e+07	0.999068	ns
tpch_q02/duckdb:parquet	46929923	4.7458e+07	0.988872	ns
tpch_q03/duckdb:parquet	76856336	7.70694e+07	0.997235	ns
tpch_q04/duckdb:parquet	64766377	7.11734e+07	0.90998	ns
tpch_q05/duckdb:parquet	81843014	7.45125e+07	1.09838	ns
tpch_q06/duckdb:parquet	23132359	3.18613e+07	0.726033	ns	🚀
tpch_q07/duckdb:parquet	93255379	8.10148e+07	1.15109	ns	🚨
tpch_q08/duckdb:parquet	96284175	9.69609e+07	0.99302	ns
tpch_q09/duckdb:parquet	144815677	1.6132e+08	0.897692	ns	🚀
tpch_q10/duckdb:parquet	152471259	1.50432e+08	1.01356	ns
tpch_q11/duckdb:parquet	25767469	2.60261e+07	0.990062	ns
tpch_q12/duckdb:parquet	73724999	5.91792e+07	1.24579	ns	🚨
tpch_q13/duckdb:parquet	272745708	2.7127e+08	1.00544	ns
tpch_q14/duckdb:parquet	53535271	6.90365e+07	0.775463	ns	🚀
tpch_q15/duckdb:parquet	29279603	2.90311e+07	1.00856	ns
tpch_q16/duckdb:parquet	59590567	6.01122e+07	0.991323	ns
tpch_q17/duckdb:parquet	74632751	7.0636e+07	1.05658	ns
tpch_q18/duckdb:parquet	134138132	1.26604e+08	1.05951	ns
tpch_q19/duckdb:parquet	76022542	9.04557e+07	0.840439	ns	🚀
tpch_q20/duckdb:parquet	86494474	7.1588e+07	1.20823	ns	🚨
tpch_q21/duckdb:parquet	187454132	1.82263e+08	1.02848	ns
tpch_q22/duckdb:parquet	56440303	5.689e+07	0.992095	ns
tpch_q01/duckdb:vortex-file-compressed	30053887	3.04258e+07	0.987778	ns
tpch_q02/duckdb:vortex-file-compressed	27849318	2.85033e+07	0.977055	ns
tpch_q03/duckdb:vortex-file-compressed	31354028	3.07715e+07	1.01893	ns
tpch_q04/duckdb:vortex-file-compressed	36151871	3.57879e+07	1.01017	ns
tpch_q05/duckdb:vortex-file-compressed	38851240	3.75304e+07	1.03519	ns
tpch_q06/duckdb:vortex-file-compressed	10788137	1.02068e+07	1.05695	ns
tpch_q07/duckdb:vortex-file-compressed	40674390	3.91162e+07	1.03984	ns
tpch_q08/duckdb:vortex-file-compressed	47206733	4.46238e+07	1.05788	ns
tpch_q09/duckdb:vortex-file-compressed	73961700	7.2172e+07	1.0248	ns
tpch_q10/duckdb:vortex-file-compressed	36216605	3.41073e+07	1.06184	ns
tpch_q11/duckdb:vortex-file-compressed	17082752	1.60702e+07	1.06301	ns
tpch_q12/duckdb:vortex-file-compressed	25080275	2.47947e+07	1.01152	ns
tpch_q13/duckdb:vortex-file-compressed	38742218	3.77565e+07	1.02611	ns
tpch_q14/duckdb:vortex-file-compressed	25386718	2.41526e+07	1.0511	ns
tpch_q15/duckdb:vortex-file-compressed	17781405	1.70627e+07	1.04212	ns
tpch_q16/duckdb:vortex-file-compressed	34278530	3.31389e+07	1.03439	ns
tpch_q17/duckdb:vortex-file-compressed	26278252	2.64245e+07	0.994466	ns
tpch_q18/duckdb:vortex-file-compressed	52741148	5.0637e+07	1.04155	ns
tpch_q19/duckdb:vortex-file-compressed	32411845	3.21084e+07	1.00945	ns
tpch_q20/duckdb:vortex-file-compressed	35350477	3.37891e+07	1.04621	ns
tpch_q21/duckdb:vortex-file-compressed	104121295	1.04277e+08	0.99851	ns
tpch_q22/duckdb:vortex-file-compressed	20849325	2.07057e+07	1.00694	ns
tpch_q01/duckdb:vortex-compact	34307973	3.42256e+07	1.00241	ns
tpch_q02/duckdb:vortex-compact	39876565	3.6869e+07	1.08158	ns
tpch_q03/duckdb:vortex-compact	40869494	3.98207e+07	1.02634	ns
tpch_q04/duckdb:vortex-compact	44140156	4.30102e+07	1.02627	ns
tpch_q05/duckdb:vortex-compact	42642751	4.22881e+07	1.00839	ns
tpch_q06/duckdb:vortex-compact	18920341	1.65811e+07	1.14108	ns	🚨
tpch_q07/duckdb:vortex-compact	49804637	4.83359e+07	1.03039	ns
tpch_q08/duckdb:vortex-compact	57144628	5.57046e+07	1.02585	ns
tpch_q09/duckdb:vortex-compact	82542103	7.93396e+07	1.04036	ns
tpch_q10/duckdb:vortex-compact	46159048	4.39783e+07	1.04959	ns
tpch_q11/duckdb:vortex-compact	22041876	2.08696e+07	1.05617	ns
tpch_q12/duckdb:vortex-compact	50700009	4.92459e+07	1.02953	ns
tpch_q13/duckdb:vortex-compact	45033754	4.4503e+07	1.01193	ns
tpch_q14/duckdb:vortex-compact	32492278	2.96883e+07	1.09445	ns
tpch_q15/duckdb:vortex-compact	21171721	2.11763e+07	0.999784	ns
tpch_q16/duckdb:vortex-compact	40643627	4.083e+07	0.995435	ns
tpch_q17/duckdb:vortex-compact	30948581	2.95586e+07	1.04702	ns
tpch_q18/duckdb:vortex-compact	58707430	5.70056e+07	1.02985	ns
tpch_q19/duckdb:vortex-compact	40866564	4.11791e+07	0.992411	ns
tpch_q20/duckdb:vortex-compact	45759064	4.54345e+07	1.00714	ns
tpch_q21/duckdb:vortex-compact	117140451	1.15449e+08	1.01465	ns
tpch_q22/duckdb:vortex-compact	22447993	2.24391e+07	1.0004	ns
tpch_q01/duckdb:duckdb	17538154	1.75143e+07	1.00136	ns
tpch_q02/duckdb:duckdb	14317121	1.48549e+07	0.9638	ns
tpch_q03/duckdb:duckdb	22542675	2.217e+07	1.01681	ns
tpch_q04/duckdb:duckdb	20369483	1.99287e+07	1.02212	ns
tpch_q05/duckdb:duckdb	22543033	2.23345e+07	1.00933	ns
tpch_q06/duckdb:duckdb	7305616	7.36116e+06	0.992454	ns
tpch_q07/duckdb:duckdb	26791856	2.67144e+07	1.0029	ns
tpch_q08/duckdb:duckdb	26698469	2.68022e+07	0.996131	ns
tpch_q09/duckdb:duckdb	61043937	6.06383e+07	1.00669	ns
tpch_q10/duckdb:duckdb	58066156	6.16292e+07	0.942185	ns
tpch_q11/duckdb:duckdb	7299726	7.16822e+06	1.01835	ns
tpch_q12/duckdb:duckdb	17563929	1.76274e+07	0.996399	ns
tpch_q13/duckdb:duckdb	40537967	4.07557e+07	0.994658	ns
tpch_q14/duckdb:duckdb	23052117	2.25554e+07	1.02202	ns
tpch_q15/duckdb:duckdb	14509592	1.41666e+07	1.02421	ns
tpch_q16/duckdb:duckdb	25385933	2.47771e+07	1.02457	ns
tpch_q17/duckdb:duckdb	18242773	1.81892e+07	1.00295	ns
tpch_q18/duckdb:duckdb	39712265	3.98347e+07	0.996927	ns
tpch_q19/duckdb:duckdb	32501320	3.20945e+07	1.01267	ns
tpch_q20/duckdb:duckdb	26750313	2.66869e+07	1.00238	ns
tpch_q21/duckdb:duckdb	62696183	6.30809e+07	0.993901	ns
tpch_q22/duckdb:duckdb	27131434	2.67004e+07	1.01614	ns

[github-actions[bot]]

Benchmarks: TPC-H SF=1 on S3

Summary

• Overall: 1.036x ➖
• Vortex: 1.047x ➖
• duckdb:vortex: 1.031x ➖
• datafusion:vortex: 1.062x ➖
• Best: tpch_q08/datafusion:vortex-file-compressed (0.730x)
• Worst: tpch_q15/datafusion:vortex-compact (1.262x)
• Significant (>30%): 0↑ 0↓

Detailed Results Table

name	PR cb25f3c0	base 69377e1f	ratio (PR/base)	unit	remark
tpch_q01/datafusion:parquet	222284584	2.67941e+08	0.829604	ns
tpch_q02/datafusion:parquet	393670272	3.77009e+08	1.04419	ns
tpch_q03/datafusion:parquet	307520810	3.04681e+08	1.00932	ns
tpch_q04/datafusion:parquet	143116786	1.36431e+08	1.049	ns
tpch_q05/datafusion:parquet	395643926	3.76642e+08	1.05045	ns
tpch_q06/datafusion:parquet	147757558	1.32888e+08	1.11189	ns
tpch_q07/datafusion:parquet	420002151	4.00712e+08	1.04814	ns
tpch_q08/datafusion:parquet	473689902	4.69318e+08	1.00932	ns
tpch_q09/datafusion:parquet	457306290	4.3685e+08	1.04683	ns
tpch_q10/datafusion:parquet	476816977	4.66152e+08	1.02288	ns
tpch_q11/datafusion:parquet	306838130	3.01143e+08	1.01891	ns
tpch_q12/datafusion:parquet	234391220	2.3564e+08	0.9947	ns
tpch_q13/datafusion:parquet	446611373	4.32673e+08	1.03221	ns
tpch_q14/datafusion:parquet	169885456	1.66775e+08	1.01865	ns
tpch_q15/datafusion:parquet	283631184	2.87933e+08	0.98506	ns
tpch_q16/datafusion:parquet	199194446	1.8846e+08	1.05696	ns
tpch_q17/datafusion:parquet	347325048	3.45631e+08	1.0049	ns
tpch_q18/datafusion:parquet	441720110	4.52076e+08	0.977093	ns
tpch_q19/datafusion:parquet	302362445	3.11879e+08	0.969485	ns
tpch_q20/datafusion:parquet	278379077	2.62663e+08	1.05983	ns
tpch_q21/datafusion:parquet	434486975	4.1352e+08	1.0507	ns
tpch_q22/datafusion:parquet	183460893	1.81327e+08	1.01177	ns
tpch_q01/datafusion:vortex-file-compressed	288697889	2.53835e+08	1.13734	ns
tpch_q02/datafusion:vortex-file-compressed	214170355	1.89876e+08	1.12795	ns
tpch_q03/datafusion:vortex-file-compressed	309357389	3.14763e+08	0.982825	ns
tpch_q04/datafusion:vortex-file-compressed	197550416	1.83724e+08	1.07526	ns
tpch_q05/datafusion:vortex-file-compressed	323972378	2.75092e+08	1.17769	ns
tpch_q06/datafusion:vortex-file-compressed	239237233	2.04535e+08	1.16966	ns
tpch_q07/datafusion:vortex-file-compressed	294812926	2.67107e+08	1.10373	ns
tpch_q08/datafusion:vortex-file-compressed	340884993	4.67128e+08	0.729747	ns
tpch_q09/datafusion:vortex-file-compressed	306844506	2.6972e+08	1.13764	ns
tpch_q10/datafusion:vortex-file-compressed	394635504	3.86622e+08	1.02073	ns
tpch_q11/datafusion:vortex-file-compressed	123876218	1.19646e+08	1.03536	ns
tpch_q12/datafusion:vortex-file-compressed	278928622	2.67179e+08	1.04397	ns
tpch_q13/datafusion:vortex-file-compressed	207388991	2.1296e+08	0.973841	ns
tpch_q14/datafusion:vortex-file-compressed	182561026	1.67258e+08	1.09149	ns
tpch_q15/datafusion:vortex-file-compressed	271431166	2.47325e+08	1.09747	ns
tpch_q16/datafusion:vortex-file-compressed	142216926	1.24027e+08	1.14666	ns
tpch_q17/datafusion:vortex-file-compressed	292590712	2.79075e+08	1.04843	ns
tpch_q18/datafusion:vortex-file-compressed	284824148	3.0208e+08	0.942876	ns
tpch_q19/datafusion:vortex-file-compressed	335411363	3.34098e+08	1.00393	ns
tpch_q20/datafusion:vortex-file-compressed	235243075	2.06647e+08	1.13838	ns
tpch_q21/datafusion:vortex-file-compressed	340213901	3.58542e+08	0.948881	ns
tpch_q22/datafusion:vortex-file-compressed	155462890	1.47375e+08	1.05488	ns
tpch_q01/datafusion:vortex-compact	229484625	2.28277e+08	1.00529	ns
tpch_q02/datafusion:vortex-compact	184473884	1.93368e+08	0.954007	ns
tpch_q03/datafusion:vortex-compact	306474962	2.69691e+08	1.13639	ns
tpch_q04/datafusion:vortex-compact	193781157	2.0665e+08	0.937727	ns
tpch_q05/datafusion:vortex-compact	275153149	2.34122e+08	1.17525	ns
tpch_q06/datafusion:vortex-compact	284530239	2.54359e+08	1.11861	ns
tpch_q07/datafusion:vortex-compact	241389171	2.3868e+08	1.01135	ns
tpch_q08/datafusion:vortex-compact	278555536	2.61139e+08	1.06669	ns
tpch_q09/datafusion:vortex-compact	314992762	2.90976e+08	1.08254	ns
tpch_q10/datafusion:vortex-compact	345094602	3.24217e+08	1.0644	ns
tpch_q11/datafusion:vortex-compact	105516069	8.73231e+07	1.20834	ns
tpch_q12/datafusion:vortex-compact	376376996	2.998e+08	1.25543	ns
tpch_q13/datafusion:vortex-compact	159195249	1.44142e+08	1.10444	ns
tpch_q14/datafusion:vortex-compact	205364690	1.75479e+08	1.17031	ns
tpch_q15/datafusion:vortex-compact	357312580	2.83049e+08	1.26237	ns
tpch_q16/datafusion:vortex-compact	124870411	1.33632e+08	0.934432	ns
tpch_q17/datafusion:vortex-compact	282030555	2.68494e+08	1.05042	ns
tpch_q18/datafusion:vortex-compact	270093894	2.65544e+08	1.01713	ns
tpch_q19/datafusion:vortex-compact	361580496	3.25988e+08	1.10918	ns
tpch_q20/datafusion:vortex-compact	278034383	2.32788e+08	1.19437	ns
tpch_q21/datafusion:vortex-compact	367435512	3.59622e+08	1.02173	ns
tpch_q22/datafusion:vortex-compact	107436138	1.19817e+08	0.896665	ns
tpch_q01/duckdb:parquet	495326016	5.29957e+08	0.934653	ns
tpch_q02/duckdb:parquet	1139472400	1.09134e+09	1.0441	ns
tpch_q03/duckdb:parquet	854825113	7.99574e+08	1.0691	ns
tpch_q04/duckdb:parquet	541836360	5.1701e+08	1.04802	ns
tpch_q05/duckdb:parquet	1272875244	1.30678e+09	0.974055	ns
tpch_q06/duckdb:parquet	359134975	3.37663e+08	1.06359	ns
tpch_q07/duckdb:parquet	1043729931	1.0417e+09	1.00195	ns
tpch_q08/duckdb:parquet	1378100055	1.36187e+09	1.01192	ns
tpch_q09/duckdb:parquet	1231799524	1.18379e+09	1.04056	ns
tpch_q10/duckdb:parquet	1165734615	1.10833e+09	1.05179	ns
tpch_q11/duckdb:parquet	690758366	7.59831e+08	0.909095	ns
tpch_q12/duckdb:parquet	547042607	5.2357e+08	1.04483	ns
tpch_q13/duckdb:parquet	851256902	8.28743e+08	1.02717	ns
tpch_q14/duckdb:parquet	553710755	5.64529e+08	0.980837	ns
tpch_q15/duckdb:parquet	594576979	5.92054e+08	1.00426	ns
tpch_q16/duckdb:parquet	464832913	4.79404e+08	0.969605	ns
tpch_q17/duckdb:parquet	672451684	6.76794e+08	0.993584	ns
tpch_q18/duckdb:parquet	739406601	6.92706e+08	1.06742	ns
tpch_q19/duckdb:parquet	707796974	6.38828e+08	1.10796	ns
tpch_q20/duckdb:parquet	881661806	9.09015e+08	0.969909	ns
tpch_q21/duckdb:parquet	1069625649	9.58021e+08	1.1165	ns
tpch_q22/duckdb:parquet	443917162	4.67399e+08	0.94976	ns
tpch_q01/duckdb:vortex-file-compressed	280925689	2.84107e+08	0.988804	ns
tpch_q02/duckdb:vortex-file-compressed	683437685	6.4976e+08	1.05183	ns
tpch_q03/duckdb:vortex-file-compressed	641729689	6.35631e+08	1.0096	ns
tpch_q04/duckdb:vortex-file-compressed	386887159	3.79164e+08	1.02037	ns
tpch_q05/duckdb:vortex-file-compressed	695989850	7.01713e+08	0.991844	ns
tpch_q06/duckdb:vortex-file-compressed	383112858	3.54758e+08	1.07993	ns
tpch_q07/duckdb:vortex-file-compressed	706885390	6.78888e+08	1.04124	ns
tpch_q08/duckdb:vortex-file-compressed	940356102	9.16908e+08	1.02557	ns
tpch_q09/duckdb:vortex-file-compressed	754989006	6.99212e+08	1.07977	ns
tpch_q10/duckdb:vortex-file-compressed	761782519	7.71622e+08	0.987248	ns
tpch_q11/duckdb:vortex-file-compressed	349935261	3.33297e+08	1.04992	ns
tpch_q12/duckdb:vortex-file-compressed	505075119	5.1173e+08	0.986996	ns
tpch_q13/duckdb:vortex-file-compressed	450168993	4.29371e+08	1.04844	ns
tpch_q14/duckdb:vortex-file-compressed	424616900	3.88068e+08	1.09418	ns
tpch_q15/duckdb:vortex-file-compressed	294177381	2.79641e+08	1.05198	ns
tpch_q16/duckdb:vortex-file-compressed	289526073	2.94212e+08	0.984073	ns
tpch_q17/duckdb:vortex-file-compressed	549583730	5.33205e+08	1.03072	ns
tpch_q18/duckdb:vortex-file-compressed	629013594	6.24131e+08	1.00782	ns
tpch_q19/duckdb:vortex-file-compressed	420094485	4.08843e+08	1.02752	ns
tpch_q20/duckdb:vortex-file-compressed	704119561	5.93317e+08	1.18675	ns
tpch_q21/duckdb:vortex-file-compressed	884179226	8.75243e+08	1.01021	ns
tpch_q22/duckdb:vortex-file-compressed	243496724	2.266e+08	1.07457	ns
tpch_q01/duckdb:vortex-compact	298540275	2.73327e+08	1.09224	ns
tpch_q02/duckdb:vortex-compact	610233130	6.27208e+08	0.972936	ns
tpch_q03/duckdb:vortex-compact	536049795	5.26434e+08	1.01827	ns
tpch_q04/duckdb:vortex-compact	341396977	3.4048e+08	1.00269	ns
tpch_q05/duckdb:vortex-compact	650338554	6.16055e+08	1.05565	ns
tpch_q06/duckdb:vortex-compact	384204467	3.72864e+08	1.03041	ns
tpch_q07/duckdb:vortex-compact	575238338	5.59142e+08	1.02879	ns
tpch_q08/duckdb:vortex-compact	860840783	8.31571e+08	1.0352	ns
tpch_q09/duckdb:vortex-compact	724993761	7.36779e+08	0.984004	ns
tpch_q10/duckdb:vortex-compact	652512437	6.51965e+08	1.00084	ns
tpch_q11/duckdb:vortex-compact	336627534	3.33168e+08	1.01038	ns
tpch_q12/duckdb:vortex-compact	455537868	4.60877e+08	0.988415	ns
tpch_q13/duckdb:vortex-compact	390905454	3.65961e+08	1.06816	ns
tpch_q14/duckdb:vortex-compact	415066018	3.63178e+08	1.14287	ns
tpch_q15/duckdb:vortex-compact	251335834	2.55886e+08	0.982218	ns
tpch_q16/duckdb:vortex-compact	285563674	2.73794e+08	1.04299	ns
tpch_q17/duckdb:vortex-compact	528333474	5.05805e+08	1.04454	ns
tpch_q18/duckdb:vortex-compact	501119244	5.30148e+08	0.945245	ns
tpch_q19/duckdb:vortex-compact	439503081	4.23931e+08	1.03673	ns
tpch_q20/duckdb:vortex-compact	654925480	6.10678e+08	1.07246	ns
tpch_q21/duckdb:vortex-compact	815614368	8.01784e+08	1.01725	ns
tpch_q22/duckdb:vortex-compact	232058572	2.3121e+08	1.00367	ns

[github-actions[bot]]

Benchmarks: TPC-H SF=10 on NVME

Summary

• Overall: 1.183x ❌
• Vortex: 1.263x ❌
• duckdb:vortex: 1.237x ❌
• datafusion:vortex: 1.289x ❌
• Best: No improvements
• Worst: tpch_q11/datafusion:vortex-file-compressed (1.500x)
• Significant (>10%): 0↑ 86↓

Detailed Results Table

name	PR cb25f3c0	base 69377e1f	ratio (PR/base)	unit	remark
tpch_q01/datafusion:arrow	336618450	4.83323e+08	0.696467	ns	🚀
tpch_q02/datafusion:arrow	90161883	9.5321e+07	0.945877	ns
tpch_q03/datafusion:arrow	197390305	1.99949e+08	0.987202	ns
tpch_q04/datafusion:arrow	112195981	9.69977e+07	1.15669	ns	🚨
tpch_q05/datafusion:arrow	346199795	3.46677e+08	0.998625	ns
tpch_q06/datafusion:arrow	58937773	6.04148e+07	0.975552	ns
tpch_q07/datafusion:arrow	741388381	6.73267e+08	1.10118	ns	🚨
tpch_q08/datafusion:arrow	320304508	2.8965e+08	1.10583	ns	🚨
tpch_q09/datafusion:arrow	633427598	5.7234e+08	1.10673	ns	🚨
tpch_q10/datafusion:arrow	248380801	2.37641e+08	1.04519	ns
tpch_q11/datafusion:arrow	73333247	3.92526e+08	0.186824	ns	🚀
tpch_q12/datafusion:arrow	191438494	1.83436e+08	1.04363	ns
tpch_q13/datafusion:arrow	201346371	1.92289e+08	1.0471	ns
tpch_q14/datafusion:arrow	55514421	5.44073e+07	1.02035	ns
tpch_q15/datafusion:arrow	102542262	1.03728e+08	0.988569	ns
tpch_q16/datafusion:arrow	76469469	7.57035e+07	1.01012	ns
tpch_q17/datafusion:arrow	625886016	5.88507e+08	1.06351	ns
tpch_q18/datafusion:arrow	1255692892	1.37117e+09	0.915785	ns
tpch_q19/datafusion:arrow	123566624	1.21252e+08	1.01909	ns
tpch_q20/datafusion:arrow	170989371	1.68627e+08	1.01401	ns
tpch_q21/datafusion:arrow	3453174945	8.86717e+08	3.89434	ns	🚨
tpch_q22/datafusion:arrow	54110492	5.36674e+07	1.00826	ns
tpch_q01/datafusion:parquet	521938490	6.98935e+08	0.746763	ns	🚀
tpch_q02/datafusion:parquet	218097490	2.20095e+08	0.990922	ns
tpch_q03/datafusion:parquet	377556145	2.99461e+08	1.26079	ns	🚨
tpch_q04/datafusion:parquet	285498776	2.04637e+08	1.39514	ns	🚨
tpch_q05/datafusion:parquet	669374263	4.64882e+08	1.43988	ns	🚨
tpch_q06/datafusion:parquet	136342491	1.29816e+08	1.05028	ns
tpch_q07/datafusion:parquet	951328186	6.72967e+08	1.41363	ns	🚨
tpch_q08/datafusion:parquet	663954670	5.2493e+08	1.26484	ns	🚨
tpch_q09/datafusion:parquet	1114368464	8.20845e+08	1.35759	ns	🚨
tpch_q10/datafusion:parquet	647822363	5.15377e+08	1.25699	ns	🚨
tpch_q11/datafusion:parquet	170781763	1.32708e+08	1.2869	ns	🚨
tpch_q12/datafusion:parquet	247580710	1.9842e+08	1.24776	ns	🚨
tpch_q13/datafusion:parquet	503074030	4.27716e+08	1.17619	ns	🚨
tpch_q14/datafusion:parquet	193574184	1.57928e+08	1.22571	ns	🚨
tpch_q15/datafusion:parquet	328883475	2.54818e+08	1.29066	ns	🚨
tpch_q16/datafusion:parquet	185071761	1.47126e+08	1.25792	ns	🚨
tpch_q17/datafusion:parquet	986431079	7.18772e+08	1.37238	ns	🚨
tpch_q18/datafusion:parquet	1260903486	1.13078e+09	1.11507	ns	🚨
tpch_q19/datafusion:parquet	333845722	2.86807e+08	1.16401	ns	🚨
tpch_q20/datafusion:parquet	393983616	3.07026e+08	1.28323	ns	🚨
tpch_q21/datafusion:parquet	1110147532	8.69517e+08	1.27674	ns	🚨
tpch_q22/datafusion:parquet	352090790	3.29836e+08	1.06747	ns
tpch_q01/datafusion:vortex-file-compressed	593957516	4.98264e+08	1.19205	ns	🚨
tpch_q02/datafusion:vortex-file-compressed	223455966	1.65263e+08	1.35213	ns	🚨
tpch_q03/datafusion:vortex-file-compressed	298398545	2.21948e+08	1.34445	ns	🚨
tpch_q04/datafusion:vortex-file-compressed	128553828	1.03955e+08	1.23663	ns	🚨
tpch_q05/datafusion:vortex-file-compressed	805249669	5.83572e+08	1.37986	ns	🚨
tpch_q06/datafusion:vortex-file-compressed	55422919	3.74864e+07	1.47848	ns	🚨
tpch_q07/datafusion:vortex-file-compressed	801632526	5.86049e+08	1.36786	ns	🚨
tpch_q08/datafusion:vortex-file-compressed	913483379	6.47755e+08	1.41023	ns	🚨
tpch_q09/datafusion:vortex-file-compressed	1305505473	1.04383e+09	1.25069	ns	🚨
tpch_q10/datafusion:vortex-file-compressed	345553842	2.70063e+08	1.27953	ns	🚨
tpch_q11/datafusion:vortex-file-compressed	197759435	1.31809e+08	1.50034	ns	🚨
tpch_q12/datafusion:vortex-file-compressed	140862568	9.94724e+07	1.4161	ns	🚨
tpch_q13/datafusion:vortex-file-compressed	268387155	2.21457e+08	1.21191	ns	🚨
tpch_q14/datafusion:vortex-file-compressed	72535079	5.55367e+07	1.30607	ns	🚨
tpch_q15/datafusion:vortex-file-compressed	131585425	9.53112e+07	1.38059	ns	🚨
tpch_q16/datafusion:vortex-file-compressed	115163287	8.71045e+07	1.32213	ns	🚨
tpch_q17/datafusion:vortex-file-compressed	1295035603	9.0301e+08	1.43413	ns	🚨
tpch_q18/datafusion:vortex-file-compressed	1244098814	1.11056e+09	1.12024	ns	🚨
tpch_q19/datafusion:vortex-file-compressed	88959053	7.15074e+07	1.24405	ns	🚨
tpch_q20/datafusion:vortex-file-compressed	259112206	1.78947e+08	1.44799	ns	🚨
tpch_q21/datafusion:vortex-file-compressed	951153748	7.60608e+08	1.25052	ns	🚨
tpch_q22/datafusion:vortex-file-compressed	86443796	7.44904e+07	1.16047	ns	🚨
tpch_q01/datafusion:vortex-compact	628239385	5.31582e+08	1.18183	ns	🚨
tpch_q02/datafusion:vortex-compact	228521654	1.77469e+08	1.28767	ns	🚨
tpch_q03/datafusion:vortex-compact	325624088	2.40911e+08	1.35164	ns	🚨
tpch_q04/datafusion:vortex-compact	148346057	1.2059e+08	1.23017	ns	🚨
tpch_q05/datafusion:vortex-compact	792532111	6.81182e+08	1.16347	ns	🚨
tpch_q06/datafusion:vortex-compact	93469690	7.52274e+07	1.2425	ns	🚨
tpch_q07/datafusion:vortex-compact	834396791	6.14581e+08	1.35767	ns	🚨
tpch_q08/datafusion:vortex-compact	902282960	6.90452e+08	1.3068	ns	🚨
tpch_q09/datafusion:vortex-compact	1342361988	1.11431e+09	1.20466	ns	🚨
tpch_q10/datafusion:vortex-compact	391315962	3.1356e+08	1.24798	ns	🚨
tpch_q11/datafusion:vortex-compact	190483149	1.4349e+08	1.3275	ns	🚨
tpch_q12/datafusion:vortex-compact	216219642	1.65016e+08	1.3103	ns	🚨
tpch_q13/datafusion:vortex-compact	316174119	2.70204e+08	1.17013	ns	🚨
tpch_q14/datafusion:vortex-compact	116852335	8.69546e+07	1.34383	ns	🚨
tpch_q15/datafusion:vortex-compact	212943406	1.63615e+08	1.30149	ns	🚨
tpch_q16/datafusion:vortex-compact	131487408	9.52594e+07	1.38031	ns	🚨
tpch_q17/datafusion:vortex-compact	1302709518	9.83798e+08	1.32416	ns	🚨
tpch_q18/datafusion:vortex-compact	1244877033	1.1127e+09	1.11879	ns	🚨
tpch_q19/datafusion:vortex-compact	152116061	1.2723e+08	1.1956	ns	🚨
tpch_q20/datafusion:vortex-compact	282527490	2.09928e+08	1.34583	ns	🚨
tpch_q21/datafusion:vortex-compact	960563327	7.66767e+08	1.25274	ns	🚨
tpch_q22/datafusion:vortex-compact	97901237	8.52278e+07	1.1487	ns	🚨
tpch_q01/duckdb:parquet	265610454	2.60553e+08	1.01941	ns
tpch_q02/duckdb:parquet	140174941	1.27497e+08	1.09944	ns
tpch_q03/duckdb:parquet	247628718	2.24888e+08	1.10112	ns	🚨
tpch_q04/duckdb:parquet	169700713	1.52589e+08	1.11214	ns	🚨
tpch_q05/duckdb:parquet	257529648	2.34626e+08	1.09762	ns
tpch_q06/duckdb:parquet	73768835	7.21741e+07	1.0221	ns
tpch_q07/duckdb:parquet	245638654	2.20078e+08	1.11614	ns	🚨
tpch_q08/duckdb:parquet	387149516	3.30878e+08	1.17007	ns	🚨
tpch_q09/duckdb:parquet	569997391	4.76155e+08	1.19708	ns	🚨
tpch_q10/duckdb:parquet	708850017	6.36788e+08	1.11316	ns	🚨
tpch_q11/duckdb:parquet	58685787	5.58394e+07	1.05097	ns
tpch_q12/duckdb:parquet	151423627	1.41847e+08	1.06752	ns
tpch_q13/duckdb:parquet	460650973	4.13532e+08	1.11394	ns	🚨
tpch_q14/duckdb:parquet	198842959	1.83369e+08	1.08439	ns
tpch_q15/duckdb:parquet	118714869	1.08333e+08	1.09583	ns
tpch_q16/duckdb:parquet	199269073	1.66689e+08	1.19546	ns	🚨
tpch_q17/duckdb:parquet	216064762	2.05217e+08	1.05286	ns
tpch_q18/duckdb:parquet	412989643	3.64158e+08	1.13409	ns	🚨
tpch_q19/duckdb:parquet	306498598	2.94021e+08	1.04244	ns
tpch_q20/duckdb:parquet	266410745	2.52314e+08	1.05587	ns
tpch_q21/duckdb:parquet	717323220	5.87525e+08	1.22092	ns	🚨
tpch_q22/duckdb:parquet	315278449	3.01916e+08	1.04426	ns
tpch_q01/duckdb:vortex-file-compressed	219464441	2.04555e+08	1.07289	ns
tpch_q02/duckdb:vortex-file-compressed	74899801	5.76524e+07	1.29916	ns	🚨
tpch_q03/duckdb:vortex-file-compressed	172709183	1.34585e+08	1.28327	ns	🚨
tpch_q04/duckdb:vortex-file-compressed	226454783	1.64662e+08	1.37527	ns	🚨
tpch_q05/duckdb:vortex-file-compressed	189882178	1.36186e+08	1.39429	ns	🚨
tpch_q06/duckdb:vortex-file-compressed	77480080	5.61177e+07	1.38067	ns	🚨
tpch_q07/duckdb:vortex-file-compressed	189104056	1.46831e+08	1.28791	ns	🚨
tpch_q08/duckdb:vortex-file-compressed	313388677	2.40932e+08	1.30073	ns	🚨
tpch_q09/duckdb:vortex-file-compressed	461720458	3.62381e+08	1.27413	ns	🚨
tpch_q10/duckdb:vortex-file-compressed	194435026	1.47008e+08	1.32262	ns	🚨
tpch_q11/duckdb:vortex-file-compressed	52906784	4.01888e+07	1.31646	ns	🚨
tpch_q12/duckdb:vortex-file-compressed	139542100	1.09469e+08	1.27472	ns	🚨
tpch_q13/duckdb:vortex-file-compressed	306917655	2.3948e+08	1.2816	ns	🚨
tpch_q14/duckdb:vortex-file-compressed	86330013	6.68652e+07	1.29111	ns	🚨
tpch_q15/duckdb:vortex-file-compressed	122701356	9.81271e+07	1.25043	ns	🚨
tpch_q16/duckdb:vortex-file-compressed	103185277	8.14186e+07	1.26734	ns	🚨
tpch_q17/duckdb:vortex-file-compressed	165417658	1.26606e+08	1.30655	ns	🚨
tpch_q18/duckdb:vortex-file-compressed	342136897	2.83369e+08	1.20739	ns	🚨
tpch_q19/duckdb:vortex-file-compressed	115180916	9.86891e+07	1.16711	ns	🚨
tpch_q20/duckdb:vortex-file-compressed	220494159	1.72441e+08	1.27866	ns	🚨
tpch_q21/duckdb:vortex-file-compressed	803660591	5.88393e+08	1.36586	ns	🚨
tpch_q22/duckdb:vortex-file-compressed	90122837	7.55125e+07	1.19348	ns	🚨
tpch_q01/duckdb:vortex-compact	264882886	2.5232e+08	1.04979	ns
tpch_q02/duckdb:vortex-compact	86084582	6.99467e+07	1.23072	ns	🚨
tpch_q03/duckdb:vortex-compact	216207810	1.81622e+08	1.19043	ns	🚨
tpch_q04/duckdb:vortex-compact	242223408	2.12024e+08	1.14243	ns	🚨
tpch_q05/duckdb:vortex-compact	217381913	1.75392e+08	1.23941	ns	🚨
tpch_q06/duckdb:vortex-compact	142236804	1.10577e+08	1.28631	ns	🚨
tpch_q07/duckdb:vortex-compact	256709121	2.20504e+08	1.16419	ns	🚨
tpch_q08/duckdb:vortex-compact	321704078	2.6479e+08	1.21494	ns	🚨
tpch_q09/duckdb:vortex-compact	514003365	4.16288e+08	1.23473	ns	🚨
tpch_q10/duckdb:vortex-compact	249858762	2.08218e+08	1.19999	ns	🚨
tpch_q11/duckdb:vortex-compact	56657447	4.37212e+07	1.29588	ns	🚨
tpch_q12/duckdb:vortex-compact	327126872	2.95586e+08	1.10671	ns	🚨
tpch_q13/duckdb:vortex-compact	365039308	2.98985e+08	1.22093	ns	🚨
tpch_q14/duckdb:vortex-compact	140698025	1.06633e+08	1.31946	ns	🚨
tpch_q15/duckdb:vortex-compact	155457564	1.33009e+08	1.16877	ns	🚨
tpch_q16/duckdb:vortex-compact	109464089	9.20393e+07	1.18932	ns	🚨
tpch_q17/duckdb:vortex-compact	173672761	1.47539e+08	1.17713	ns	🚨
tpch_q18/duckdb:vortex-compact	396046567	3.36908e+08	1.17553	ns	🚨
tpch_q19/duckdb:vortex-compact	179237603	1.57529e+08	1.13781	ns	🚨
tpch_q20/duckdb:vortex-compact	259677850	2.22898e+08	1.16501	ns	🚨
tpch_q21/duckdb:vortex-compact	849674008	6.83732e+08	1.2427	ns	🚨
tpch_q22/duckdb:vortex-compact	99041894	8.39654e+07	1.17956	ns	🚨
tpch_q01/duckdb:duckdb	123406082	1.17754e+08	1.048	ns
tpch_q02/duckdb:duckdb	59597087	5.30665e+07	1.12306	ns	🚨
tpch_q03/duckdb:duckdb	123871528	1.01626e+08	1.2189	ns	🚨
tpch_q04/duckdb:duckdb	159059109	1.30011e+08	1.22343	ns	🚨
tpch_q05/duckdb:duckdb	134261028	1.15884e+08	1.15859	ns	🚨
tpch_q06/duckdb:duckdb	49676504	4.58155e+07	1.08427	ns
tpch_q07/duckdb:duckdb	126904296	1.1101e+08	1.14317	ns	🚨
tpch_q08/duckdb:duckdb	159440486	1.41006e+08	1.13074	ns	🚨
tpch_q09/duckdb:duckdb	363638645	3.07668e+08	1.18192	ns	🚨
tpch_q10/duckdb:duckdb	267272735	2.16781e+08	1.23292	ns	🚨
tpch_q11/duckdb:duckdb	24930540	2.35556e+07	1.05837	ns
tpch_q12/duckdb:duckdb	100281012	8.68537e+07	1.1546	ns	🚨
tpch_q13/duckdb:duckdb	275566740	2.36935e+08	1.16305	ns	🚨
tpch_q14/duckdb:duckdb	89795056	7.93309e+07	1.13191	ns	🚨
tpch_q15/duckdb:duckdb	92189961	8.19544e+07	1.12489	ns	🚨
tpch_q16/duckdb:duckdb	89425277	7.38773e+07	1.21046	ns	🚨
tpch_q17/duckdb:duckdb	108090234	1.00325e+08	1.0774	ns
tpch_q18/duckdb:duckdb	255194077	2.18623e+08	1.16728	ns	🚨
tpch_q19/duckdb:duckdb	142676322	1.30033e+08	1.09723	ns
tpch_q20/duckdb:duckdb	137961882	1.25251e+08	1.10148	ns	🚨
tpch_q21/duckdb:duckdb	392670762	3.21182e+08	1.22258	ns	🚨
tpch_q22/duckdb:duckdb	79582190	7.56464e+07	1.05203	ns

[github-actions[bot]]

Benchmarks: TPC-H SF=10 on S3

Summary

• Overall: 0.995x ➖
• Vortex: 0.999x ➖
• duckdb:vortex: 0.975x ➖
• datafusion:vortex: 1.023x ➖
• Best: tpch_q18/datafusion:vortex-compact (0.745x)
• Worst: tpch_q12/datafusion:vortex-compact (1.412x)
• Significant (>30%): 0↑ 2↓

Detailed Results Table

name	PR cb25f3c0	base 69377e1f	ratio (PR/base)	unit	remark
tpch_q01/datafusion:parquet	966057427	1.19073e+09	0.811314	ns
tpch_q02/datafusion:parquet	640255247	6.68051e+08	0.958392	ns
tpch_q03/datafusion:parquet	950506994	8.75077e+08	1.0862	ns
tpch_q04/datafusion:parquet	523910434	5.24305e+08	0.999248	ns
tpch_q05/datafusion:parquet	1047466045	1.02086e+09	1.02606	ns
tpch_q06/datafusion:parquet	502880260	5.02659e+08	1.00044	ns
tpch_q07/datafusion:parquet	1292692167	1.28406e+09	1.00672	ns
tpch_q08/datafusion:parquet	1404306285	1.35644e+09	1.03529	ns
tpch_q09/datafusion:parquet	1605171403	1.63518e+09	0.981647	ns
tpch_q10/datafusion:parquet	1875327290	1.86198e+09	1.00717	ns
tpch_q11/datafusion:parquet	432579595	4.26183e+08	1.01501	ns
tpch_q12/datafusion:parquet	590200680	6.23769e+08	0.946185	ns
tpch_q13/datafusion:parquet	730163355	7.58101e+08	0.963148	ns
tpch_q14/datafusion:parquet	756150670	7.4061e+08	1.02098	ns
tpch_q15/datafusion:parquet	1343067441	1.21631e+09	1.10421	ns
tpch_q16/datafusion:parquet	347775139	3.66164e+08	0.949781	ns
tpch_q17/datafusion:parquet	1327733694	1.30068e+09	1.0208	ns
tpch_q18/datafusion:parquet	1493741201	1.6025e+09	0.932133	ns
tpch_q19/datafusion:parquet	904411103	9.31513e+08	0.970905	ns
tpch_q20/datafusion:parquet	1023082545	1.01895e+09	1.00406	ns
tpch_q21/datafusion:parquet	1677192537	1.6303e+09	1.02877	ns
tpch_q22/datafusion:parquet	752784791	7.53238e+08	0.999398	ns
tpch_q01/datafusion:vortex-file-compressed	694579271	7.39806e+08	0.938867	ns
tpch_q02/datafusion:vortex-file-compressed	561171274	5.27775e+08	1.06328	ns
tpch_q03/datafusion:vortex-file-compressed	755228060	8.03743e+08	0.939639	ns
tpch_q04/datafusion:vortex-file-compressed	528022712	4.95842e+08	1.0649	ns
tpch_q05/datafusion:vortex-file-compressed	1068475516	9.84976e+08	1.08477	ns
tpch_q06/datafusion:vortex-file-compressed	560156425	4.89336e+08	1.14473	ns
tpch_q07/datafusion:vortex-file-compressed	956146383	9.90331e+08	0.965482	ns
tpch_q08/datafusion:vortex-file-compressed	1429098437	1.26273e+09	1.13176	ns
tpch_q09/datafusion:vortex-file-compressed	1537680304	1.51328e+09	1.01612	ns
tpch_q10/datafusion:vortex-file-compressed	992445483	8.40129e+08	1.1813	ns
tpch_q11/datafusion:vortex-file-compressed	407855631	3.97511e+08	1.02602	ns
tpch_q12/datafusion:vortex-file-compressed	819479697	7.55352e+08	1.0849	ns
tpch_q13/datafusion:vortex-file-compressed	395954405	4.75073e+08	0.833459	ns
tpch_q14/datafusion:vortex-file-compressed	553487767	4.50594e+08	1.22835	ns
tpch_q15/datafusion:vortex-file-compressed	930187865	8.15861e+08	1.14013	ns
tpch_q16/datafusion:vortex-file-compressed	301677120	2.89247e+08	1.04298	ns
tpch_q17/datafusion:vortex-file-compressed	1376369160	1.4137e+09	0.97359	ns
tpch_q18/datafusion:vortex-file-compressed	1296972338	1.52465e+09	0.850667	ns
tpch_q19/datafusion:vortex-file-compressed	613285565	6.67248e+08	0.919127	ns
tpch_q20/datafusion:vortex-file-compressed	790288327	6.95304e+08	1.13661	ns
tpch_q21/datafusion:vortex-file-compressed	1453140368	1.57916e+09	0.920196	ns
tpch_q22/datafusion:vortex-file-compressed	310509615	3.26616e+08	0.950686	ns
tpch_q01/datafusion:vortex-compact	701702167	7.49636e+08	0.936057	ns
tpch_q02/datafusion:vortex-compact	515298369	4.80431e+08	1.07258	ns
tpch_q03/datafusion:vortex-compact	690049809	6.51889e+08	1.05854	ns
tpch_q04/datafusion:vortex-compact	466351847	4.7475e+08	0.98231	ns
tpch_q05/datafusion:vortex-compact	994409119	9.22441e+08	1.07802	ns
tpch_q06/datafusion:vortex-compact	583128586	5.24363e+08	1.11207	ns
tpch_q07/datafusion:vortex-compact	943630002	9.55736e+08	0.987333	ns
tpch_q08/datafusion:vortex-compact	1191625553	1.28145e+09	0.929906	ns
tpch_q09/datafusion:vortex-compact	1459548570	1.55438e+09	0.938989	ns
tpch_q10/datafusion:vortex-compact	827726087	7.9014e+08	1.04757	ns
tpch_q11/datafusion:vortex-compact	404852908	3.97615e+08	1.0182	ns
tpch_q12/datafusion:vortex-compact	882051178	6.24608e+08	1.41217	ns	🚨
tpch_q13/datafusion:vortex-compact	430077434	4.2785e+08	1.00521	ns
tpch_q14/datafusion:vortex-compact	550658059	4.54518e+08	1.21152	ns
tpch_q15/datafusion:vortex-compact	1134562545	8.29752e+08	1.36735	ns	🚨
tpch_q16/datafusion:vortex-compact	265311647	2.72234e+08	0.97457	ns
tpch_q17/datafusion:vortex-compact	1430088521	1.51668e+09	0.942906	ns
tpch_q18/datafusion:vortex-compact	1144647709	1.53634e+09	0.74505	ns
tpch_q19/datafusion:vortex-compact	631562513	6.76397e+08	0.933716	ns
tpch_q20/datafusion:vortex-compact	704534417	6.58754e+08	1.0695	ns
tpch_q21/datafusion:vortex-compact	1308000710	1.37938e+09	0.948251	ns
tpch_q22/datafusion:vortex-compact	324708569	3.46836e+08	0.936202	ns
tpch_q01/duckdb:parquet	955971705	9.36285e+08	1.02103	ns
tpch_q02/duckdb:parquet	1225885046	1.27648e+09	0.960361	ns
tpch_q03/duckdb:parquet	1307096021	1.33085e+09	0.982154	ns
tpch_q04/duckdb:parquet	881112408	8.29563e+08	1.06214	ns
tpch_q05/duckdb:parquet	1761843362	1.74382e+09	1.01033	ns
tpch_q06/duckdb:parquet	621360386	7.13947e+08	0.870318	ns
tpch_q07/duckdb:parquet	1645324679	1.53948e+09	1.06875	ns
tpch_q08/duckdb:parquet	2079852583	2.02661e+09	1.02627	ns
tpch_q09/duckdb:parquet	1997372996	2.09354e+09	0.954065	ns
tpch_q10/duckdb:parquet	2606947116	2.75087e+09	0.94768	ns
tpch_q11/duckdb:parquet	798819439	7.84186e+08	1.01866	ns
tpch_q12/duckdb:parquet	871197120	8.67601e+08	1.00414	ns
tpch_q13/duckdb:parquet	1001934610	1.06725e+09	0.938803	ns
tpch_q14/duckdb:parquet	1077453205	1.06665e+09	1.01013	ns
tpch_q15/duckdb:parquet	984075229	9.21862e+08	1.06749	ns
tpch_q16/duckdb:parquet	660260695	7.16475e+08	0.92154	ns
tpch_q17/duckdb:parquet	1179179426	1.12273e+09	1.05028	ns
tpch_q18/duckdb:parquet	1153077577	1.14892e+09	1.00362	ns
tpch_q19/duckdb:parquet	1274492386	1.27557e+09	0.999152	ns
tpch_q20/duckdb:parquet	1464280603	1.60082e+09	0.914705	ns
tpch_q21/duckdb:parquet	1470033809	1.53035e+09	0.960589	ns
tpch_q22/duckdb:parquet	831635212	9.16898e+08	0.907009	ns
tpch_q01/duckdb:vortex-file-compressed	715825425	8.95244e+08	0.799587	ns
tpch_q02/duckdb:vortex-file-compressed	1007763415	1.00762e+09	1.00014	ns
tpch_q03/duckdb:vortex-file-compressed	1362323336	1.32762e+09	1.02614	ns
tpch_q04/duckdb:vortex-file-compressed	875369782	7.09224e+08	1.23426	ns
tpch_q05/duckdb:vortex-file-compressed	1211063259	1.28477e+09	0.942632	ns
tpch_q06/duckdb:vortex-file-compressed	908637747	9.28746e+08	0.978349	ns
tpch_q07/duckdb:vortex-file-compressed	1196388726	1.27768e+09	0.936379	ns
tpch_q08/duckdb:vortex-file-compressed	1622001919	1.65228e+09	0.981675	ns
tpch_q09/duckdb:vortex-file-compressed	1588968682	1.71028e+09	0.92907	ns
tpch_q10/duckdb:vortex-file-compressed	1310187802	1.26816e+09	1.03314	ns
tpch_q11/duckdb:vortex-file-compressed	783022898	7.93308e+08	0.987036	ns
tpch_q12/duckdb:vortex-file-compressed	756292625	7.78449e+08	0.971538	ns
tpch_q13/duckdb:vortex-file-compressed	1057496614	1.03849e+09	1.0183	ns
tpch_q14/duckdb:vortex-file-compressed	851394488	8.63982e+08	0.985431	ns
tpch_q15/duckdb:vortex-file-compressed	607335865	6.72299e+08	0.903372	ns
tpch_q16/duckdb:vortex-file-compressed	559299027	5.43556e+08	1.02896	ns
tpch_q17/duckdb:vortex-file-compressed	1063857926	1.1369e+09	0.935756	ns
tpch_q18/duckdb:vortex-file-compressed	1087532596	1.20136e+09	0.905251	ns
tpch_q19/duckdb:vortex-file-compressed	800880422	9.0118e+08	0.888702	ns
tpch_q20/duckdb:vortex-file-compressed	1216633744	1.22179e+09	0.995778	ns
tpch_q21/duckdb:vortex-file-compressed	1894295203	1.95512e+09	0.968891	ns
tpch_q22/duckdb:vortex-file-compressed	478526382	4.91204e+08	0.97419	ns
tpch_q01/duckdb:vortex-compact	687811919	6.9476e+08	0.989999	ns
tpch_q02/duckdb:vortex-compact	830722649	8.77851e+08	0.946314	ns
tpch_q03/duckdb:vortex-compact	1013632305	9.61319e+08	1.05442	ns
tpch_q04/duckdb:vortex-compact	567529393	5.58459e+08	1.01624	ns
tpch_q05/duckdb:vortex-compact	1071294398	1.05053e+09	1.01977	ns
tpch_q06/duckdb:vortex-compact	841354034	7.04669e+08	1.19397	ns
tpch_q07/duckdb:vortex-compact	1035147416	1.09149e+09	0.948379	ns
tpch_q08/duckdb:vortex-compact	1421372922	1.5135e+09	0.939132	ns
tpch_q09/duckdb:vortex-compact	1367473149	1.40105e+09	0.976036	ns
tpch_q10/duckdb:vortex-compact	1185575200	1.17761e+09	1.00676	ns
tpch_q11/duckdb:vortex-compact	630046668	6.36017e+08	0.990613	ns
tpch_q12/duckdb:vortex-compact	750500726	8.17099e+08	0.918494	ns
tpch_q13/duckdb:vortex-compact	745289694	8.15008e+08	0.914457	ns
tpch_q14/duckdb:vortex-compact	876188153	8.63996e+08	1.01411	ns
tpch_q15/duckdb:vortex-compact	609552297	6.33356e+08	0.962416	ns
tpch_q16/duckdb:vortex-compact	455010589	4.91354e+08	0.926034	ns
tpch_q17/duckdb:vortex-compact	1045064444	1.02085e+09	1.02372	ns
tpch_q18/duckdb:vortex-compact	869720433	9.40748e+08	0.924499	ns
tpch_q19/duckdb:vortex-compact	764340960	8.30193e+08	0.920678	ns
tpch_q20/duckdb:vortex-compact	1169526914	1.16213e+09	1.00636	ns
tpch_q21/duckdb:vortex-compact	1606767885	1.82501e+09	0.880414	ns
tpch_q22/duckdb:vortex-compact	535441156	5.23377e+08	1.02305	ns

[robert3005]

Tihs is blocked on lance and tpchgen-rs because of our benchmark setup

[AdamGS]

I forgot lance was feature flagged :/

[codecov[bot]]

Codecov Report

:x: Patch coverage is 52.94118% with 32 lines in your changes missing coverage. Please review. :white_check_mark: Project coverage is 39.41%. Comparing base (ec5c119) to head (cb25f3c).

Files with missing lines	Patch %	Lines
vortex-datafusion/src/convert/scalars.rs	30.95%	29 Missing :warning:
vortex-datafusion/src/persistent/opener.rs	87.50%	2 Missing :warning:
vortex-dtype/src/arrow.rs	66.66%	1 Missing :warning:

:exclamation: There is a different number of reports uploaded between BASE (ec5c119) and HEAD (cb25f3c). Click for more details.

HEAD has 1 upload less than BASE

Flag	BASE (ec5c119)	HEAD (cb25f3c)
tests	1	0

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:

• :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[a10y]

I ported the schema evolution tests from #5406 and they seem to fail :/

aduffy@Andrews-MacBook-Pro /V/C/w/d/vortex-datafusion (adamg/df-51)> cargo test --test schema_evolution
    Finished `test` profile [unoptimized + debuginfo] target(s) in 0.12s
     Running tests/schema_evolution.rs (/Volumes/Code/worktree/df51/target/debug/deps/schema_evolution-dc8592b17d16340b)

running 3 tests
test test_filter_schema_evolution_order ... FAILED
test test_filter_with_schema_evolution ... FAILED
test test_filter_schema_evolution_struct_fields ... FAILED

failures:

---- test_filter_schema_evolution_order stdout ----

thread 'test_filter_schema_evolution_order' panicked at vortex-datafusion/tests/schema_evolution.rs:235:10:
called `Result::unwrap()` on an `Err` value: ArrowError(SchemaError("Unable to get field named \"b\". Valid fields: [\"a\"]"), Some(""))
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

---- test_filter_with_schema_evolution stdout ----

thread 'test_filter_with_schema_evolution' panicked at vortex-datafusion/tests/schema_evolution.rs:145:10:
called `Result::unwrap()` on an `Err` value: ArrowError(SchemaError("Unable to get field named \"a\". Valid fields: [\"b\"]"), Some(""))

---- test_filter_schema_evolution_struct_fields stdout ----

thread 'test_filter_schema_evolution_struct_fields' panicked at vortex-datafusion/tests/schema_evolution.rs:409:5:
assertion `left == right` failed
  left: RecordBatch { schema: Schema { fields: [Field { name: "hostname", data_type: Utf8, nullable: true }, Field { name: "payload", data_type: Struct([Field { name: "uptime", data_type: Int64, nullable: true }, Field { name: "instance", data_type: Utf8, nullable: true }]), nullable: true }], metadata: {} }, columns: [StringArray
[
  "host01.local",
  "host01.local",
  "host01.local",
  "host01.local",
  "host02.local",
  "host02.local",
], StructArray
-- validity:
[
  valid,
  valid,
  valid,
  valid,
  valid,
  valid,
]
[
-- child 0: "uptime" (Int64)
PrimitiveArray<Int64>
[
  1,
  2,
  3,
  4,
  10,
  20,
]
-- child 1: "instance" (Utf8)
StringArray
[
  null,
  null,
  null,
  null,
  "c6i",
  "c6i",
]
]], row_count: 6 }
 right: RecordBatch { schema: Schema { fields: [Field { name: "hostname", data_type: Utf8, nullable: true }, Field { name: "payload", data_type: Struct([Field { name: "uptime", data_type: Int64, nullable: true }, Field { name: "instance", data_type: Utf8, nullable: true }]), nullable: true }], metadata: {} }, columns: [StringArray
[
  "host01",
  "host01",
  "host01",
  "host01",
  "host02",
  "host02",
], StructArray
-- validity:
[
  valid,
  valid,
  valid,
  valid,
  valid,
  valid,
]
[
-- child 0: "uptime" (Int64)
PrimitiveArray<Int64>
[
  1,
  2,
  3,
  4,
  10,
  20,
]
-- child 1: "instance" (Utf8)
StringArray
[
  null,
  null,
  null,
  null,
  "c6i",
  "c6i",
]
]], row_count: 6 }


failures:
    test_filter_schema_evolution_order
    test_filter_schema_evolution_struct_fields
    test_filter_with_schema_evolution

test result: FAILED. 0 passed; 3 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.06s

error: test failed, to rerun pass `--test schema_evolution`
aduffy@Andrews-MacBook-Pro /V/C/w/d/vortex-datafusion (adamg/df-51) [101]>

[a10y]

I pushed a few commits which cover a few fixes:

1. Fix Struct casting to allow for schema-compatible casts on structs (i.e. field reordering, adding nullable columns, dropping columns)
2. Vendor in some changes from last week to the PhysicalExprRewriter that fixes schema evolution for fields of nested struct columns. Relevant block is here
3. Bring integration tests over from my old PR and get them passing

This does force us to bring in a small block of vendored code that we'll delete when DF 52 releases. We can forego that and just continue to leave the problem open for now, and merge #5717 later. Or we can include the one vendored file which we'll delete on next DF bump.

[AdamGS]

So @a10y is on vacation for the next few weeks, so just updating my current thinking here:

1. I would love to not vendor temporary fixes (@asubiotto - would love your thoughts here).
2. I'm getting close to unblocking this release but I'm not sure I'll make it this year, if I do - we can release a 51 supporting version (with the underlying issue still there).
3. DF 52 should be released later this month or in January, which will allow us to quickly release again with the upstream fix.

[asubiotto]

I'm also on PTO this week so won't be very reachable but I think most of the urgency comes from some changes @brancz is working on so I'll defer to him. Re the vendored code I don't think I mind it too much, especially since it'll be deleted soon. I think the question is whether it's worth the effort to push through this 51 release if 52 is coming soon and most everyone is on holiday starting next week.

[robert3005]

My personal bias is to merge the vendored code now since it’s an indication of an upstream bug for a feature we care about. Then delete it once 52 is around. Without it gharchive is broken and it’s a bit annoying to wait for upstream.

[brancz]

No strong opinion one way or another, we're already at the point where we're carrying several unreleased patches on upstream for both arrow and datafusion.

[brancz]

Jynxed it, I'm quite certain I'm seeing a very noticeable case for us where we're lacking projection pushdown for a field in a struct (which is one of the things this fixes). Would appreciate it if we could merge this.

[AdamGS]

This is currently blocked by #5676, once I merge that (hopefully today), I'll rebase this PR and try and catch up on all the pieces here and get it merged.