Skip to content

Support limit and filter for ScanBuilder and RepeatedScan#7565

Draft
AdamGS wants to merge 4 commits intodevelopfrom
adamg/remove-map-fn-limit
Draft

Support limit and filter for ScanBuilder and RepeatedScan#7565
AdamGS wants to merge 4 commits intodevelopfrom
adamg/remove-map-fn-limit

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Apr 20, 2026

Summary

Closes: #000

Testing

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Apr 20, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 20, 2026
@AdamGS AdamGS added the changelog/feature A new feature label Apr 20, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 17fa9ff 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 0374b7f 1 Explore Profiling Data
🟢 Done d4a7142 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.087x ➖


datafusion / vortex-file-compressed (1.087x ➖, 0↑ 3↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨 232412627 123806557 1.88
polarsignals_q01/datafusion:vortex-file-compressed 🚨 407729964 367540490 1.11
polarsignals_q02/datafusion:vortex-file-compressed 23429946 23576895 0.99
polarsignals_q03/datafusion:vortex-file-compressed 🚨 411724671 373040148 1.10
polarsignals_q04/datafusion:vortex-file-compressed 11635167 11420629 1.02
polarsignals_q05/datafusion:vortex-file-compressed 15826980 15770816 1.00
polarsignals_q06/datafusion:vortex-file-compressed 18287419 18583290 0.98
polarsignals_q07/datafusion:vortex-file-compressed 13352756 14004405 0.95
polarsignals_q08/datafusion:vortex-file-compressed 474211739 458912270 1.03
polarsignals_q09/datafusion:vortex-file-compressed 10435697 10248423 1.02

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +6.1%
Vortex (geomean): 1.070x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.7%


datafusion / vortex-file-compressed (1.069x ➖, 0↑ 2↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4026577 3690903 1.09
fineweb_q01/datafusion:vortex-file-compressed 24622152 23022553 1.07
fineweb_q02/datafusion:vortex-file-compressed 🚨 27975861 21685940 1.29
fineweb_q03/datafusion:vortex-file-compressed 🚨 78750347 66069019 1.19
fineweb_q04/datafusion:vortex-file-compressed 241556899 231557131 1.04
fineweb_q05/datafusion:vortex-file-compressed 219661105 218262059 1.01
fineweb_q06/datafusion:vortex-file-compressed 53723690 55983263 0.96
fineweb_q07/datafusion:vortex-file-compressed 58882845 59779175 0.99
fineweb_q08/datafusion:vortex-file-compressed 22050600 21493399 1.03
datafusion / vortex-compact (1.235x ❌, 0↑ 4↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4805550 4380640 1.10
fineweb_q01/datafusion:vortex-compact 🚨 296442722 158695237 1.87
fineweb_q02/datafusion:vortex-compact 🚨 300555786 163637224 1.84
fineweb_q03/datafusion:vortex-compact 🚨 1612510986 1465364533 1.10
fineweb_q04/datafusion:vortex-compact 1722382705 1580559249 1.09
fineweb_q05/datafusion:vortex-compact 1332049067 1236969422 1.08
fineweb_q06/datafusion:vortex-compact 748547078 693754899 1.08
fineweb_q07/datafusion:vortex-compact 797254145 732088210 1.09
fineweb_q08/datafusion:vortex-compact 🚨 20931236 17850320 1.17
datafusion / parquet (0.994x ➖, 0↑ 1↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 6875501 6190025 1.11
fineweb_q01/datafusion:parquet 283053373 292402318 0.97
fineweb_q02/datafusion:parquet 286937834 296222312 0.97
fineweb_q03/datafusion:parquet 282896030 285671082 0.99
fineweb_q04/datafusion:parquet 295778507 299843771 0.99
fineweb_q05/datafusion:parquet 293329484 296403156 0.99
fineweb_q06/datafusion:parquet 282102592 288273433 0.98
fineweb_q07/datafusion:parquet 275860756 280954565 0.98
fineweb_q08/datafusion:parquet 275014085 280977272 0.98
duckdb / vortex-file-compressed (0.987x ➖, 1↑ 1↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3453404 3124434 1.11
fineweb_q01/duckdb:vortex-file-compressed 22562909 22555582 1.00
fineweb_q02/duckdb:vortex-file-compressed 24061233 22771292 1.06
fineweb_q03/duckdb:vortex-file-compressed 🚀 115428900 156864205 0.74
fineweb_q04/duckdb:vortex-file-compressed 218063968 216770797 1.01
fineweb_q05/duckdb:vortex-file-compressed 209939275 212010192 0.99
fineweb_q06/duckdb:vortex-file-compressed 51751950 50810072 1.02
fineweb_q07/duckdb:vortex-file-compressed 53760050 52708632 1.02
fineweb_q08/duckdb:vortex-file-compressed 22436849 22475293 1.00
duckdb / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3738559 3967049 0.94
fineweb_q01/duckdb:vortex-compact 102265382 105014980 0.97
fineweb_q02/duckdb:vortex-compact 113933769 110914196 1.03
fineweb_q03/duckdb:vortex-compact 856492751 853478152 1.00
fineweb_q04/duckdb:vortex-compact 904891901 892251287 1.01
fineweb_q05/duckdb:vortex-compact 808789499 799987751 1.01
fineweb_q06/duckdb:vortex-compact 461160231 465327814 0.99
fineweb_q07/duckdb:vortex-compact 474750199 469448103 1.01
fineweb_q08/duckdb:vortex-compact 23669243 22166494 1.07
duckdb / parquet (1.022x ➖, 0↑ 1↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31703981 30837365 1.03
fineweb_q01/duckdb:parquet 82803354 81504889 1.02
fineweb_q02/duckdb:parquet 83478215 82968524 1.01
fineweb_q03/duckdb:parquet 309546244 308844074 1.00
fineweb_q04/duckdb:parquet 439435236 439006680 1.00
fineweb_q05/duckdb:parquet 408180431 410438847 0.99
fineweb_q06/duckdb:parquet 198936674 198119215 1.00
fineweb_q07/duckdb:parquet 208070077 208993461 1.00
fineweb_q08/duckdb:parquet 🚨 32724130 28243126 1.16
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +9.7% +6.9% +2.7% +60.7% ➖ noise
0 datafusion:vortex-file-compressed +9.1% +6.9% +2.1% +48.6% ➖ noise
0 duckdb:vortex-compact -5.8% +6.9% -11.8% +112.3% ➖ noise
0 duckdb:vortex-file-compressed +10.5% +6.9% +3.4% +78.7% ➖ noise
1 datafusion:vortex-compact +86.8% -0.8% +88.4% +10.3% 🚨 regression
1 datafusion:vortex-file-compressed +6.9% -0.8% +7.8% +24.4% ➖ noise
1 duckdb:vortex-compact -2.6% -0.8% -1.8% +19.4% ➖ noise
1 duckdb:vortex-file-compressed +0.0% -0.8% +0.9% +58.4% ➖ noise
2 datafusion:vortex-compact +83.7% -1.3% +86.0% +10.0% 🚨 regression
2 datafusion:vortex-file-compressed +29.0% -1.3% +30.7% +11.1% 🚨 regression
2 duckdb:vortex-compact +2.7% -1.3% +4.1% +16.2% ➖ noise
2 duckdb:vortex-file-compressed +5.7% -1.3% +7.0% +10.5% ➖ noise
3 datafusion:vortex-compact +10.0% -0.4% +10.5% +10.0% 🚨 regression
3 datafusion:vortex-file-compressed +19.2% -0.4% +19.6% +46.7% ➖ noise
3 duckdb:vortex-compact +0.4% -0.4% +0.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -26.4% -0.4% -26.1% +35.2% ✅ faster
4 datafusion:vortex-compact +9.0% -0.6% +9.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +4.3% -0.6% +5.0% +10.0% ➖ noise
4 duckdb:vortex-compact +1.4% -0.6% +2.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.6% -0.6% +1.2% +10.0% ➖ noise
5 datafusion:vortex-compact +7.7% -0.8% +8.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.6% -0.8% +1.4% +10.0% ➖ noise
5 duckdb:vortex-compact +1.1% -0.8% +1.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.0% -0.8% -0.2% +10.0% ➖ noise
6 datafusion:vortex-compact +7.9% -0.9% +8.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.0% -0.9% -3.2% +10.0% ➖ noise
6 duckdb:vortex-compact -0.9% -0.9% -0.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.9% -0.9% +2.7% +10.0% ➖ noise
7 datafusion:vortex-compact +8.9% -1.1% +10.1% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed -1.5% -1.1% -0.4% +27.5% ➖ noise
7 duckdb:vortex-compact +1.1% -1.1% +2.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.0% -1.1% +3.2% +31.1% ➖ noise
8 datafusion:vortex-compact +17.3% +6.5% +10.1% +19.2% ➖ noise
8 datafusion:vortex-file-compressed +2.6% +6.5% -3.7% +10.3% ➖ noise
8 duckdb:vortex-compact +6.8% +6.5% +0.3% +31.2% ➖ noise
8 duckdb:vortex-file-compressed -0.2% +6.5% -6.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Vortex (geomean): 1.025x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.2%


datafusion / vortex-file-compressed (1.029x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 47314341 46822819 1.01
tpch_q02/datafusion:vortex-file-compressed 30077003 27505288 1.09
tpch_q03/datafusion:vortex-file-compressed 26777961 25154579 1.06
tpch_q04/datafusion:vortex-file-compressed 19425036 18341020 1.06
tpch_q05/datafusion:vortex-file-compressed 49293300 47019120 1.05
tpch_q06/datafusion:vortex-file-compressed 10064692 10631356 0.95
tpch_q07/datafusion:vortex-file-compressed 60494784 59343916 1.02
tpch_q08/datafusion:vortex-file-compressed 40601856 39327991 1.03
tpch_q09/datafusion:vortex-file-compressed 52369736 52846547 0.99
tpch_q10/datafusion:vortex-file-compressed 43008373 40643411 1.06
tpch_q11/datafusion:vortex-file-compressed 15069444 14721534 1.02
tpch_q12/datafusion:vortex-file-compressed 23374390 22786512 1.03
tpch_q13/datafusion:vortex-file-compressed 26458544 25496235 1.04
tpch_q14/datafusion:vortex-file-compressed 15279691 14688441 1.04
tpch_q15/datafusion:vortex-file-compressed 23037693 22039021 1.05
tpch_q16/datafusion:vortex-file-compressed 21562659 21114300 1.02
tpch_q17/datafusion:vortex-file-compressed 62191074 61916619 1.00
tpch_q18/datafusion:vortex-file-compressed 79309563 76632011 1.03
tpch_q19/datafusion:vortex-file-compressed 22692022 22269082 1.02
tpch_q20/datafusion:vortex-file-compressed 29548018 28464458 1.04
tpch_q21/datafusion:vortex-file-compressed 70608945 67525951 1.05
tpch_q22/datafusion:vortex-file-compressed 13646645 13699307 1.00
datafusion / vortex-compact (1.088x ➖, 0↑ 4↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 55478677 56053419 0.99
tpch_q02/datafusion:vortex-compact 33407059 31629745 1.06
tpch_q03/datafusion:vortex-compact 31548862 28697405 1.10
tpch_q04/datafusion:vortex-compact 🚨 25252642 22250162 1.13
tpch_q05/datafusion:vortex-compact 56572834 52464087 1.08
tpch_q06/datafusion:vortex-compact 14528940 13758277 1.06
tpch_q07/datafusion:vortex-compact 66926719 65101987 1.03
tpch_q08/datafusion:vortex-compact 46233832 44653318 1.04
tpch_q09/datafusion:vortex-compact 61806086 56953220 1.09
tpch_q10/datafusion:vortex-compact 🚨 67839023 48749826 1.39
tpch_q11/datafusion:vortex-compact 17919543 16731859 1.07
tpch_q12/datafusion:vortex-compact 33897642 32651262 1.04
tpch_q13/datafusion:vortex-compact 35103680 34508402 1.02
tpch_q14/datafusion:vortex-compact 🚨 21632559 19559142 1.11
tpch_q15/datafusion:vortex-compact 33799729 32400372 1.04
tpch_q16/datafusion:vortex-compact 25148262 24948130 1.01
tpch_q17/datafusion:vortex-compact 67768698 66008180 1.03
tpch_q18/datafusion:vortex-compact 87054288 82553876 1.05
tpch_q19/datafusion:vortex-compact 32492330 31792895 1.02
tpch_q20/datafusion:vortex-compact 37259653 36078450 1.03
tpch_q21/datafusion:vortex-compact 85158736 78632953 1.08
tpch_q22/datafusion:vortex-compact 🚨 23981182 14693861 1.63
datafusion / parquet (1.008x ➖, 1↑ 1↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 129799808 127184666 1.02
tpch_q02/datafusion:parquet 63634024 62429261 1.02
tpch_q03/datafusion:parquet 75003551 73460175 1.02
tpch_q04/datafusion:parquet 44744549 45215758 0.99
tpch_q05/datafusion:parquet 93122202 95630461 0.97
tpch_q06/datafusion:parquet 42895080 42779424 1.00
tpch_q07/datafusion:parquet 106800632 106310064 1.00
tpch_q08/datafusion:parquet 96508281 92970360 1.04
tpch_q09/datafusion:parquet 131889220 129195176 1.02
tpch_q10/datafusion:parquet 112274862 110552920 1.02
tpch_q11/datafusion:parquet 42124859 41227550 1.02
tpch_q12/datafusion:parquet 🚀 73689864 84151079 0.88
tpch_q13/datafusion:parquet 188271968 193325097 0.97
tpch_q14/datafusion:parquet 🚨 50203234 44805520 1.12
tpch_q15/datafusion:parquet 60120644 57701238 1.04
tpch_q16/datafusion:parquet 44818291 43585536 1.03
tpch_q17/datafusion:parquet 132113188 130977132 1.01
tpch_q18/datafusion:parquet 158686466 155059533 1.02
tpch_q19/datafusion:parquet 90026667 89547738 1.01
tpch_q20/datafusion:parquet 71090297 70262985 1.01
tpch_q21/datafusion:parquet 137431028 135642558 1.01
tpch_q22/datafusion:parquet 30312080 31080303 0.98
datafusion / arrow (0.999x ➖, 0↑ 1↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 55273297 54460055 1.01
tpch_q02/datafusion:arrow 18183824 18680021 0.97
tpch_q03/datafusion:arrow 29087267 29273329 0.99
tpch_q04/datafusion:arrow 25906490 24752387 1.05
tpch_q05/datafusion:arrow 76354799 70141295 1.09
tpch_q06/datafusion:arrow 🚨 22043769 19615618 1.12
tpch_q07/datafusion:arrow 102746889 100203779 1.03
tpch_q08/datafusion:arrow 40037751 42388706 0.94
tpch_q09/datafusion:arrow 59994805 62967952 0.95
tpch_q10/datafusion:arrow 45192708 48750837 0.93
tpch_q11/datafusion:arrow 8683329 9329330 0.93
tpch_q12/datafusion:arrow 51809099 52781058 0.98
tpch_q13/datafusion:arrow 47857046 47614469 1.01
tpch_q14/datafusion:arrow 21447991 21194221 1.01
tpch_q15/datafusion:arrow 41542536 41964360 0.99
tpch_q16/datafusion:arrow 18814168 18188253 1.03
tpch_q17/datafusion:arrow 66938024 67163908 1.00
tpch_q18/datafusion:arrow 132252372 132707618 1.00
tpch_q19/datafusion:arrow 34894835 36509603 0.96
tpch_q20/datafusion:arrow 34155876 34104920 1.00
tpch_q21/datafusion:arrow 145612952 147515776 0.99
tpch_q22/datafusion:arrow 17503474 17040889 1.03
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31507541 31817387 0.99
tpch_q02/duckdb:vortex-file-compressed 24900404 24923252 1.00
tpch_q03/duckdb:vortex-file-compressed 29313757 30193190 0.97
tpch_q04/duckdb:vortex-file-compressed 29439154 29287766 1.01
tpch_q05/duckdb:vortex-file-compressed 34040179 33194806 1.03
tpch_q06/duckdb:vortex-file-compressed 10475334 10876458 0.96
tpch_q07/duckdb:vortex-file-compressed 36997168 38142885 0.97
tpch_q08/duckdb:vortex-file-compressed 39571343 38177412 1.04
tpch_q09/duckdb:vortex-file-compressed 72051463 73216223 0.98
tpch_q10/duckdb:vortex-file-compressed 33997709 34731315 0.98
tpch_q11/duckdb:vortex-file-compressed 14796686 14979323 0.99
tpch_q12/duckdb:vortex-file-compressed 22024766 22131853 1.00
tpch_q13/duckdb:vortex-file-compressed 34723840 34580984 1.00
tpch_q14/duckdb:vortex-file-compressed 21953036 22081905 0.99
tpch_q15/duckdb:vortex-file-compressed 16385668 16519241 0.99
tpch_q16/duckdb:vortex-file-compressed 27648271 28457632 0.97
tpch_q17/duckdb:vortex-file-compressed 25331699 25282260 1.00
tpch_q18/duckdb:vortex-file-compressed 49613545 50142551 0.99
tpch_q19/duckdb:vortex-file-compressed 28787724 29206272 0.99
tpch_q20/duckdb:vortex-file-compressed 33931954 34069462 1.00
tpch_q21/duckdb:vortex-file-compressed 105092462 104993937 1.00
tpch_q22/duckdb:vortex-file-compressed 17352984 16847391 1.03
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38632902 38759091 1.00
tpch_q02/duckdb:vortex-compact 35602177 35095075 1.01
tpch_q03/duckdb:vortex-compact 32091893 32316375 0.99
tpch_q04/duckdb:vortex-compact 35735759 35302382 1.01
tpch_q05/duckdb:vortex-compact 37120900 38304168 0.97
tpch_q06/duckdb:vortex-compact 15189247 15001025 1.01
tpch_q07/duckdb:vortex-compact 42616994 42315523 1.01
tpch_q08/duckdb:vortex-compact 45497812 45720681 1.00
tpch_q09/duckdb:vortex-compact 82984807 82762208 1.00
tpch_q10/duckdb:vortex-compact 38918107 39972714 0.97
tpch_q11/duckdb:vortex-compact 18855607 19565813 0.96
tpch_q12/duckdb:vortex-compact 34858684 35042837 0.99
tpch_q13/duckdb:vortex-compact 43573284 43431052 1.00
tpch_q14/duckdb:vortex-compact 28792436 29200658 0.99
tpch_q15/duckdb:vortex-compact 19474554 19400062 1.00
tpch_q16/duckdb:vortex-compact 34044745 35594314 0.96
tpch_q17/duckdb:vortex-compact 30112664 30251031 1.00
tpch_q18/duckdb:vortex-compact 49169032 50887348 0.97
tpch_q19/duckdb:vortex-compact 34745811 34671827 1.00
tpch_q20/duckdb:vortex-compact 42111558 42124168 1.00
tpch_q21/duckdb:vortex-compact 110976355 109434299 1.01
tpch_q22/duckdb:vortex-compact 19271302 19447306 0.99
duckdb / parquet (0.972x ➖, 2↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 78106173 77479116 1.01
tpch_q02/duckdb:parquet 38976126 38804073 1.00
tpch_q03/duckdb:parquet 69044132 70848036 0.97
tpch_q04/duckdb:parquet 46932530 46289015 1.01
tpch_q05/duckdb:parquet 65840509 67445886 0.98
tpch_q06/duckdb:parquet 20470451 20669579 0.99
tpch_q07/duckdb:parquet 65950143 66226012 1.00
tpch_q08/duckdb:parquet 88885209 96774777 0.92
tpch_q09/duckdb:parquet 🚀 131812086 155176773 0.85
tpch_q10/duckdb:parquet 114610670 119474323 0.96
tpch_q11/duckdb:parquet 21884294 21806722 1.00
tpch_q12/duckdb:parquet 45073723 45180715 1.00
tpch_q13/duckdb:parquet 247963961 246615063 1.01
tpch_q14/duckdb:parquet 46501703 49159540 0.95
tpch_q15/duckdb:parquet 24164128 24305205 0.99
tpch_q16/duckdb:parquet 55158272 55706097 0.99
tpch_q17/duckdb:parquet 🚀 50558554 57215422 0.88
tpch_q18/duckdb:parquet 110812096 112641907 0.98
tpch_q19/duckdb:parquet 65157691 67560298 0.96
tpch_q20/duckdb:parquet 62672729 63109380 0.99
tpch_q21/duckdb:parquet 158206335 164430471 0.96
tpch_q22/duckdb:parquet 51585842 52020579 0.99
duckdb / duckdb (0.997x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15794664 15966448 0.99
tpch_q02/duckdb:duckdb 12683549 12254134 1.04
tpch_q03/duckdb:duckdb 19067722 18882907 1.01
tpch_q04/duckdb:duckdb 19279449 18789861 1.03
tpch_q05/duckdb:duckdb 19655505 20372078 0.96
tpch_q06/duckdb:duckdb 5397256 5126365 1.05
tpch_q07/duckdb:duckdb 22258542 21762237 1.02
tpch_q08/duckdb:duckdb 20760478 20710007 1.00
tpch_q09/duckdb:duckdb 52257871 54680632 0.96
tpch_q10/duckdb:duckdb 43508587 43422890 1.00
tpch_q11/duckdb:duckdb 5748887 5724979 1.00
tpch_q12/duckdb:duckdb 14198284 13613272 1.04
tpch_q13/duckdb:duckdb 37612457 37595067 1.00
tpch_q14/duckdb:duckdb 16462035 18027610 0.91
tpch_q15/duckdb:duckdb 11787315 11724858 1.01
tpch_q16/duckdb:duckdb 23151025 23840178 0.97
tpch_q17/duckdb:duckdb 13433448 13751409 0.98
tpch_q18/duckdb:duckdb 38857278 37983927 1.02
tpch_q19/duckdb:duckdb 25818205 27073434 0.95
tpch_q20/duckdb:duckdb 22226401 22514500 0.99
tpch_q21/duckdb:duckdb 56121464 55564384 1.01
tpch_q22/duckdb:duckdb 24400509 24645776 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +1.5% +1.4% +0.1% +17.2% ➖ noise
1 datafusion:vortex-compact -1.0% +1.4% -2.4% +16.7% ➖ noise
1 datafusion:vortex-file-compressed +1.0% +1.4% -0.4% +17.8% ➖ noise
1 duckdb:duckdb -1.1% +1.4% -2.5% +16.4% ➖ noise
1 duckdb:vortex-compact -0.3% +1.4% -1.7% +15.5% ➖ noise
1 duckdb:vortex-file-compressed -1.0% +1.4% -2.4% +18.7% ➖ noise
2 datafusion:arrow -2.7% +1.2% -3.8% +10.0% ➖ noise
2 datafusion:vortex-compact +5.6% +1.2% +4.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +9.3% +1.2% +8.1% +10.0% ➖ noise
2 duckdb:duckdb +3.5% +1.2% +2.3% +10.8% ➖ noise
2 duckdb:vortex-compact +1.4% +1.2% +0.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.1% +1.2% -1.3% +10.0% ➖ noise
3 datafusion:arrow -0.6% -0.2% -0.4% +10.0% ➖ noise
3 datafusion:vortex-compact +9.9% -0.2% +10.2% +10.8% ➖ noise
3 datafusion:vortex-file-compressed +6.5% -0.2% +6.7% +10.7% ➖ noise
3 duckdb:duckdb +1.0% -0.2% +1.2% +12.5% ➖ noise
3 duckdb:vortex-compact -0.7% -0.2% -0.4% +10.7% ➖ noise
3 duckdb:vortex-file-compressed -2.9% -0.2% -2.7% +14.9% ➖ noise
4 datafusion:arrow +4.7% +0.2% +4.5% +10.0% ➖ noise
4 datafusion:vortex-compact +13.5% +0.2% +13.3% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed +5.9% +0.2% +5.7% +10.0% ➖ noise
4 duckdb:duckdb +2.6% +0.2% +2.4% +10.0% ➖ noise
4 duckdb:vortex-compact +1.2% +0.2% +1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.5% +0.2% +0.3% +10.0% ➖ noise
5 datafusion:arrow +8.9% -2.5% +11.7% +10.3% 🚨 regression
5 datafusion:vortex-compact +7.8% -2.5% +10.6% +10.0% 🚨 regression
5 datafusion:vortex-file-compressed +4.8% -2.5% +7.5% +10.0% ➖ noise
5 duckdb:duckdb -3.5% -2.5% -1.0% +12.3% ➖ noise
5 duckdb:vortex-compact -3.1% -2.5% -0.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.5% -2.5% +5.2% +13.6% ➖ noise
6 datafusion:arrow +12.4% -0.3% +12.8% +17.0% ➖ noise
6 datafusion:vortex-compact +5.6% -0.3% +6.0% +15.4% ➖ noise
6 datafusion:vortex-file-compressed -5.3% -0.3% -5.0% +18.4% ➖ noise
6 duckdb:duckdb +5.3% -0.3% +5.7% +16.6% ➖ noise
6 duckdb:vortex-compact +1.3% -0.3% +1.6% +23.0% ➖ noise
6 duckdb:vortex-file-compressed -3.7% -0.3% -3.4% +15.8% ➖ noise
7 datafusion:arrow +2.5% +0.0% +2.5% +11.2% ➖ noise
7 datafusion:vortex-compact +2.8% +0.0% +2.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.9% +0.0% +1.9% +10.0% ➖ noise
7 duckdb:duckdb +2.3% +0.0% +2.3% +10.0% ➖ noise
7 duckdb:vortex-compact +0.7% +0.0% +0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.0% +0.0% -3.0% +10.0% ➖ noise
8 datafusion:arrow -5.5% -2.4% -3.3% +10.0% ➖ noise
8 datafusion:vortex-compact +3.5% -2.4% +6.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +3.2% -2.4% +5.7% +10.0% ➖ noise
8 duckdb:duckdb +0.2% -2.4% +2.7% +10.8% ➖ noise
8 duckdb:vortex-compact -0.5% -2.4% +1.9% +10.6% ➖ noise
8 duckdb:vortex-file-compressed +3.7% -2.4% +6.2% +14.1% ➖ noise
9 datafusion:arrow -4.7% -6.9% +2.3% +10.0% ➖ noise
9 datafusion:vortex-compact +8.5% -6.9% +16.5% +10.0% 🚨 regression
9 datafusion:vortex-file-compressed -0.9% -6.9% +6.4% +10.0% ➖ noise
9 duckdb:duckdb -4.4% -6.9% +2.6% +10.0% ➖ noise
9 duckdb:vortex-compact +0.3% -6.9% +7.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.6% -6.9% +5.7% +10.0% ➖ noise
10 datafusion:arrow -7.3% -1.3% -6.1% +10.0% ➖ noise
10 datafusion:vortex-compact +39.2% -1.3% +41.0% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +5.8% -1.3% +7.2% +10.0% ➖ noise
10 duckdb:duckdb +0.2% -1.3% +1.5% +11.8% ➖ noise
10 duckdb:vortex-compact -2.6% -1.3% -1.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.1% -1.3% -0.8% +10.0% ➖ noise
11 datafusion:arrow -6.9% +1.3% -8.1% +10.0% ➖ noise
11 datafusion:vortex-compact +7.1% +1.3% +5.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.4% +1.3% +1.1% +10.0% ➖ noise
11 duckdb:duckdb +0.4% +1.3% -0.8% +10.0% ➖ noise
11 duckdb:vortex-compact -3.6% +1.3% -4.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.2% +1.3% -2.5% +10.0% ➖ noise
12 datafusion:arrow -1.8% -6.5% +5.0% +17.2% ➖ noise
12 datafusion:vortex-compact +3.8% -6.5% +11.1% +11.0% 🚨 regression
12 datafusion:vortex-file-compressed +2.6% -6.5% +9.7% +10.4% ➖ noise
12 duckdb:duckdb +4.3% -6.5% +11.6% +11.0% 🚨 regression
12 duckdb:vortex-compact -0.5% -6.5% +6.4% +11.1% ➖ noise
12 duckdb:vortex-file-compressed -0.5% -6.5% +6.5% +13.1% ➖ noise
13 datafusion:arrow +0.5% -1.0% +1.6% +10.0% ➖ noise
13 datafusion:vortex-compact +1.7% -1.0% +2.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +3.8% -1.0% +4.9% +10.0% ➖ noise
13 duckdb:duckdb +0.0% -1.0% +1.1% +10.0% ➖ noise
13 duckdb:vortex-compact +0.3% -1.0% +1.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.4% -1.0% +1.5% +10.0% ➖ noise
14 datafusion:arrow +1.2% +3.0% -1.7% +14.3% ➖ noise
14 datafusion:vortex-compact +10.6% +3.0% +7.4% +13.3% ➖ noise
14 datafusion:vortex-file-compressed +4.0% +3.0% +1.0% +12.3% ➖ noise
14 duckdb:duckdb -8.7% +3.0% -11.3% +15.6% ➖ noise
14 duckdb:vortex-compact -1.4% +3.0% -4.2% +13.8% ➖ noise
14 duckdb:vortex-file-compressed -0.6% +3.0% -3.4% +12.9% ➖ noise
15 datafusion:arrow -1.0% +1.8% -2.7% +11.9% ➖ noise
15 datafusion:vortex-compact +4.3% +1.8% +2.5% +12.9% ➖ noise
15 datafusion:vortex-file-compressed +4.5% +1.8% +2.7% +13.6% ➖ noise
15 duckdb:duckdb +0.5% +1.8% -1.2% +14.1% ➖ noise
15 duckdb:vortex-compact +0.4% +1.8% -1.4% +14.1% ➖ noise
15 duckdb:vortex-file-compressed -0.8% +1.8% -2.5% +12.9% ➖ noise
16 datafusion:arrow +3.4% +0.9% +2.5% +10.0% ➖ noise
16 datafusion:vortex-compact +0.8% +0.9% -0.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.1% +0.9% +1.2% +10.0% ➖ noise
16 duckdb:duckdb -2.9% +0.9% -3.8% +10.1% ➖ noise
16 duckdb:vortex-compact -4.4% +0.9% -5.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -2.8% +0.9% -3.7% +10.0% ➖ noise
17 datafusion:arrow -0.3% -5.6% +5.6% +10.5% ➖ noise
17 datafusion:vortex-compact +2.7% -5.6% +8.7% +10.6% ➖ noise
17 datafusion:vortex-file-compressed +0.4% -5.6% +6.4% +10.0% ➖ noise
17 duckdb:duckdb -2.3% -5.6% +3.5% +10.5% ➖ noise
17 duckdb:vortex-compact -0.5% -5.6% +5.4% +12.0% ➖ noise
17 duckdb:vortex-file-compressed +0.2% -5.6% +6.1% +13.3% ➖ noise
18 datafusion:arrow -0.3% +0.3% -0.7% +10.0% ➖ noise
18 datafusion:vortex-compact +5.5% +0.3% +5.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +3.5% +0.3% +3.1% +10.0% ➖ noise
18 duckdb:duckdb +2.3% +0.3% +2.0% +10.0% ➖ noise
18 duckdb:vortex-compact -3.4% +0.3% -3.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.1% +0.3% -1.4% +10.0% ➖ noise
19 datafusion:arrow -4.4% -1.5% -2.9% +17.3% ➖ noise
19 datafusion:vortex-compact +2.2% -1.5% +3.8% +12.8% ➖ noise
19 datafusion:vortex-file-compressed +1.9% -1.5% +3.5% +13.3% ➖ noise
19 duckdb:duckdb -4.6% -1.5% -3.2% +17.1% ➖ noise
19 duckdb:vortex-compact +0.2% -1.5% +1.8% +13.5% ➖ noise
19 duckdb:vortex-file-compressed -1.4% -1.5% +0.1% +13.1% ➖ noise
20 datafusion:arrow +0.1% +0.2% -0.1% +10.0% ➖ noise
20 datafusion:vortex-compact +3.3% +0.2% +3.0% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +3.8% +0.2% +3.6% +10.0% ➖ noise
20 duckdb:duckdb -1.3% +0.2% -1.5% +11.3% ➖ noise
20 duckdb:vortex-compact -0.0% +0.2% -0.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.4% +0.2% -0.6% +10.0% ➖ noise
21 datafusion:arrow -1.3% -1.3% -0.0% +10.0% ➖ noise
21 datafusion:vortex-compact +8.3% -1.3% +9.7% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +4.6% -1.3% +5.9% +10.0% ➖ noise
21 duckdb:duckdb +1.0% -1.3% +2.3% +10.0% ➖ noise
21 duckdb:vortex-compact +1.4% -1.3% +2.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.1% -1.3% +1.4% +10.0% ➖ noise
22 datafusion:arrow +2.7% -1.7% +4.4% +10.0% ➖ noise
22 datafusion:vortex-compact +63.2% -1.7% +66.0% +10.0% 🚨 regression
22 datafusion:vortex-file-compressed -0.4% -1.7% +1.3% +10.3% ➖ noise
22 duckdb:duckdb -1.0% -1.7% +0.7% +10.0% ➖ noise
22 duckdb:vortex-compact -0.9% -1.7% +0.8% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +3.0% -1.7% +4.7% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Vortex (geomean): 1.014x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.1%


datafusion / vortex-file-compressed (1.032x ➖, 0↑ 9↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 20327245 20128293 1.01
tpcds_q02/datafusion:vortex-file-compressed 47112466 47746456 0.99
tpcds_q03/datafusion:vortex-file-compressed 16575887 16525016 1.00
tpcds_q04/datafusion:vortex-file-compressed 273175160 257649563 1.06
tpcds_q05/datafusion:vortex-file-compressed 44784026 44593035 1.00
tpcds_q06/datafusion:vortex-file-compressed 42293956 41019809 1.03
tpcds_q07/datafusion:vortex-file-compressed 44347999 43114322 1.03
tpcds_q08/datafusion:vortex-file-compressed 29185310 29054329 1.00
tpcds_q09/datafusion:vortex-file-compressed 48881610 47221259 1.04
tpcds_q10/datafusion:vortex-file-compressed 🚨 44206825 34844050 1.27
tpcds_q11/datafusion:vortex-file-compressed 154367204 147197668 1.05
tpcds_q12/datafusion:vortex-file-compressed 19188669 19159610 1.00
tpcds_q13/datafusion:vortex-file-compressed 51721818 50011936 1.03
tpcds_q14/datafusion:vortex-file-compressed 170898417 167796398 1.02
tpcds_q15/datafusion:vortex-file-compressed 29622649 29653284 1.00
tpcds_q16/datafusion:vortex-file-compressed 24942936 23663909 1.05
tpcds_q17/datafusion:vortex-file-compressed 60811891 57853278 1.05
tpcds_q18/datafusion:vortex-file-compressed 66629040 65481353 1.02
tpcds_q19/datafusion:vortex-file-compressed 24084004 23964989 1.00
tpcds_q20/datafusion:vortex-file-compressed 22333231 21318583 1.05
tpcds_q21/datafusion:vortex-file-compressed 127917039 127646678 1.00
tpcds_q22/datafusion:vortex-file-compressed 56270607 52529879 1.07
tpcds_q23/datafusion:vortex-file-compressed 130795927 129776182 1.01
tpcds_q24/datafusion:vortex-file-compressed 99089059 98046379 1.01
tpcds_q25/datafusion:vortex-file-compressed 59758224 58876675 1.01
tpcds_q26/datafusion:vortex-file-compressed 32127739 34084002 0.94
tpcds_q27/datafusion:vortex-file-compressed 105577252 104882805 1.01
tpcds_q28/datafusion:vortex-file-compressed 43343681 45946470 0.94
tpcds_q29/datafusion:vortex-file-compressed 59056482 58084271 1.02
tpcds_q30/datafusion:vortex-file-compressed 🚨 27503566 23502765 1.17
tpcds_q31/datafusion:vortex-file-compressed 83540587 80329558 1.04
tpcds_q32/datafusion:vortex-file-compressed 18029813 17135557 1.05
tpcds_q33/datafusion:vortex-file-compressed 29265916 28472287 1.03
tpcds_q34/datafusion:vortex-file-compressed 27475806 26857561 1.02
tpcds_q35/datafusion:vortex-file-compressed 🚨 49208598 43055306 1.14
tpcds_q36/datafusion:vortex-file-compressed 62861759 63178816 0.99
tpcds_q37/datafusion:vortex-file-compressed 🚨 33484957 29652559 1.13
tpcds_q38/datafusion:vortex-file-compressed 45885346 43814254 1.05
tpcds_q39/datafusion:vortex-file-compressed 121338479 122931227 0.99
tpcds_q40/datafusion:vortex-file-compressed 47455189 47666214 1.00
tpcds_q41/datafusion:vortex-file-compressed 15880431 15811330 1.00
tpcds_q42/datafusion:vortex-file-compressed 15126333 15174344 1.00
tpcds_q43/datafusion:vortex-file-compressed 29252888 28535378 1.03
tpcds_q44/datafusion:vortex-file-compressed 35135558 34085544 1.03
tpcds_q45/datafusion:vortex-file-compressed 30050311 29664699 1.01
tpcds_q46/datafusion:vortex-file-compressed 39684747 38921129 1.02
tpcds_q47/datafusion:vortex-file-compressed 189710320 184018991 1.03
tpcds_q48/datafusion:vortex-file-compressed 🚨 45289586 40651593 1.11
tpcds_q49/datafusion:vortex-file-compressed 59236922 58691590 1.01
tpcds_q50/datafusion:vortex-file-compressed 39438561 38933534 1.01
tpcds_q51/datafusion:vortex-file-compressed 86797218 83002622 1.05
tpcds_q52/datafusion:vortex-file-compressed 16043347 15049359 1.07
tpcds_q53/datafusion:vortex-file-compressed 19989658 20639573 0.97
tpcds_q54/datafusion:vortex-file-compressed 35360438 34392554 1.03
tpcds_q55/datafusion:vortex-file-compressed 14945109 14753340 1.01
tpcds_q56/datafusion:vortex-file-compressed 31286013 30417526 1.03
tpcds_q57/datafusion:vortex-file-compressed 117414940 118980138 0.99
tpcds_q58/datafusion:vortex-file-compressed 61908458 60742876 1.02
tpcds_q59/datafusion:vortex-file-compressed 65253478 64964795 1.00
tpcds_q60/datafusion:vortex-file-compressed 31764529 30095291 1.06
tpcds_q61/datafusion:vortex-file-compressed 41988754 38911516 1.08
tpcds_q62/datafusion:vortex-file-compressed 27775544 28264194 0.98
tpcds_q63/datafusion:vortex-file-compressed 20461182 20027499 1.02
tpcds_q64/datafusion:vortex-file-compressed 424254962 427046424 0.99
tpcds_q65/datafusion:vortex-file-compressed 42530032 40260897 1.06
tpcds_q66/datafusion:vortex-file-compressed 85811891 83272057 1.03
tpcds_q67/datafusion:vortex-file-compressed 110334943 111104339 0.99
tpcds_q68/datafusion:vortex-file-compressed 40017445 39330239 1.02
tpcds_q69/datafusion:vortex-file-compressed 🚨 42902758 33106551 1.30
tpcds_q70/datafusion:vortex-file-compressed 101773625 101177601 1.01
tpcds_q71/datafusion:vortex-file-compressed 26578934 25183966 1.06
tpcds_q72/datafusion:vortex-file-compressed 2463046914 2387048870 1.03
tpcds_q73/datafusion:vortex-file-compressed 26924058 25621647 1.05
tpcds_q74/datafusion:vortex-file-compressed 102279120 97410542 1.05
tpcds_q75/datafusion:vortex-file-compressed 106223130 103300175 1.03
tpcds_q76/datafusion:vortex-file-compressed 27321869 27473108 0.99
tpcds_q77/datafusion:vortex-file-compressed 40213556 39740055 1.01
tpcds_q78/datafusion:vortex-file-compressed 114204815 113308205 1.01
tpcds_q79/datafusion:vortex-file-compressed 33584237 30983108 1.08
tpcds_q80/datafusion:vortex-file-compressed 94503663 96190435 0.98
tpcds_q81/datafusion:vortex-file-compressed 30606170 28016610 1.09
tpcds_q82/datafusion:vortex-file-compressed 🚨 34665428 29972896 1.16
tpcds_q83/datafusion:vortex-file-compressed 40290195 38783315 1.04
tpcds_q84/datafusion:vortex-file-compressed 🚨 13553876 12267968 1.10
tpcds_q85/datafusion:vortex-file-compressed 89758557 89372478 1.00
tpcds_q86/datafusion:vortex-file-compressed 16258583 16430469 0.99
tpcds_q87/datafusion:vortex-file-compressed 46952221 45997863 1.02
tpcds_q88/datafusion:vortex-file-compressed 58086246 56216162 1.03
tpcds_q89/datafusion:vortex-file-compressed 32432966 32588113 1.00
tpcds_q90/datafusion:vortex-file-compressed 13724757 13869102 0.99
tpcds_q91/datafusion:vortex-file-compressed 🚨 23575068 20704947 1.14
tpcds_q92/datafusion:vortex-file-compressed 15672415 15676635 1.00
tpcds_q93/datafusion:vortex-file-compressed 30872378 29582605 1.04
tpcds_q94/datafusion:vortex-file-compressed 19931109 19496674 1.02
tpcds_q95/datafusion:vortex-file-compressed 53370803 50618640 1.05
tpcds_q96/datafusion:vortex-file-compressed 12686837 12445822 1.02
tpcds_q97/datafusion:vortex-file-compressed 27528108 26443635 1.04
tpcds_q98/datafusion:vortex-file-compressed 27827415 28279590 0.98
tpcds_q99/datafusion:vortex-file-compressed 40772269 41610906 0.98
datafusion / vortex-compact (1.057x ➖, 0↑ 14↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 28941234 26385041 1.10
tpcds_q02/datafusion:vortex-compact 56197874 54885628 1.02
tpcds_q03/datafusion:vortex-compact 22594314 22982936 0.98
tpcds_q04/datafusion:vortex-compact 🚨 341720656 301839601 1.13
tpcds_q05/datafusion:vortex-compact 55504542 57309640 0.97
tpcds_q06/datafusion:vortex-compact 50245278 50083313 1.00
tpcds_q07/datafusion:vortex-compact 62781698 57929618 1.08
tpcds_q08/datafusion:vortex-compact 39632155 39032558 1.02
tpcds_q09/datafusion:vortex-compact 67066192 62768769 1.07
tpcds_q10/datafusion:vortex-compact 🚨 83014268 59798687 1.39
tpcds_q11/datafusion:vortex-compact 🚨 200497971 176259776 1.14
tpcds_q12/datafusion:vortex-compact 23347653 23560261 0.99
tpcds_q13/datafusion:vortex-compact 118595104 115820864 1.02
tpcds_q14/datafusion:vortex-compact 231666983 234571876 0.99
tpcds_q15/datafusion:vortex-compact 34746080 33677012 1.03
tpcds_q16/datafusion:vortex-compact 35007039 35924521 0.97
tpcds_q17/datafusion:vortex-compact 90980472 85242089 1.07
tpcds_q18/datafusion:vortex-compact 79609143 77819623 1.02
tpcds_q19/datafusion:vortex-compact 39336855 38894677 1.01
tpcds_q20/datafusion:vortex-compact 26432067 25871703 1.02
tpcds_q21/datafusion:vortex-compact 137282208 129164857 1.06
tpcds_q22/datafusion:vortex-compact 67012900 63266815 1.06
tpcds_q23/datafusion:vortex-compact 179833333 167966506 1.07
tpcds_q24/datafusion:vortex-compact 🚨 142291927 128951782 1.10
tpcds_q25/datafusion:vortex-compact 91459251 86499163 1.06
tpcds_q26/datafusion:vortex-compact 46373725 43285898 1.07
tpcds_q27/datafusion:vortex-compact 🚨 155596531 141017090 1.10
tpcds_q28/datafusion:vortex-compact 88207817 85676366 1.03
tpcds_q29/datafusion:vortex-compact 90800499 87747245 1.03
tpcds_q30/datafusion:vortex-compact 🚨 36805108 28606496 1.29
tpcds_q31/datafusion:vortex-compact 132781419 127324557 1.04
tpcds_q32/datafusion:vortex-compact 24430534 22683181 1.08
tpcds_q33/datafusion:vortex-compact 🚨 50934245 46133451 1.10
tpcds_q34/datafusion:vortex-compact 48871534 45721951 1.07
tpcds_q35/datafusion:vortex-compact 🚨 76413388 61423734 1.24
tpcds_q36/datafusion:vortex-compact 93838853 87727221 1.07
tpcds_q37/datafusion:vortex-compact 🚨 48208077 43128390 1.12
tpcds_q38/datafusion:vortex-compact 66336140 64815219 1.02
tpcds_q39/datafusion:vortex-compact 150167159 137719932 1.09
tpcds_q40/datafusion:vortex-compact 53492781 51823955 1.03
tpcds_q41/datafusion:vortex-compact 19810979 18167014 1.09
tpcds_q42/datafusion:vortex-compact 22417017 20615714 1.09
tpcds_q43/datafusion:vortex-compact 36625175 34902950 1.05
tpcds_q44/datafusion:vortex-compact 68663973 65925283 1.04
tpcds_q45/datafusion:vortex-compact 35771778 34326563 1.04
tpcds_q46/datafusion:vortex-compact 65854469 62516502 1.05
tpcds_q47/datafusion:vortex-compact 221133650 211022128 1.05
tpcds_q48/datafusion:vortex-compact 91876391 85520425 1.07
tpcds_q49/datafusion:vortex-compact 82272537 79305880 1.04
tpcds_q50/datafusion:vortex-compact 60070076 57974660 1.04
tpcds_q51/datafusion:vortex-compact 100403852 97779607 1.03
tpcds_q52/datafusion:vortex-compact 22114687 22172553 1.00
tpcds_q53/datafusion:vortex-compact 32680742 31046492 1.05
tpcds_q54/datafusion:vortex-compact 53727835 53406743 1.01
tpcds_q55/datafusion:vortex-compact 21508041 20726300 1.04
tpcds_q56/datafusion:vortex-compact 50043697 47365647 1.06
tpcds_q57/datafusion:vortex-compact 133561731 129151705 1.03
tpcds_q58/datafusion:vortex-compact 74175756 68498235 1.08
tpcds_q59/datafusion:vortex-compact 83398870 78986120 1.06
tpcds_q60/datafusion:vortex-compact 50238889 48006253 1.05
tpcds_q61/datafusion:vortex-compact 67762775 64161721 1.06
tpcds_q62/datafusion:vortex-compact 30776557 30769730 1.00
tpcds_q63/datafusion:vortex-compact 33197535 31779031 1.04
tpcds_q64/datafusion:vortex-compact 506875957 501294951 1.01
tpcds_q65/datafusion:vortex-compact 66429773 65587769 1.01
tpcds_q66/datafusion:vortex-compact 91130132 88527211 1.03
tpcds_q67/datafusion:vortex-compact 123357742 118402115 1.04
tpcds_q68/datafusion:vortex-compact 65927409 65486394 1.01
tpcds_q69/datafusion:vortex-compact 🚨 78359476 55951942 1.40
tpcds_q70/datafusion:vortex-compact 119106018 114899355 1.04
tpcds_q71/datafusion:vortex-compact 43992920 42827568 1.03
tpcds_q72/datafusion:vortex-compact 2388406939 2424709048 0.99
tpcds_q73/datafusion:vortex-compact 47213707 44537593 1.06
tpcds_q74/datafusion:vortex-compact 135246006 126392314 1.07
tpcds_q75/datafusion:vortex-compact 153640275 145807484 1.05
tpcds_q76/datafusion:vortex-compact 44758144 45194247 0.99
tpcds_q77/datafusion:vortex-compact 60673211 57624137 1.05
tpcds_q78/datafusion:vortex-compact 143330671 140536523 1.02
tpcds_q79/datafusion:vortex-compact 55590661 57130697 0.97
tpcds_q80/datafusion:vortex-compact 122440994 116005580 1.06
tpcds_q81/datafusion:vortex-compact 35159976 33896676 1.04
tpcds_q82/datafusion:vortex-compact 🚨 50175248 44076489 1.14
tpcds_q83/datafusion:vortex-compact 48578609 46173961 1.05
tpcds_q84/datafusion:vortex-compact 🚨 18557268 14645818 1.27
tpcds_q85/datafusion:vortex-compact 122289624 117252516 1.04
tpcds_q86/datafusion:vortex-compact 20341141 20001404 1.02
tpcds_q87/datafusion:vortex-compact 64657634 62549776 1.03
tpcds_q88/datafusion:vortex-compact 133752749 127969741 1.05
tpcds_q89/datafusion:vortex-compact 43402708 42014727 1.03
tpcds_q90/datafusion:vortex-compact 20450413 20613507 0.99
tpcds_q91/datafusion:vortex-compact 🚨 41668291 34881387 1.19
tpcds_q92/datafusion:vortex-compact 23292704 23420737 0.99
tpcds_q93/datafusion:vortex-compact 🚨 47133360 41234493 1.14
tpcds_q94/datafusion:vortex-compact 28781642 26224546 1.10
tpcds_q95/datafusion:vortex-compact 68150492 63951336 1.07
tpcds_q96/datafusion:vortex-compact 24274375 23529572 1.03
tpcds_q97/datafusion:vortex-compact 38955199 39038016 1.00
tpcds_q98/datafusion:vortex-compact 36038397 34800543 1.04
tpcds_q99/datafusion:vortex-compact 43915978 45311438 0.97
datafusion / parquet (0.992x ➖, 1↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 28860859 30696691 0.94
tpcds_q02/datafusion:parquet 40831022 41442224 0.99
tpcds_q03/datafusion:parquet 🚀 13365784 14855919 0.90
tpcds_q04/datafusion:parquet 261328975 259203255 1.01
tpcds_q05/datafusion:parquet 41257480 41274221 1.00
tpcds_q06/datafusion:parquet 58765180 59297890 0.99
tpcds_q07/datafusion:parquet 79396695 77502125 1.02
tpcds_q08/datafusion:parquet 26333853 26324144 1.00
tpcds_q09/datafusion:parquet 45169775 44338282 1.02
tpcds_q10/datafusion:parquet 71778807 70756833 1.01
tpcds_q11/datafusion:parquet 148618374 148288782 1.00
tpcds_q12/datafusion:parquet 17783194 18028512 0.99
tpcds_q13/datafusion:parquet 74573111 75240594 0.99
tpcds_q14/datafusion:parquet 161557433 165366545 0.98
tpcds_q15/datafusion:parquet 20992653 21607048 0.97
tpcds_q16/datafusion:parquet 23532961 23793364 0.99
tpcds_q17/datafusion:parquet 63460555 66946561 0.95
tpcds_q18/datafusion:parquet 112757167 115510991 0.98
tpcds_q19/datafusion:parquet 22103842 23018969 0.96
tpcds_q20/datafusion:parquet 16279016 16153809 1.01
tpcds_q21/datafusion:parquet 18002413 18815500 0.96
tpcds_q22/datafusion:parquet 139754299 142722078 0.98
tpcds_q23/datafusion:parquet 143463635 150769538 0.95
tpcds_q24/datafusion:parquet 89527876 89821973 1.00
tpcds_q25/datafusion:parquet 63306747 64292170 0.98
tpcds_q26/datafusion:parquet 65575861 66404741 0.99
tpcds_q27/datafusion:parquet 148686475 147340541 1.01
tpcds_q28/datafusion:parquet 45124691 46174536 0.98
tpcds_q29/datafusion:parquet 64625059 67423644 0.96
tpcds_q30/datafusion:parquet 34068581 34900924 0.98
tpcds_q31/datafusion:parquet 64294935 64180220 1.00
tpcds_q32/datafusion:parquet 17579291 18256239 0.96
tpcds_q33/datafusion:parquet 26347265 26737742 0.99
tpcds_q34/datafusion:parquet 21740850 20956235 1.04
tpcds_q35/datafusion:parquet 69844363 71671576 0.97
tpcds_q36/datafusion:parquet 55592556 55844338 1.00
tpcds_q37/datafusion:parquet 18970429 18623524 1.02
tpcds_q38/datafusion:parquet 40593033 43771062 0.93
tpcds_q39/datafusion:parquet 71558069 70276170 1.02
tpcds_q40/datafusion:parquet 23713222 22956636 1.03
tpcds_q41/datafusion:parquet 13222864 13153309 1.01
tpcds_q42/datafusion:parquet 11745242 12075245 0.97
tpcds_q43/datafusion:parquet 16151207 16900045 0.96
tpcds_q44/datafusion:parquet 32809573 31651746 1.04
tpcds_q45/datafusion:parquet 27835696 27314055 1.02
tpcds_q46/datafusion:parquet 31910584 31382797 1.02
tpcds_q47/datafusion:parquet 123997801 122550206 1.01
tpcds_q48/datafusion:parquet 69121377 70611386 0.98
tpcds_q49/datafusion:parquet 54755894 54347395 1.01
tpcds_q50/datafusion:parquet 42396336 42982805 0.99
tpcds_q51/datafusion:parquet 84896849 83379029 1.02
tpcds_q52/datafusion:parquet 12044908 12412792 0.97
tpcds_q53/datafusion:parquet 18537957 17578590 1.05
tpcds_q54/datafusion:parquet 33773122 34268733 0.99
tpcds_q55/datafusion:parquet 11281866 12409344 0.91
tpcds_q56/datafusion:parquet 27297618 27475085 0.99
tpcds_q57/datafusion:parquet 91837635 93980420 0.98
tpcds_q58/datafusion:parquet 48810820 49384197 0.99
tpcds_q59/datafusion:parquet 51945695 53015262 0.98
tpcds_q60/datafusion:parquet 27508307 26850224 1.02
tpcds_q61/datafusion:parquet 42959402 42802984 1.00
tpcds_q62/datafusion:parquet 24767856 24647627 1.00
tpcds_q63/datafusion:parquet 18052822 17416249 1.04
tpcds_q64/datafusion:parquet 501897009 510156848 0.98
tpcds_q65/datafusion:parquet 37651632 37151330 1.01
tpcds_q66/datafusion:parquet 72837960 69163511 1.05
tpcds_q67/datafusion:parquet 141492559 144633920 0.98
tpcds_q68/datafusion:parquet 32163464 32500055 0.99
tpcds_q69/datafusion:parquet 67151562 69273170 0.97
tpcds_q70/datafusion:parquet 86231961 83487037 1.03
tpcds_q71/datafusion:parquet 23034670 22870951 1.01
tpcds_q72/datafusion:parquet 579999233 586715104 0.99
tpcds_q73/datafusion:parquet 21823328 22195431 0.98
tpcds_q74/datafusion:parquet 84373488 81211516 1.04
tpcds_q75/datafusion:parquet 97273573 97634071 1.00
tpcds_q76/datafusion:parquet 29452006 30572621 0.96
tpcds_q77/datafusion:parquet 38030928 39090071 0.97
tpcds_q78/datafusion:parquet 109381905 108336682 1.01
tpcds_q79/datafusion:parquet 27977802 26770148 1.05
tpcds_q80/datafusion:parquet 76601662 77868274 0.98
tpcds_q81/datafusion:parquet 32077263 31499484 1.02
tpcds_q82/datafusion:parquet 19626487 19596833 1.00
tpcds_q83/datafusion:parquet 36399893 38156745 0.95
tpcds_q84/datafusion:parquet 39513139 38781131 1.02
tpcds_q85/datafusion:parquet 145767067 147827080 0.99
tpcds_q86/datafusion:parquet 15329554 15416180 0.99
tpcds_q87/datafusion:parquet 41254842 41589424 0.99
tpcds_q88/datafusion:parquet 59585840 59429940 1.00
tpcds_q89/datafusion:parquet 21199841 21119335 1.00
tpcds_q90/datafusion:parquet 14097971 13960533 1.01
tpcds_q91/datafusion:parquet 59037757 60315446 0.98
tpcds_q92/datafusion:parquet 18475675 18941195 0.98
tpcds_q93/datafusion:parquet 30180111 31108047 0.97
tpcds_q94/datafusion:parquet 20272919 20907617 0.97
tpcds_q95/datafusion:parquet 57343207 57072986 1.00
tpcds_q96/datafusion:parquet 11864610 12721433 0.93
tpcds_q97/datafusion:parquet 29358070 29400398 1.00
tpcds_q98/datafusion:parquet 20977496 21025704 1.00
tpcds_q99/datafusion:parquet 24570318 23959618 1.03
duckdb / vortex-file-compressed (0.984x ➖, 2↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21794449 21338405 1.02
tpcds_q02/duckdb:vortex-file-compressed 36202634 36165805 1.00
tpcds_q03/duckdb:vortex-file-compressed 30129240 32916957 0.92
tpcds_q04/duckdb:vortex-file-compressed 105328565 103992773 1.01
tpcds_q05/duckdb:vortex-file-compressed 36307720 36047050 1.01
tpcds_q06/duckdb:vortex-file-compressed 32965429 32986482 1.00
tpcds_q07/duckdb:vortex-file-compressed 19481263 20687261 0.94
tpcds_q08/duckdb:vortex-file-compressed 28912961 27492898 1.05
tpcds_q09/duckdb:vortex-file-compressed 39989072 39649901 1.01
tpcds_q10/duckdb:vortex-file-compressed 40755307 40753031 1.00
tpcds_q11/duckdb:vortex-file-compressed 59243036 62291219 0.95
tpcds_q12/duckdb:vortex-file-compressed 14486357 14560110 0.99
tpcds_q13/duckdb:vortex-file-compressed 34127543 33668543 1.01
tpcds_q14/duckdb:vortex-file-compressed 107382143 106595263 1.01
tpcds_q15/duckdb:vortex-file-compressed 27102962 26979663 1.00
tpcds_q16/duckdb:vortex-file-compressed 26526626 27379529 0.97
tpcds_q17/duckdb:vortex-file-compressed 42732091 43507151 0.98
tpcds_q18/duckdb:vortex-file-compressed 47626448 48113321 0.99
tpcds_q19/duckdb:vortex-file-compressed 33765779 33500304 1.01
tpcds_q20/duckdb:vortex-file-compressed 15281751 15631202 0.98
tpcds_q21/duckdb:vortex-file-compressed 16960266 17024056 1.00
tpcds_q22/duckdb:vortex-file-compressed 72114696 69693229 1.03
tpcds_q23/duckdb:vortex-file-compressed 99044014 105774716 0.94
tpcds_q24/duckdb:vortex-file-compressed 49866167 51068461 0.98
tpcds_q25/duckdb:vortex-file-compressed 48639821 49416620 0.98
tpcds_q26/duckdb:vortex-file-compressed 40524840 41112387 0.99
tpcds_q27/duckdb:vortex-file-compressed 44986691 48818817 0.92
tpcds_q28/duckdb:vortex-file-compressed 36687023 35633807 1.03
tpcds_q29/duckdb:vortex-file-compressed 41886380 42038735 1.00
tpcds_q30/duckdb:vortex-file-compressed 24167029 24576241 0.98
tpcds_q31/duckdb:vortex-file-compressed 36320446 36420698 1.00
tpcds_q32/duckdb:vortex-file-compressed 14290291 14321648 1.00
tpcds_q33/duckdb:vortex-file-compressed 25252342 24879220 1.01
tpcds_q34/duckdb:vortex-file-compressed 23826592 23325751 1.02
tpcds_q35/duckdb:vortex-file-compressed 62975384 63883958 0.99
tpcds_q36/duckdb:vortex-file-compressed 25817224 25665005 1.01
tpcds_q37/duckdb:vortex-file-compressed 15642464 15851762 0.99
tpcds_q38/duckdb:vortex-file-compressed 36430294 38065181 0.96
tpcds_q39/duckdb:vortex-file-compressed 35535643 33758882 1.05
tpcds_q40/duckdb:vortex-file-compressed 19195131 19745435 0.97
tpcds_q41/duckdb:vortex-file-compressed 13343243 13535352 0.99
tpcds_q42/duckdb:vortex-file-compressed 12943391 14088217 0.92
tpcds_q43/duckdb:vortex-file-compressed 23348537 22548979 1.04
tpcds_q44/duckdb:vortex-file-compressed 21071568 21210764 0.99
tpcds_q45/duckdb:vortex-file-compressed 28778547 30255689 0.95
tpcds_q46/duckdb:vortex-file-compressed 52122548 52248582 1.00
tpcds_q47/duckdb:vortex-file-compressed 45851375 47014042 0.98
tpcds_q48/duckdb:vortex-file-compressed 29948483 31724627 0.94
tpcds_q49/duckdb:vortex-file-compressed 34258304 34061435 1.01
tpcds_q50/duckdb:vortex-file-compressed 33952656 34355333 0.99
tpcds_q51/duckdb:vortex-file-compressed 97217825 99132075 0.98
tpcds_q52/duckdb:vortex-file-compressed 12756235 12798311 1.00
tpcds_q53/duckdb:vortex-file-compressed 23103190 23308561 0.99
tpcds_q54/duckdb:vortex-file-compressed 28559409 29641089 0.96
tpcds_q55/duckdb:vortex-file-compressed 12998571 13251604 0.98
tpcds_q56/duckdb:vortex-file-compressed 24247343 25591638 0.95
tpcds_q57/duckdb:vortex-file-compressed 39231598 39278913 1.00
tpcds_q58/duckdb:vortex-file-compressed 28370159 29853575 0.95
tpcds_q59/duckdb:vortex-file-compressed 67373884 66033554 1.02
tpcds_q60/duckdb:vortex-file-compressed 26222978 26912704 0.97
tpcds_q61/duckdb:vortex-file-compressed 32666211 35358552 0.92
tpcds_q62/duckdb:vortex-file-compressed 17549141 17382254 1.01
tpcds_q63/duckdb:vortex-file-compressed 21347584 21646673 0.99
tpcds_q64/duckdb:vortex-file-compressed 87368213 84839140 1.03
tpcds_q65/duckdb:vortex-file-compressed 22833790 22138892 1.03
tpcds_q66/duckdb:vortex-file-compressed 29792845 29814292 1.00
tpcds_q67/duckdb:vortex-file-compressed 135495003 138513125 0.98
tpcds_q68/duckdb:vortex-file-compressed 41907640 42036589 1.00
tpcds_q69/duckdb:vortex-file-compressed 41357371 41449205 1.00
tpcds_q70/duckdb:vortex-file-compressed 26189359 26740312 0.98
tpcds_q71/duckdb:vortex-file-compressed 21171698 20855101 1.02
tpcds_q72/duckdb:vortex-file-compressed 171472521 169792586 1.01
tpcds_q73/duckdb:vortex-file-compressed 22751255 24329855 0.94
tpcds_q74/duckdb:vortex-file-compressed 73060480 74171471 0.99
tpcds_q75/duckdb:vortex-file-compressed 55741235 57211911 0.97
tpcds_q76/duckdb:vortex-file-compressed 18806364 20304607 0.93
tpcds_q77/duckdb:vortex-file-compressed 26660883 26186556 1.02
tpcds_q78/duckdb:vortex-file-compressed 74787936 74660850 1.00
tpcds_q79/duckdb:vortex-file-compressed 32721052 33657977 0.97
tpcds_q80/duckdb:vortex-file-compressed 47069365 47349587 0.99
tpcds_q81/duckdb:vortex-file-compressed 28109108 28016896 1.00
tpcds_q82/duckdb:vortex-file-compressed 16767497 17328244 0.97
tpcds_q83/duckdb:vortex-file-compressed 24387009 24855942 0.98
tpcds_q84/duckdb:vortex-file-compressed 19412525 20439723 0.95
tpcds_q85/duckdb:vortex-file-compressed 45550196 46456316 0.98
tpcds_q86/duckdb:vortex-file-compressed 17730575 17311648 1.02
tpcds_q87/duckdb:vortex-file-compressed 39017038 41617569 0.94
tpcds_q88/duckdb:vortex-file-compressed 34490604 34462984 1.00
tpcds_q89/duckdb:vortex-file-compressed 23206226 22642392 1.02
tpcds_q90/duckdb:vortex-file-compressed 12754900 12893206 0.99
tpcds_q91/duckdb:vortex-file-compressed 30684396 30724784 1.00
tpcds_q92/duckdb:vortex-file-compressed 🚀 21307357 24580674 0.87
tpcds_q93/duckdb:vortex-file-compressed 29438024 30437470 0.97
tpcds_q94/duckdb:vortex-file-compressed 23888256 24001031 1.00
tpcds_q95/duckdb:vortex-file-compressed 🚀 122196938 144310907 0.85
tpcds_q96/duckdb:vortex-file-compressed 12716593 13964622 0.91
tpcds_q97/duckdb:vortex-file-compressed 38417669 37500203 1.02
tpcds_q98/duckdb:vortex-file-compressed 18290333 18579153 0.98
tpcds_q99/duckdb:vortex-file-compressed 27784726 28060999 0.99
duckdb / vortex-compact (0.984x ➖, 2↑ 1↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24483381 23238148 1.05
tpcds_q02/duckdb:vortex-compact 🚀 31901152 40908410 0.78
tpcds_q03/duckdb:vortex-compact 56858577 59262814 0.96
tpcds_q04/duckdb:vortex-compact 119392398 117821722 1.01
tpcds_q05/duckdb:vortex-compact 51556859 55882601 0.92
tpcds_q06/duckdb:vortex-compact 40716698 40273465 1.01
tpcds_q07/duckdb:vortex-compact 34605555 34621477 1.00
tpcds_q08/duckdb:vortex-compact 47307177 46103743 1.03
tpcds_q09/duckdb:vortex-compact 58399997 57974009 1.01
tpcds_q10/duckdb:vortex-compact 60697436 63810711 0.95
tpcds_q11/duckdb:vortex-compact 69484927 72384416 0.96
tpcds_q12/duckdb:vortex-compact 22158777 24343814 0.91
tpcds_q13/duckdb:vortex-compact 59652156 58479223 1.02
tpcds_q14/duckdb:vortex-compact 137560975 133251764 1.03
tpcds_q15/duckdb:vortex-compact 31648363 32153097 0.98
tpcds_q16/duckdb:vortex-compact 31026901 33274811 0.93
tpcds_q17/duckdb:vortex-compact 54185859 56101336 0.97
tpcds_q18/duckdb:vortex-compact 61631956 58152352 1.06
tpcds_q19/duckdb:vortex-compact 50964412 52745687 0.97
tpcds_q20/duckdb:vortex-compact 20138556 20223151 1.00
tpcds_q21/duckdb:vortex-compact 18853544 18868350 1.00
tpcds_q22/duckdb:vortex-compact 76596378 76319970 1.00
tpcds_q23/duckdb:vortex-compact 119300487 127270732 0.94
tpcds_q24/duckdb:vortex-compact 63993960 64630215 0.99
tpcds_q25/duckdb:vortex-compact 80886869 80013696 1.01
tpcds_q26/duckdb:vortex-compact 51153005 53478673 0.96
tpcds_q27/duckdb:vortex-compact 68865471 71203758 0.97
tpcds_q28/duckdb:vortex-compact 82803121 86511079 0.96
tpcds_q29/duckdb:vortex-compact 54163075 54402227 1.00
tpcds_q30/duckdb:vortex-compact 29920512 28112688 1.06
tpcds_q31/duckdb:vortex-compact 45860044 46343475 0.99
tpcds_q32/duckdb:vortex-compact 23270174 23198802 1.00
tpcds_q33/duckdb:vortex-compact 38651794 36427368 1.06
tpcds_q34/duckdb:vortex-compact 39926451 39510256 1.01
tpcds_q35/duckdb:vortex-compact 81487667 83827493 0.97
tpcds_q36/duckdb:vortex-compact 42324089 42159219 1.00
tpcds_q37/duckdb:vortex-compact 23684192 25764377 0.92
tpcds_q38/duckdb:vortex-compact 47859297 48791859 0.98
tpcds_q39/duckdb:vortex-compact 🚨 40854638 36278977 1.13
tpcds_q40/duckdb:vortex-compact 25663283 25417039 1.01
tpcds_q41/duckdb:vortex-compact 15653922 15834957 0.99
tpcds_q42/duckdb:vortex-compact 22612489 23446079 0.96
tpcds_q43/duckdb:vortex-compact 35200543 38713525 0.91
tpcds_q44/duckdb:vortex-compact 31481114 29853717 1.05
tpcds_q45/duckdb:vortex-compact 37861438 39465919 0.96
tpcds_q46/duckdb:vortex-compact 71904042 71495825 1.01
tpcds_q47/duckdb:vortex-compact 62687999 62205982 1.01
tpcds_q48/duckdb:vortex-compact 53238866 54656640 0.97
tpcds_q49/duckdb:vortex-compact 58190068 56182469 1.04
tpcds_q50/duckdb:vortex-compact 46841351 47578233 0.98
tpcds_q51/duckdb:vortex-compact 108259415 107805639 1.00
tpcds_q52/duckdb:vortex-compact 22701228 22730042 1.00
tpcds_q53/duckdb:vortex-compact 38246381 41705583 0.92
tpcds_q54/duckdb:vortex-compact 40846918 41688291 0.98
tpcds_q55/duckdb:vortex-compact 23125946 23142263 1.00
tpcds_q56/duckdb:vortex-compact 37604640 37342192 1.01
tpcds_q57/duckdb:vortex-compact 43903489 43520239 1.01
tpcds_q58/duckdb:vortex-compact 43961096 43667250 1.01
tpcds_q59/duckdb:vortex-compact 89313682 90347861 0.99
tpcds_q60/duckdb:vortex-compact 39189599 39216187 1.00
tpcds_q61/duckdb:vortex-compact 64031744 66858980 0.96
tpcds_q62/duckdb:vortex-compact 27160445 26881148 1.01
tpcds_q63/duckdb:vortex-compact 37847269 39116887 0.97
tpcds_q64/duckdb:vortex-compact 117266672 120270611 0.98
tpcds_q65/duckdb:vortex-compact 33039590 33531790 0.99
tpcds_q66/duckdb:vortex-compact 40065358 40055182 1.00
tpcds_q67/duckdb:vortex-compact 148915293 152588920 0.98
tpcds_q68/duckdb:vortex-compact 61185621 64592439 0.95
tpcds_q69/duckdb:vortex-compact 64706353 64178443 1.01
tpcds_q70/duckdb:vortex-compact 37260218 37926746 0.98
tpcds_q71/duckdb:vortex-compact 34436718 35334344 0.97
tpcds_q72/duckdb:vortex-compact 189641961 190533610 1.00
tpcds_q73/duckdb:vortex-compact 37374934 39534394 0.95
tpcds_q74/duckdb:vortex-compact 80937328 83079360 0.97
tpcds_q75/duckdb:vortex-compact 71363366 75250674 0.95
tpcds_q76/duckdb:vortex-compact 36965011 36542959 1.01
tpcds_q77/duckdb:vortex-compact 41054874 42681140 0.96
tpcds_q78/duckdb:vortex-compact 88642768 88255306 1.00
tpcds_q79/duckdb:vortex-compact 55833319 55011592 1.01
tpcds_q80/duckdb:vortex-compact 78930999 85565909 0.92
tpcds_q81/duckdb:vortex-compact 33410779 34141872 0.98
tpcds_q82/duckdb:vortex-compact 🚀 24404114 27316195 0.89
tpcds_q83/duckdb:vortex-compact 33367462 31978774 1.04
tpcds_q84/duckdb:vortex-compact 26674164 26986694 0.99
tpcds_q85/duckdb:vortex-compact 56270198 61259673 0.92
tpcds_q86/duckdb:vortex-compact 22888892 22595176 1.01
tpcds_q87/duckdb:vortex-compact 49573529 51918157 0.95
tpcds_q88/duckdb:vortex-compact 41405889 41263166 1.00
tpcds_q89/duckdb:vortex-compact 38253366 39219575 0.98
tpcds_q90/duckdb:vortex-compact 15325539 15526409 0.99
tpcds_q91/duckdb:vortex-compact 52159345 52612115 0.99
tpcds_q92/duckdb:vortex-compact 57283137 57072045 1.00
tpcds_q93/duckdb:vortex-compact 31931522 30413162 1.05
tpcds_q94/duckdb:vortex-compact 29915942 32369857 0.92
tpcds_q95/duckdb:vortex-compact 149799269 156919270 0.95
tpcds_q96/duckdb:vortex-compact 19086155 18217273 1.05
tpcds_q97/duckdb:vortex-compact 44169907 44218400 1.00
tpcds_q98/duckdb:vortex-compact 29870318 29599521 1.01
tpcds_q99/duckdb:vortex-compact 31217360 32571984 0.96
duckdb / parquet (0.997x ➖, 1↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29831495 28062690 1.06
tpcds_q02/duckdb:parquet 22408415 23036852 0.97
tpcds_q03/duckdb:parquet 10968344 11395621 0.96
tpcds_q04/duckdb:parquet 165970381 166187593 1.00
tpcds_q05/duckdb:parquet 28652353 30571469 0.94
tpcds_q06/duckdb:parquet 27268229 26840454 1.02
tpcds_q07/duckdb:parquet 20648950 20838255 0.99
tpcds_q08/duckdb:parquet 26116412 26942169 0.97
tpcds_q09/duckdb:parquet 39486559 38737505 1.02
tpcds_q10/duckdb:parquet 33099349 32668792 1.01
tpcds_q11/duckdb:parquet 88144874 88963421 0.99
tpcds_q12/duckdb:parquet 13707697 14447203 0.95
tpcds_q13/duckdb:parquet 32560657 32914228 0.99
tpcds_q14/duckdb:parquet 99101122 98459537 1.01
tpcds_q15/duckdb:parquet 28748513 28509587 1.01
tpcds_q16/duckdb:parquet 20441445 20375110 1.00
tpcds_q17/duckdb:parquet 36713785 35880493 1.02
tpcds_q18/duckdb:parquet 46402446 45155420 1.03
tpcds_q19/duckdb:parquet 27924578 28671532 0.97
tpcds_q20/duckdb:parquet 15441144 15284778 1.01
tpcds_q21/duckdb:parquet 🚀 10032212 12003040 0.84
tpcds_q22/duckdb:parquet 70164694 67563935 1.04
tpcds_q23/duckdb:parquet 79335286 80877036 0.98
tpcds_q24/duckdb:parquet 44529665 44575767 1.00
tpcds_q25/duckdb:parquet 33543467 33073942 1.01
tpcds_q26/duckdb:parquet 35169146 35316350 1.00
tpcds_q27/duckdb:parquet 48718251 48126272 1.01
tpcds_q28/duckdb:parquet 36985728 37054387 1.00
tpcds_q29/duckdb:parquet 36928000 36385515 1.01
tpcds_q30/duckdb:parquet 34918570 34665425 1.01
tpcds_q31/duckdb:parquet 22912479 22731514 1.01
tpcds_q32/duckdb:parquet 10659574 11513775 0.93
tpcds_q33/duckdb:parquet 20078397 20908802 0.96
tpcds_q34/duckdb:parquet 19992753 19990910 1.00
tpcds_q35/duckdb:parquet 58883093 56728026 1.04
tpcds_q36/duckdb:parquet 19167878 19487183 0.98
tpcds_q37/duckdb:parquet 11416591 12356501 0.92
tpcds_q38/duckdb:parquet 31963672 32494992 0.98
tpcds_q39/duckdb:parquet 28542945 29193876 0.98
tpcds_q40/duckdb:parquet 16986290 17432654 0.97
tpcds_q41/duckdb:parquet 7319611 7453836 0.98
tpcds_q42/duckdb:parquet 9881286 9856323 1.00
tpcds_q43/duckdb:parquet 14785778 14957217 0.99
tpcds_q44/duckdb:parquet 22596680 21787142 1.04
tpcds_q45/duckdb:parquet 25692116 24608347 1.04
tpcds_q46/duckdb:parquet 44935134 46181822 0.97
tpcds_q47/duckdb:parquet 43480045 43045905 1.01
tpcds_q48/duckdb:parquet 28851401 28749952 1.00
tpcds_q49/duckdb:parquet 23592233 24549915 0.96
tpcds_q50/duckdb:parquet 23913693 23996829 1.00
tpcds_q51/duckdb:parquet 92530653 94143274 0.98
tpcds_q52/duckdb:parquet 10455793 10128268 1.03
tpcds_q53/duckdb:parquet 15156074 14703383 1.03
tpcds_q54/duckdb:parquet 24035288 24136213 1.00
tpcds_q55/duckdb:parquet 9642384 9625639 1.00
tpcds_q56/duckdb:parquet 20115239 20579817 0.98
tpcds_q57/duckdb:parquet 33543248 34229258 0.98
tpcds_q58/duckdb:parquet 21750963 21401521 1.02
tpcds_q59/duckdb:parquet 35330968 35207408 1.00
tpcds_q60/duckdb:parquet 21071738 21280549 0.99
tpcds_q61/duckdb:parquet 30756851 30352483 1.01
tpcds_q62/duckdb:parquet 11603418 11195955 1.04
tpcds_q63/duckdb:parquet 13712500 13890940 0.99
tpcds_q64/duckdb:parquet 72959190 72486616 1.01
tpcds_q65/duckdb:parquet 19017161 19546407 0.97
tpcds_q66/duckdb:parquet 27668241 29168367 0.95
tpcds_q67/duckdb:parquet 133341478 134830899 0.99
tpcds_q68/duckdb:parquet 35432296 36571723 0.97
tpcds_q69/duckdb:parquet 35089189 35042813 1.00
tpcds_q70/duckdb:parquet 19696728 19919752 0.99
tpcds_q71/duckdb:parquet 19222061 19238042 1.00
tpcds_q72/duckdb:parquet 171883221 165689245 1.04
tpcds_q73/duckdb:parquet 17290668 18353060 0.94
tpcds_q74/duckdb:parquet 127988126 127900254 1.00
tpcds_q75/duckdb:parquet 51849370 51816752 1.00
tpcds_q76/duckdb:parquet 18797876 18748505 1.00
tpcds_q77/duckdb:parquet 21019465 21346660 0.98
tpcds_q78/duckdb:parquet 73257725 73532710 1.00
tpcds_q79/duckdb:parquet 27235143 26154690 1.04
tpcds_q80/duckdb:parquet 39145502 39752592 0.98
tpcds_q81/duckdb:parquet 31410802 31253535 1.01
tpcds_q82/duckdb:parquet 13201016 13097915 1.01
tpcds_q83/duckdb:parquet 16496902 15673747 1.05
tpcds_q84/duckdb:parquet 19043840 18059038 1.05
tpcds_q85/duckdb:parquet 37917233 38468375 0.99
tpcds_q86/duckdb:parquet 11809280 11875446 0.99
tpcds_q87/duckdb:parquet 36158074 36718128 0.98
tpcds_q88/duckdb:parquet 48160702 48576040 0.99
tpcds_q89/duckdb:parquet 17043299 15995176 1.07
tpcds_q90/duckdb:parquet 7340606 8082929 0.91
tpcds_q91/duckdb:parquet 22204921 21739077 1.02
tpcds_q92/duckdb:parquet 11160338 10942388 1.02
tpcds_q93/duckdb:parquet 28596578 29067358 0.98
tpcds_q94/duckdb:parquet 16116980 15416754 1.05
tpcds_q95/duckdb:parquet 141596486 129306010 1.10
tpcds_q96/duckdb:parquet 8358070 8480120 0.99
tpcds_q97/duckdb:parquet 35958455 33762898 1.07
tpcds_q98/duckdb:parquet 17274592 18848460 0.92
tpcds_q99/duckdb:parquet 19985765 19176951 1.04
duckdb / duckdb (1.000x ➖, 0↑ 3↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19509086 20823860 0.94
tpcds_q02/duckdb:duckdb 18375162 17875915 1.03
tpcds_q03/duckdb:duckdb 8182180 8295535 0.99
tpcds_q04/duckdb:duckdb 172347344 173524525 0.99
tpcds_q05/duckdb:duckdb 18712016 19158545 0.98
tpcds_q06/duckdb:duckdb 22402773 22146115 1.01
tpcds_q07/duckdb:duckdb 37331973 37655676 0.99
tpcds_q08/duckdb:duckdb 119948164 120188110 1.00
tpcds_q09/duckdb:duckdb 19581752 20007523 0.98
tpcds_q10/duckdb:duckdb 23451145 22671286 1.03
tpcds_q11/duckdb:duckdb 86151036 90310875 0.95
tpcds_q12/duckdb:duckdb 11617643 11271897 1.03
tpcds_q13/duckdb:duckdb 24077528 24142161 1.00
tpcds_q14/duckdb:duckdb 92961749 92016092 1.01
tpcds_q15/duckdb:duckdb 24295259 24717614 0.98
tpcds_q16/duckdb:duckdb 16603776 16527789 1.00
tpcds_q17/duckdb:duckdb 21587809 22747347 0.95
tpcds_q18/duckdb:duckdb 43072920 45383340 0.95
tpcds_q19/duckdb:duckdb 17439275 16752346 1.04
tpcds_q20/duckdb:duckdb 11546703 11377398 1.01
tpcds_q21/duckdb:duckdb 6972402 6664374 1.05
tpcds_q22/duckdb:duckdb 61286639 62939356 0.97
tpcds_q23/duckdb:duckdb 80289993 82159035 0.98
tpcds_q24/duckdb:duckdb 24412445 24010665 1.02
tpcds_q25/duckdb:duckdb 16596341 17583808 0.94
tpcds_q26/duckdb:duckdb 26462298 26440629 1.00
tpcds_q27/duckdb:duckdb 35999764 37139441 0.97
tpcds_q28/duckdb:duckdb 22155921 22226279 1.00
tpcds_q29/duckdb:duckdb 20890041 20592010 1.01
tpcds_q30/duckdb:duckdb 28500707 28864639 0.99
tpcds_q31/duckdb:duckdb 48436895 49270115 0.98
tpcds_q32/duckdb:duckdb 7457201 7515531 0.99
tpcds_q33/duckdb:duckdb 12787587 12318582 1.04
tpcds_q34/duckdb:duckdb 14862543 14632311 1.02
tpcds_q35/duckdb:duckdb 31928960 32739070 0.98
tpcds_q36/duckdb:duckdb 70181850 68733830 1.02
tpcds_q37/duckdb:duckdb 7836242 7274169 1.08
tpcds_q38/duckdb:duckdb 30473635 31156614 0.98
tpcds_q39/duckdb:duckdb 25003750 25932951 0.96
tpcds_q40/duckdb:duckdb 12374177 13210497 0.94
tpcds_q41/duckdb:duckdb 8456990 9190396 0.92
tpcds_q42/duckdb:duckdb 6713587 6692187 1.00
tpcds_q43/duckdb:duckdb 11122382 11348330 0.98
tpcds_q44/duckdb:duckdb 13341676 12956084 1.03
tpcds_q45/duckdb:duckdb 17341448 16590083 1.05
tpcds_q46/duckdb:duckdb 36322427 37281068 0.97
tpcds_q47/duckdb:duckdb 39679083 39499427 1.00
tpcds_q48/duckdb:duckdb 22265492 23297341 0.96
tpcds_q49/duckdb:duckdb 16832853 17049207 0.99
tpcds_q50/duckdb:duckdb 14678105 14039516 1.05
tpcds_q51/duckdb:duckdb 90220316 90641605 1.00
tpcds_q52/duckdb:duckdb 7253033 7447122 0.97
tpcds_q53/duckdb:duckdb 12929828 13337339 0.97
tpcds_q54/duckdb:duckdb 16151339 15791341 1.02
tpcds_q55/duckdb:duckdb 7013242 6987639 1.00
tpcds_q56/duckdb:duckdb 13235419 14276726 0.93
tpcds_q57/duckdb:duckdb 32331638 32565285 0.99
tpcds_q58/duckdb:duckdb 12497103 12220691 1.02
tpcds_q59/duckdb:duckdb 35311969 35141464 1.00
tpcds_q60/duckdb:duckdb 15219551 14471463 1.05
tpcds_q61/duckdb:duckdb 14808444 14537490 1.02
tpcds_q62/duckdb:duckdb 9186969 9595950 0.96
tpcds_q63/duckdb:duckdb 13138538 12658887 1.04
tpcds_q64/duckdb:duckdb 54567210 52587085 1.04
tpcds_q65/duckdb:duckdb 34928838 34649515 1.01
tpcds_q66/duckdb:duckdb 25581318 25718239 0.99
tpcds_q67/duckdb:duckdb 129312872 130931458 0.99
tpcds_q68/duckdb:duckdb 25187667 25347549 0.99
tpcds_q69/duckdb:duckdb 24656783 25161676 0.98
tpcds_q70/duckdb:duckdb 14037741 14507854 0.97
tpcds_q71/duckdb:duckdb 🚨 13214779 11496198 1.15
tpcds_q72/duckdb:duckdb 40851863 43469252 0.94
tpcds_q73/duckdb:duckdb 11641888 10762081 1.08
tpcds_q74/duckdb:duckdb 143109466 145154869 0.99
tpcds_q75/duckdb:duckdb 41713923 40917715 1.02
tpcds_q76/duckdb:duckdb 11822035 12238182 0.97
tpcds_q77/duckdb:duckdb 12020944 12101870 0.99
tpcds_q78/duckdb:duckdb 62262363 59854296 1.04
tpcds_q79/duckdb:duckdb 17615202 18842553 0.93
tpcds_q80/duckdb:duckdb 27286306 26587094 1.03
tpcds_q81/duckdb:duckdb 36666993 35989887 1.02
tpcds_q82/duckdb:duckdb 8330601 8027765 1.04
tpcds_q83/duckdb:duckdb 9022495 9067357 1.00
tpcds_q84/duckdb:duckdb 13643964 13647121 1.00
tpcds_q85/duckdb:duckdb 23513682 23938011 0.98
tpcds_q86/duckdb:duckdb 10323841 10073201 1.02
tpcds_q87/duckdb:duckdb 36220557 34040960 1.06
tpcds_q88/duckdb:duckdb 25557276 25893983 0.99
tpcds_q89/duckdb:duckdb 14519040 14450380 1.00
tpcds_q90/duckdb:duckdb 5381380 5448786 0.99
tpcds_q91/duckdb:duckdb 12453618 13428451 0.93
tpcds_q92/duckdb:duckdb 8932510 8851223 1.01
tpcds_q93/duckdb:duckdb 🚨 22663171 20552976 1.10
tpcds_q94/duckdb:duckdb 13130877 12345171 1.06
tpcds_q95/duckdb:duckdb 🚨 125399984 110191329 1.14
tpcds_q96/duckdb:duckdb 4485253 4711347 0.95
tpcds_q97/duckdb:duckdb 30668300 31429159 0.98
tpcds_q98/duckdb:duckdb 13697963 14176279 0.97
tpcds_q99/duckdb:duckdb 16483968 16410791 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +9.7% -0.0% +9.7% +25.5% ➖ noise
1 datafusion:vortex-file-compressed +1.0% -0.0% +1.0% +22.3% ➖ noise
1 duckdb:duckdb -6.3% -0.0% -6.3% +23.8% ➖ noise
1 duckdb:vortex-compact +5.4% -0.0% +5.4% +23.6% ➖ noise
1 duckdb:vortex-file-compressed +2.1% -0.0% +2.2% +35.9% ➖ noise
2 datafusion:vortex-compact +2.4% -2.1% +4.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.3% -2.1% +0.8% +10.0% ➖ noise
2 duckdb:duckdb +2.8% -2.1% +5.0% +10.0% ➖ noise
2 duckdb:vortex-compact -22.0% -2.1% -20.3% +23.9% ✅ faster
2 duckdb:vortex-file-compressed +0.1% -2.1% +2.3% +28.0% ➖ noise
3 datafusion:vortex-compact -1.7% -6.9% +5.6% +13.4% ➖ noise
3 datafusion:vortex-file-compressed +0.3% -6.9% +7.8% +15.9% ➖ noise
3 duckdb:duckdb -1.4% -6.9% +6.0% +14.0% ➖ noise
3 duckdb:vortex-compact -4.1% -6.9% +3.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -8.5% -6.9% -1.6% +14.4% ➖ noise
4 datafusion:vortex-compact +13.2% +0.3% +12.8% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed +6.0% +0.3% +5.7% +10.0% ➖ noise
4 duckdb:duckdb -0.7% +0.3% -1.0% +10.0% ➖ noise
4 duckdb:vortex-compact +1.3% +0.3% +1.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.3% +0.3% +0.9% +12.5% ➖ noise
5 datafusion:vortex-compact -3.1% -3.2% +0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.4% -3.2% +3.8% +10.0% ➖ noise
5 duckdb:duckdb -2.3% -3.2% +0.9% +12.3% ➖ noise
5 duckdb:vortex-compact -7.7% -3.2% -4.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.7% -3.2% +4.1% +10.8% ➖ noise
6 datafusion:vortex-compact +0.3% +0.3% -0.0% +12.3% ➖ noise
6 datafusion:vortex-file-compressed +3.1% +0.3% +2.8% +10.0% ➖ noise
6 duckdb:duckdb +1.2% +0.3% +0.8% +13.3% ➖ noise
6 duckdb:vortex-compact +1.1% +0.3% +0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.1% +0.3% -0.4% +10.0% ➖ noise
7 datafusion:vortex-compact +8.4% +0.8% +7.6% +12.9% ➖ noise
7 datafusion:vortex-file-compressed +2.9% +0.8% +2.1% +10.0% ➖ noise
7 duckdb:duckdb -0.9% +0.8% -1.6% +17.7% ➖ noise
7 duckdb:vortex-compact -0.0% +0.8% -0.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.8% +0.8% -6.5% +27.3% ➖ noise
8 datafusion:vortex-compact +1.5% -1.5% +3.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.5% -1.5% +2.0% +10.0% ➖ noise
8 duckdb:duckdb -0.2% -1.5% +1.3% +10.0% ➖ noise
8 duckdb:vortex-compact +2.6% -1.5% +4.2% +13.3% ➖ noise
8 duckdb:vortex-file-compressed +5.2% -1.5% +6.8% +10.0% ➖ noise
9 datafusion:vortex-compact +6.8% +1.9% +4.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.5% +1.9% +1.6% +10.0% ➖ noise
9 duckdb:duckdb -2.1% +1.9% -4.0% +10.0% ➖ noise
9 duckdb:vortex-compact +0.7% +1.9% -1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.9% +1.9% -1.0% +11.6% ➖ noise
10 datafusion:vortex-compact +38.8% +1.4% +36.9% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +26.9% +1.4% +25.1% +10.0% 🚨 regression
10 duckdb:duckdb +3.4% +1.4% +2.0% +10.0% ➖ noise
10 duckdb:vortex-compact -4.9% +1.4% -6.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.0% +1.4% -1.4% +10.0% ➖ noise
11 datafusion:vortex-compact +13.8% -0.4% +14.2% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed +4.9% -0.4% +5.2% +10.0% ➖ noise
11 duckdb:duckdb -4.6% -0.4% -4.3% +13.2% ➖ noise
11 duckdb:vortex-compact -4.0% -0.4% -3.7% +14.2% ➖ noise
11 duckdb:vortex-file-compressed -4.9% -0.4% -4.6% +13.0% ➖ noise
12 datafusion:vortex-compact -0.9% -3.3% +2.4% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.2% -3.3% +3.5% +10.0% ➖ noise
12 duckdb:duckdb +3.1% -3.3% +6.5% +12.0% ➖ noise
12 duckdb:vortex-compact -9.0% -3.3% -5.9% +14.6% ➖ noise
12 duckdb:vortex-file-compressed -0.5% -3.3% +2.8% +10.8% ➖ noise
13 datafusion:vortex-compact +2.4% -1.0% +3.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +3.4% -1.0% +4.4% +10.0% ➖ noise
13 duckdb:duckdb -0.3% -1.0% +0.7% +11.6% ➖ noise
13 duckdb:vortex-compact +2.0% -1.0% +3.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.4% -1.0% +2.4% +10.0% ➖ noise
14 datafusion:vortex-compact -1.2% -0.8% -0.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.8% -0.8% +2.7% +10.0% ➖ noise
14 duckdb:duckdb +1.0% -0.8% +1.9% +10.0% ➖ noise
14 duckdb:vortex-compact +3.2% -0.8% +4.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.7% -0.8% +1.6% +10.0% ➖ noise
15 datafusion:vortex-compact +3.2% -1.0% +4.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.1% -1.0% +0.9% +10.0% ➖ noise
15 duckdb:duckdb -1.7% -1.0% -0.7% +10.0% ➖ noise
15 duckdb:vortex-compact -1.6% -1.0% -0.6% +10.1% ➖ noise
15 duckdb:vortex-file-compressed +0.5% -1.0% +1.5% +10.0% ➖ noise
16 datafusion:vortex-compact -2.6% -0.4% -2.2% +11.4% ➖ noise
16 datafusion:vortex-file-compressed +5.4% -0.4% +5.8% +10.0% ➖ noise
16 duckdb:duckdb +0.5% -0.4% +0.9% +10.0% ➖ noise
16 duckdb:vortex-compact -6.8% -0.4% -6.4% +17.9% ➖ noise
16 duckdb:vortex-file-compressed -3.1% -0.4% -2.7% +10.0% ➖ noise
17 datafusion:vortex-compact +6.7% -1.5% +8.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +5.1% -1.5% +6.7% +10.0% ➖ noise
17 duckdb:duckdb -5.1% -1.5% -3.6% +10.2% ➖ noise
17 duckdb:vortex-compact -3.4% -1.5% -1.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -1.8% -1.5% -0.3% +16.0% ➖ noise
18 datafusion:vortex-compact +2.3% +0.2% +2.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.8% +0.2% +1.6% +12.7% ➖ noise
18 duckdb:duckdb -5.1% +0.2% -5.2% +10.0% ➖ noise
18 duckdb:vortex-compact +6.0% +0.2% +5.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.0% +0.2% -1.2% +11.2% ➖ noise
19 datafusion:vortex-compact +1.1% -3.3% +4.6% +10.4% ➖ noise
19 datafusion:vortex-file-compressed +0.5% -3.3% +3.9% +10.0% ➖ noise
19 duckdb:duckdb +4.1% -3.3% +7.6% +13.8% ➖ noise
19 duckdb:vortex-compact -3.4% -3.3% -0.1% +13.3% ➖ noise
19 duckdb:vortex-file-compressed +0.8% -3.3% +4.2% +10.0% ➖ noise
20 datafusion:vortex-compact +2.2% +0.9% +1.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +4.8% +0.9% +3.8% +10.0% ➖ noise
20 duckdb:duckdb +1.5% +0.9% +0.6% +11.1% ➖ noise
20 duckdb:vortex-compact -0.4% +0.9% -1.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -2.2% +0.9% -3.1% +10.0% ➖ noise
21 datafusion:vortex-compact +6.3% -10.6% +18.9% +10.9% 🚨 regression
21 datafusion:vortex-file-compressed +0.2% -10.6% +12.1% +11.0% 🚨 regression
21 duckdb:duckdb +4.6% -10.6% +17.0% +16.3% 🚨 regression
21 duckdb:vortex-compact -0.1% -10.6% +11.7% +16.8% ➖ noise
21 duckdb:vortex-file-compressed -0.4% -10.6% +11.4% +11.7% ➖ noise
22 datafusion:vortex-compact +5.9% +0.8% +5.0% +18.7% ➖ noise
22 datafusion:vortex-file-compressed +7.1% +0.8% +6.2% +16.7% ➖ noise
22 duckdb:duckdb -2.6% +0.8% -3.4% +13.2% ➖ noise
22 duckdb:vortex-compact +0.4% +0.8% -0.5% +15.2% ➖ noise
22 duckdb:vortex-file-compressed +3.5% +0.8% +2.6% +14.9% ➖ noise
23 datafusion:vortex-compact +7.1% -3.4% +10.8% +10.0% 🚨 regression
23 datafusion:vortex-file-compressed +0.8% -3.4% +4.3% +10.0% ➖ noise
23 duckdb:duckdb -2.3% -3.4% +1.2% +24.3% ➖ noise
23 duckdb:vortex-compact -6.3% -3.4% -3.0% +17.8% ➖ noise
23 duckdb:vortex-file-compressed -6.4% -3.4% -3.1% +16.3% ➖ noise
24 datafusion:vortex-compact +10.3% -0.2% +10.6% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed +1.1% -0.2% +1.3% +10.0% ➖ noise
24 duckdb:duckdb +1.7% -0.2% +1.9% +10.0% ➖ noise
24 duckdb:vortex-compact -1.0% -0.2% -0.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -2.4% -0.2% -2.1% +12.0% ➖ noise
25 datafusion:vortex-compact +5.7% -0.1% +5.8% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +1.5% -0.1% +1.6% +10.0% ➖ noise
25 duckdb:duckdb -5.6% -0.1% -5.6% +10.0% ➖ noise
25 duckdb:vortex-compact +1.1% -0.1% +1.2% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -1.6% -0.1% -1.5% +10.0% ➖ noise
26 datafusion:vortex-compact +7.1% -0.8% +8.0% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -5.7% -0.8% -4.9% +12.6% ➖ noise
26 duckdb:duckdb +0.1% -0.8% +0.9% +11.3% ➖ noise
26 duckdb:vortex-compact -4.3% -0.8% -3.5% +14.8% ➖ noise
26 duckdb:vortex-file-compressed -1.4% -0.8% -0.6% +14.1% ➖ noise
27 datafusion:vortex-compact +10.3% +1.1% +9.2% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +0.7% +1.1% -0.4% +10.3% ➖ noise
27 duckdb:duckdb -3.1% +1.1% -4.1% +19.7% ➖ noise
27 duckdb:vortex-compact -3.3% +1.1% -4.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -7.8% +1.1% -8.8% +14.8% ➖ noise
28 datafusion:vortex-compact +3.0% -1.2% +4.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -5.7% -1.2% -4.5% +10.0% ➖ noise
28 duckdb:duckdb -0.3% -1.2% +0.9% +10.0% ➖ noise
28 duckdb:vortex-compact -4.3% -1.2% -3.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +3.0% -1.2% +4.2% +10.0% ➖ noise
29 datafusion:vortex-compact +3.5% -1.4% +4.9% +10.1% ➖ noise
29 datafusion:vortex-file-compressed +1.7% -1.4% +3.1% +12.7% ➖ noise
29 duckdb:duckdb +1.4% -1.4% +2.9% +10.0% ➖ noise
29 duckdb:vortex-compact -0.4% -1.4% +0.9% +13.9% ➖ noise
29 duckdb:vortex-file-compressed -0.4% -1.4% +1.0% +10.0% ➖ noise
30 datafusion:vortex-compact +28.7% -0.8% +29.7% +10.6% 🚨 regression
30 datafusion:vortex-file-compressed +17.0% -0.8% +18.0% +10.0% 🚨 regression
30 duckdb:duckdb -1.3% -0.8% -0.4% +10.0% ➖ noise
30 duckdb:vortex-compact +6.4% -0.8% +7.3% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.7% -0.8% -0.8% +13.7% ➖ noise
31 datafusion:vortex-compact +4.3% +0.5% +3.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +4.0% +0.5% +3.5% +10.0% ➖ noise
31 duckdb:duckdb -1.7% +0.5% -2.2% +10.0% ➖ noise
31 duckdb:vortex-compact -1.0% +0.5% -1.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -0.3% +0.5% -0.8% +10.8% ➖ noise
32 datafusion:vortex-compact +7.7% -5.6% +14.1% +10.0% 🚨 regression
32 datafusion:vortex-file-compressed +5.2% -5.6% +11.4% +10.0% 🚨 regression
32 duckdb:duckdb -0.8% -5.6% +5.1% +10.2% ➖ noise
32 duckdb:vortex-compact +0.3% -5.6% +6.2% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -0.2% -5.6% +5.7% +14.2% ➖ noise
33 datafusion:vortex-compact +10.4% -2.7% +13.5% +10.0% 🚨 regression
33 datafusion:vortex-file-compressed +2.8% -2.7% +5.7% +17.2% ➖ noise
33 duckdb:duckdb +3.8% -2.7% +6.7% +11.4% ➖ noise
33 duckdb:vortex-compact +6.1% -2.7% +9.1% +12.0% ➖ noise
33 duckdb:vortex-file-compressed +1.5% -2.7% +4.3% +10.0% ➖ noise
34 datafusion:vortex-compact +6.9% +1.9% +4.9% +12.6% ➖ noise
34 datafusion:vortex-file-compressed +2.3% +1.9% +0.4% +10.0% ➖ noise
34 duckdb:duckdb +1.6% +1.9% -0.3% +10.0% ➖ noise
34 duckdb:vortex-compact +1.1% +1.9% -0.8% +16.2% ➖ noise
34 duckdb:vortex-file-compressed +2.1% +1.9% +0.3% +10.0% ➖ noise
35 datafusion:vortex-compact +24.4% +0.6% +23.7% +10.0% 🚨 regression
35 datafusion:vortex-file-compressed +14.3% +0.6% +13.6% +10.0% 🚨 regression
35 duckdb:duckdb -2.5% +0.6% -3.0% +13.3% ➖ noise
35 duckdb:vortex-compact -2.8% +0.6% -3.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.4% +0.6% -2.0% +10.0% ➖ noise
36 datafusion:vortex-compact +7.0% -1.0% +8.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -0.5% -1.0% +0.6% +10.0% ➖ noise
36 duckdb:duckdb +2.1% -1.0% +3.2% +10.0% ➖ noise
36 duckdb:vortex-compact +0.4% -1.0% +1.5% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +0.6% -1.0% +1.7% +10.0% ➖ noise
37 datafusion:vortex-compact +11.8% -3.0% +15.2% +10.0% 🚨 regression
37 datafusion:vortex-file-compressed +12.9% -3.0% +16.4% +11.1% 🚨 regression
37 duckdb:duckdb +7.7% -3.0% +11.0% +16.6% ➖ noise
37 duckdb:vortex-compact -8.1% -3.0% -5.2% +11.9% ➖ noise
37 duckdb:vortex-file-compressed -1.3% -3.0% +1.7% +10.0% ➖ noise
38 datafusion:vortex-compact +2.3% -4.5% +7.2% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +4.7% -4.5% +9.6% +12.2% ➖ noise
38 duckdb:duckdb -2.2% -4.5% +2.4% +13.4% ➖ noise
38 duckdb:vortex-compact -1.9% -4.5% +2.7% +11.7% ➖ noise
38 duckdb:vortex-file-compressed -4.3% -4.5% +0.2% +10.8% ➖ noise
39 datafusion:vortex-compact +9.0% -0.2% +9.3% +17.6% ➖ noise
39 datafusion:vortex-file-compressed -1.3% -0.2% -1.1% +15.0% ➖ noise
39 duckdb:duckdb -3.6% -0.2% -3.4% +27.1% ➖ noise
39 duckdb:vortex-compact +12.6% -0.2% +12.9% +16.7% ➖ noise
39 duckdb:vortex-file-compressed +5.3% -0.2% +5.5% +13.2% ➖ noise
40 datafusion:vortex-compact +3.2% +0.3% +2.9% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -0.4% +0.3% -0.8% +10.0% ➖ noise
40 duckdb:duckdb -6.3% +0.3% -6.6% +12.0% ➖ noise
40 duckdb:vortex-compact +1.0% +0.3% +0.6% +11.3% ➖ noise
40 duckdb:vortex-file-compressed -2.8% +0.3% -3.1% +13.6% ➖ noise
41 datafusion:vortex-compact +9.0% -0.6% +9.8% +10.6% ➖ noise
41 datafusion:vortex-file-compressed +0.4% -0.6% +1.1% +25.3% ➖ noise
41 duckdb:duckdb -8.0% -0.6% -7.4% +10.0% ➖ noise
41 duckdb:vortex-compact -1.1% -0.6% -0.5% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -1.4% -0.6% -0.8% +10.0% ➖ noise
42 datafusion:vortex-compact +8.7% -1.3% +10.1% +10.0% 🚨 regression
42 datafusion:vortex-file-compressed -0.3% -1.3% +0.9% +10.8% ➖ noise
42 duckdb:duckdb +0.3% -1.3% +1.6% +13.0% ➖ noise
42 duckdb:vortex-compact -3.6% -1.3% -2.3% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -8.1% -1.3% -7.0% +10.8% ➖ noise
43 datafusion:vortex-compact +4.9% -2.8% +8.0% +11.7% ➖ noise
43 datafusion:vortex-file-compressed +2.5% -2.8% +5.5% +10.0% ➖ noise
43 duckdb:duckdb -2.0% -2.8% +0.8% +13.2% ➖ noise
43 duckdb:vortex-compact -9.1% -2.8% -6.5% +15.7% ➖ noise
43 duckdb:vortex-file-compressed +3.5% -2.8% +6.5% +16.9% ➖ noise
44 datafusion:vortex-compact +4.2% +3.7% +0.5% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +3.1% +3.7% -0.6% +10.0% ➖ noise
44 duckdb:duckdb +3.0% +3.7% -0.7% +14.1% ➖ noise
44 duckdb:vortex-compact +5.5% +3.7% +1.7% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -0.7% +3.7% -4.2% +10.8% ➖ noise
45 datafusion:vortex-compact +4.2% +3.1% +1.0% +11.1% ➖ noise
45 datafusion:vortex-file-compressed +1.3% +3.1% -1.8% +10.0% ➖ noise
45 duckdb:duckdb +4.5% +3.1% +1.3% +10.0% ➖ noise
45 duckdb:vortex-compact -4.1% +3.1% -7.0% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -4.9% +3.1% -7.8% +20.7% ➖ noise
46 datafusion:vortex-compact +5.3% -0.5% +5.9% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +2.0% -0.5% +2.5% +10.0% ➖ noise
46 duckdb:duckdb -2.6% -0.5% -2.0% +10.0% ➖ noise
46 duckdb:vortex-compact +0.6% -0.5% +1.1% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -0.2% -0.5% +0.3% +10.0% ➖ noise
47 datafusion:vortex-compact +4.8% +1.1% +3.7% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +3.1% +1.1% +2.0% +10.0% ➖ noise
47 duckdb:duckdb +0.5% +1.1% -0.6% +10.0% ➖ noise
47 duckdb:vortex-compact +0.8% +1.1% -0.3% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -2.5% +1.1% -3.5% +10.0% ➖ noise
48 datafusion:vortex-compact +7.4% -0.9% +8.4% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +11.4% -0.9% +12.4% +10.0% 🚨 regression
48 duckdb:duckdb -4.4% -0.9% -3.6% +10.0% ➖ noise
48 duckdb:vortex-compact -2.6% -0.9% -1.7% +10.1% ➖ noise
48 duckdb:vortex-file-compressed -5.6% -0.9% -4.8% +16.5% ➖ noise
49 datafusion:vortex-compact +3.7% -1.6% +5.4% +10.8% ➖ noise
49 datafusion:vortex-file-compressed +0.9% -1.6% +2.6% +10.0% ➖ noise
49 duckdb:duckdb -1.3% -1.6% +0.3% +15.3% ➖ noise
49 duckdb:vortex-compact +3.6% -1.6% +5.3% +10.0% ➖ noise
49 duckdb:vortex-file-compressed +0.6% -1.6% +2.2% +16.8% ➖ noise
50 datafusion:vortex-compact +3.6% -0.9% +4.5% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +1.3% -0.9% +2.2% +10.0% ➖ noise
50 duckdb:duckdb +4.5% -0.9% +5.5% +10.3% ➖ noise
50 duckdb:vortex-compact -1.5% -0.9% -0.7% +11.4% ➖ noise
50 duckdb:vortex-file-compressed -1.2% -0.9% -0.3% +10.0% ➖ noise
51 datafusion:vortex-compact +2.7% +0.0% +2.6% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +4.6% +0.0% +4.5% +10.0% ➖ noise
51 duckdb:duckdb -0.5% +0.0% -0.5% +10.0% ➖ noise
51 duckdb:vortex-compact +0.4% +0.0% +0.4% +10.0% ➖ noise
51 duckdb:vortex-file-compressed -1.9% +0.0% -2.0% +13.6% ➖ noise
52 datafusion:vortex-compact -0.3% +0.1% -0.3% +12.6% ➖ noise
52 datafusion:vortex-file-compressed +6.6% +0.1% +6.5% +11.9% ➖ noise
52 duckdb:duckdb -2.6% +0.1% -2.7% +17.7% ➖ noise
52 duckdb:vortex-compact -0.1% +0.1% -0.2% +11.6% ➖ noise
52 duckdb:vortex-file-compressed -0.3% +0.1% -0.4% +14.7% ➖ noise
53 datafusion:vortex-compact +5.3% +4.3% +1.0% +11.1% ➖ noise
53 datafusion:vortex-file-compressed -3.1% +4.3% -7.1% +18.5% ➖ noise
53 duckdb:duckdb -3.1% +4.3% -7.0% +11.7% ➖ noise
53 duckdb:vortex-compact -8.3% +4.3% -12.0% +10.1% ✅ faster
53 duckdb:vortex-file-compressed -0.9% +4.3% -4.9% +10.0% ➖ noise
54 datafusion:vortex-compact +0.6% -0.9% +1.5% +12.0% ➖ noise
54 datafusion:vortex-file-compressed +2.8% -0.9% +3.8% +12.2% ➖ noise
54 duckdb:duckdb +2.3% -0.9% +3.2% +13.8% ➖ noise
54 duckdb:vortex-compact -2.0% -0.9% -1.1% +14.0% ➖ noise
54 duckdb:vortex-file-compressed -3.6% -0.9% -2.7% +13.1% ➖ noise
55 datafusion:vortex-compact +3.8% -4.6% +8.7% +12.2% ➖ noise
55 datafusion:vortex-file-compressed +1.3% -4.6% +6.1% +10.0% ➖ noise
55 duckdb:duckdb +0.4% -4.6% +5.2% +18.5% ➖ noise
55 duckdb:vortex-compact -0.1% -4.6% +4.7% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -1.9% -4.6% +2.8% +26.1% ➖ noise
56 datafusion:vortex-compact +5.7% -1.5% +7.2% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +2.9% -1.5% +4.4% +12.1% ➖ noise
56 duckdb:duckdb -7.3% -1.5% -5.9% +11.6% ➖ noise
56 duckdb:vortex-compact +0.7% -1.5% +2.2% +18.4% ➖ noise
56 duckdb:vortex-file-compressed -5.3% -1.5% -3.9% +14.0% ➖ noise
57 datafusion:vortex-compact +3.4% -2.1% +5.7% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -1.3% -2.1% +0.8% +10.0% ➖ noise
57 duckdb:duckdb -0.7% -2.1% +1.5% +10.0% ➖ noise
57 duckdb:vortex-compact +0.9% -2.1% +3.1% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -0.1% -2.1% +2.1% +10.0% ➖ noise
58 datafusion:vortex-compact +8.3% +0.2% +8.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +1.9% +0.2% +1.7% +10.0% ➖ noise
58 duckdb:duckdb +2.3% +0.2% +2.0% +18.0% ➖ noise
58 duckdb:vortex-compact +0.7% +0.2% +0.4% +12.8% ➖ noise
58 duckdb:vortex-file-compressed -5.0% +0.2% -5.2% +12.3% ➖ noise
59 datafusion:vortex-compact +5.6% -0.8% +6.5% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +0.4% -0.8% +1.3% +10.0% ➖ noise
59 duckdb:duckdb +0.5% -0.8% +1.3% +10.0% ➖ noise
59 duckdb:vortex-compact -1.1% -0.8% -0.3% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +2.0% -0.8% +2.9% +10.1% ➖ noise
60 datafusion:vortex-compact +4.7% +0.7% +3.9% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +5.5% +0.7% +4.8% +10.0% ➖ noise
60 duckdb:duckdb +5.2% +0.7% +4.4% +11.4% ➖ noise
60 duckdb:vortex-compact -0.1% +0.7% -0.8% +13.5% ➖ noise
60 duckdb:vortex-file-compressed -2.6% +0.7% -3.3% +10.5% ➖ noise
61 datafusion:vortex-compact +5.6% +0.8% +4.7% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +7.9% +0.8% +7.0% +11.1% ➖ noise
61 duckdb:duckdb +1.9% +0.8% +1.0% +10.0% ➖ noise
61 duckdb:vortex-compact -4.2% +0.8% -5.0% +10.7% ➖ noise
61 duckdb:vortex-file-compressed -7.6% +0.8% -8.4% +17.0% ➖ noise
62 datafusion:vortex-compact +0.0% +2.1% -2.0% +12.8% ➖ noise
62 datafusion:vortex-file-compressed -1.7% +2.1% -3.7% +11.7% ➖ noise
62 duckdb:duckdb -4.3% +2.1% -6.2% +11.7% ➖ noise
62 duckdb:vortex-compact +1.0% +2.1% -1.0% +12.8% ➖ noise
62 duckdb:vortex-file-compressed +1.0% +2.1% -1.1% +13.5% ➖ noise
63 datafusion:vortex-compact +4.5% +1.2% +3.3% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +2.2% +1.2% +1.0% +10.0% ➖ noise
63 duckdb:duckdb +3.8% +1.2% +2.6% +13.3% ➖ noise
63 duckdb:vortex-compact -3.2% +1.2% -4.4% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -1.4% +1.2% -2.5% +10.0% ➖ noise
64 datafusion:vortex-compact +1.1% -0.5% +1.6% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -0.7% -0.5% -0.2% +10.0% ➖ noise
64 duckdb:duckdb +3.8% -0.5% +4.3% +10.0% ➖ noise
64 duckdb:vortex-compact -2.5% -0.5% -2.0% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +3.0% -0.5% +3.5% +10.0% ➖ noise
65 datafusion:vortex-compact +1.3% -0.7% +2.0% +13.6% ➖ noise
65 datafusion:vortex-file-compressed +5.6% -0.7% +6.4% +10.0% ➖ noise
65 duckdb:duckdb +0.8% -0.7% +1.5% +16.8% ➖ noise
65 duckdb:vortex-compact -1.5% -0.7% -0.8% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +3.1% -0.7% +3.9% +10.0% ➖ noise
66 datafusion:vortex-compact +2.9% -0.1% +3.0% +10.7% ➖ noise
66 datafusion:vortex-file-compressed +3.1% -0.1% +3.1% +10.3% ➖ noise
66 duckdb:duckdb -0.5% -0.1% -0.5% +10.0% ➖ noise
66 duckdb:vortex-compact +0.0% -0.1% +0.1% +12.7% ➖ noise
66 duckdb:vortex-file-compressed -0.1% -0.1% -0.0% +10.0% ➖ noise
67 datafusion:vortex-compact +4.2% -1.6% +5.9% +12.5% ➖ noise
67 datafusion:vortex-file-compressed -0.7% -1.6% +1.0% +10.9% ➖ noise
67 duckdb:duckdb -1.2% -1.6% +0.4% +10.0% ➖ noise
67 duckdb:vortex-compact -2.4% -1.6% -0.8% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -2.2% -1.6% -0.5% +10.0% ➖ noise
68 datafusion:vortex-compact +0.7% -2.1% +2.8% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +1.7% -2.1% +3.9% +10.0% ➖ noise
68 duckdb:duckdb -0.6% -2.1% +1.5% +10.0% ➖ noise
68 duckdb:vortex-compact -5.3% -2.1% -3.3% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -0.3% -2.1% +1.8% +10.3% ➖ noise
69 datafusion:vortex-compact +40.0% -1.5% +42.1% +10.0% 🚨 regression
69 datafusion:vortex-file-compressed +29.6% -1.5% +31.5% +17.8% 🚨 regression
69 duckdb:duckdb -2.0% -1.5% -0.5% +10.4% ➖ noise
69 duckdb:vortex-compact +0.8% -1.5% +2.3% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -0.2% -1.5% +1.3% +10.0% ➖ noise
70 datafusion:vortex-compact +3.7% +1.1% +2.6% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +0.6% +1.1% -0.5% +10.0% ➖ noise
70 duckdb:duckdb -3.2% +1.1% -4.3% +11.0% ➖ noise
70 duckdb:vortex-compact -1.8% +1.1% -2.8% +15.6% ➖ noise
70 duckdb:vortex-file-compressed -2.1% +1.1% -3.1% +10.0% ➖ noise
71 datafusion:vortex-compact +2.7% +0.3% +2.4% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +5.5% +0.3% +5.2% +10.0% ➖ noise
71 duckdb:duckdb +14.9% +0.3% +14.6% +18.3% ➖ noise
71 duckdb:vortex-compact -2.5% +0.3% -2.8% +10.0% ➖ noise
71 duckdb:vortex-file-compressed +1.5% +0.3% +1.2% +18.5% ➖ noise
72 datafusion:vortex-compact -1.5% +1.3% -2.7% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +3.2% +1.3% +1.9% +10.0% ➖ noise
72 duckdb:duckdb -6.0% +1.3% -7.2% +15.5% ➖ noise
72 duckdb:vortex-compact -0.5% +1.3% -1.7% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +1.0% +1.3% -0.3% +10.0% ➖ noise
73 datafusion:vortex-compact +6.0% -3.8% +10.1% +11.7% ➖ noise
73 datafusion:vortex-file-compressed +5.1% -3.8% +9.2% +25.7% ➖ noise
73 duckdb:duckdb +8.2% -3.8% +12.4% +12.6% ➖ noise
73 duckdb:vortex-compact -5.5% -3.8% -1.8% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -6.5% -3.8% -2.8% +13.4% ➖ noise
74 datafusion:vortex-compact +7.0% +2.0% +4.9% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +5.0% +2.0% +3.0% +12.9% ➖ noise
74 duckdb:duckdb -1.4% +2.0% -3.3% +10.0% ➖ noise
74 duckdb:vortex-compact -2.6% +2.0% -4.5% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -1.5% +2.0% -3.4% +21.4% ➖ noise
75 datafusion:vortex-compact +5.4% -0.2% +5.5% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +2.8% -0.2% +3.0% +10.3% ➖ noise
75 duckdb:duckdb +1.9% -0.2% +2.1% +10.0% ➖ noise
75 duckdb:vortex-compact -5.2% -0.2% -5.0% +10.1% ➖ noise
75 duckdb:vortex-file-compressed -2.6% -0.2% -2.4% +10.0% ➖ noise
76 datafusion:vortex-compact -1.0% -1.7% +0.8% +15.6% ➖ noise
76 datafusion:vortex-file-compressed -0.6% -1.7% +1.2% +10.0% ➖ noise
76 duckdb:duckdb -3.4% -1.7% -1.7% +14.4% ➖ noise
76 duckdb:vortex-compact +1.2% -1.7% +2.9% +12.2% ➖ noise
76 duckdb:vortex-file-compressed -7.4% -1.7% -5.8% +17.5% ➖ noise
77 datafusion:vortex-compact +5.3% -2.1% +7.6% +11.0% ➖ noise
77 datafusion:vortex-file-compressed +1.2% -2.1% +3.4% +12.7% ➖ noise
77 duckdb:duckdb -0.7% -2.1% +1.5% +13.4% ➖ noise
77 duckdb:vortex-compact -3.8% -2.1% -1.7% +14.5% ➖ noise
77 duckdb:vortex-file-compressed +1.8% -2.1% +4.0% +14.0% ➖ noise
78 datafusion:vortex-compact +2.0% +0.3% +1.7% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +0.8% +0.3% +0.5% +10.0% ➖ noise
78 duckdb:duckdb +4.0% +0.3% +3.7% +10.0% ➖ noise
78 duckdb:vortex-compact +0.4% +0.3% +0.1% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +0.2% +0.3% -0.1% +10.0% ➖ noise
79 datafusion:vortex-compact -2.7% +4.3% -6.7% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +8.4% +4.3% +3.9% +10.0% ➖ noise
79 duckdb:duckdb -6.5% +4.3% -10.4% +11.2% ✅ faster
79 duckdb:vortex-compact +1.5% +4.3% -2.7% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -2.8% +4.3% -6.8% +22.5% ➖ noise
80 datafusion:vortex-compact +5.5% -1.6% +7.2% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -1.8% -1.6% -0.2% +10.0% ➖ noise
80 duckdb:duckdb +2.6% -1.6% +4.3% +12.6% ➖ noise
80 duckdb:vortex-compact -7.8% -1.6% -6.3% +12.5% ➖ noise
80 duckdb:vortex-file-compressed -0.6% -1.6% +1.0% +12.8% ➖ noise
81 datafusion:vortex-compact +3.7% +1.2% +2.5% +10.1% ➖ noise
81 datafusion:vortex-file-compressed +9.2% +1.2% +8.0% +16.8% ➖ noise
81 duckdb:duckdb +1.9% +1.2% +0.7% +10.0% ➖ noise
81 duckdb:vortex-compact -2.1% +1.2% -3.3% +11.7% ➖ noise
81 duckdb:vortex-file-compressed +0.3% +1.2% -0.8% +10.0% ➖ noise
82 datafusion:vortex-compact +13.8% +0.5% +13.3% +10.0% 🚨 regression
82 datafusion:vortex-file-compressed +15.7% +0.5% +15.1% +10.0% 🚨 regression
82 duckdb:duckdb +3.8% +0.5% +3.3% +16.7% ➖ noise
82 duckdb:vortex-compact -10.7% +0.5% -11.1% +10.0% ✅ faster
82 duckdb:vortex-file-compressed -3.2% +0.5% -3.7% +10.0% ➖ noise
83 datafusion:vortex-compact +5.2% +0.2% +5.0% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +3.9% +0.2% +3.7% +10.0% ➖ noise
83 duckdb:duckdb -0.5% +0.2% -0.7% +11.1% ➖ noise
83 duckdb:vortex-compact +4.3% +0.2% +4.1% +17.3% ➖ noise
83 duckdb:vortex-file-compressed -1.9% +0.2% -2.1% +10.0% ➖ noise
84 datafusion:vortex-compact +26.7% +3.7% +22.2% +10.0% 🚨 regression
84 datafusion:vortex-file-compressed +10.5% +3.7% +6.6% +15.8% ➖ noise
84 duckdb:duckdb -0.0% +3.7% -3.5% +11.5% ➖ noise
84 duckdb:vortex-compact -1.2% +3.7% -4.6% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -5.0% +3.7% -8.4% +30.2% ➖ noise
85 datafusion:vortex-compact +4.3% -1.4% +5.8% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +0.4% -1.4% +1.9% +10.0% ➖ noise
85 duckdb:duckdb -1.8% -1.4% -0.4% +10.0% ➖ noise
85 duckdb:vortex-compact -8.1% -1.4% -6.8% +10.5% ➖ noise
85 duckdb:vortex-file-compressed -2.0% -1.4% -0.5% +10.0% ➖ noise
86 datafusion:vortex-compact +1.7% -0.6% +2.3% +11.4% ➖ noise
86 datafusion:vortex-file-compressed -1.0% -0.6% -0.5% +10.0% ➖ noise
86 duckdb:duckdb +2.5% -0.6% +3.1% +13.0% ➖ noise
86 duckdb:vortex-compact +1.3% -0.6% +1.9% +15.9% ➖ noise
86 duckdb:vortex-file-compressed +2.4% -0.6% +3.0% +14.5% ➖ noise
87 datafusion:vortex-compact +3.4% -1.2% +4.6% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +2.1% -1.2% +3.3% +10.0% ➖ noise
87 duckdb:duckdb +6.4% -1.2% +7.7% +14.1% ➖ noise
87 duckdb:vortex-compact -4.5% -1.2% -3.4% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -6.2% -1.2% -5.1% +10.0% ➖ noise
88 datafusion:vortex-compact +4.5% -0.3% +4.8% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +3.3% -0.3% +3.6% +10.0% ➖ noise
88 duckdb:duckdb -1.3% -0.3% -1.0% +10.0% ➖ noise
88 duckdb:vortex-compact +0.3% -0.3% +0.6% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +0.1% -0.3% +0.4% +10.0% ➖ noise
89 datafusion:vortex-compact +3.3% +3.4% -0.1% +12.4% ➖ noise
89 datafusion:vortex-file-compressed -0.5% +3.4% -3.8% +13.7% ➖ noise
89 duckdb:duckdb +0.5% +3.4% -2.8% +10.9% ➖ noise
89 duckdb:vortex-compact -2.5% +3.4% -5.7% +10.6% ➖ noise
89 duckdb:vortex-file-compressed +2.5% +3.4% -0.9% +10.0% ➖ noise
90 datafusion:vortex-compact -0.8% -4.2% +3.6% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -1.0% -4.2% +3.3% +10.0% ➖ noise
90 duckdb:duckdb -1.2% -4.2% +3.1% +10.0% ➖ noise
90 duckdb:vortex-compact -1.3% -4.2% +3.1% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -1.1% -4.2% +3.3% +10.0% ➖ noise
91 datafusion:vortex-compact +19.5% -0.0% +19.5% +10.0% 🚨 regression
91 datafusion:vortex-file-compressed +13.9% -0.0% +13.9% +10.0% 🚨 regression
91 duckdb:duckdb -7.3% -0.0% -7.2% +11.2% ➖ noise
91 duckdb:vortex-compact -0.9% -0.0% -0.9% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -0.1% -0.0% -0.1% +10.0% ➖ noise
92 datafusion:vortex-compact -0.5% -0.3% -0.3% +23.1% ➖ noise
92 datafusion:vortex-file-compressed -0.0% -0.3% +0.2% +11.0% ➖ noise
92 duckdb:duckdb +0.9% -0.3% +1.2% +14.5% ➖ noise
92 duckdb:vortex-compact +0.4% -0.3% +0.6% +26.5% ➖ noise
92 duckdb:vortex-file-compressed -13.3% -0.3% -13.1% +17.3% ➖ noise
93 datafusion:vortex-compact +14.3% -2.3% +17.0% +10.0% 🚨 regression
93 datafusion:vortex-file-compressed +4.4% -2.3% +6.8% +10.0% ➖ noise
93 duckdb:duckdb +10.3% -2.3% +12.9% +11.1% 🚨 regression
93 duckdb:vortex-compact +5.0% -2.3% +7.5% +13.2% ➖ noise
93 duckdb:vortex-file-compressed -3.3% -2.3% -1.0% +13.8% ➖ noise
94 datafusion:vortex-compact +9.8% +0.7% +9.0% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +2.2% +0.7% +1.5% +11.2% ➖ noise
94 duckdb:duckdb +6.4% +0.7% +5.6% +10.0% ➖ noise
94 duckdb:vortex-compact -7.6% +0.7% -8.2% +14.1% ➖ noise
94 duckdb:vortex-file-compressed -0.5% +0.7% -1.1% +10.0% ➖ noise
95 datafusion:vortex-compact +6.6% +4.9% +1.6% +12.6% ➖ noise
95 datafusion:vortex-file-compressed +5.4% +4.9% +0.5% +11.6% ➖ noise
95 duckdb:duckdb +13.8% +4.9% +8.5% +18.5% ➖ noise
95 duckdb:vortex-compact -4.5% +4.9% -9.0% +15.2% ➖ noise
95 duckdb:vortex-file-compressed -15.3% +4.9% -19.3% +21.7% ✅ faster
96 datafusion:vortex-compact +3.2% -4.1% +7.6% +10.2% ➖ noise
96 datafusion:vortex-file-compressed +1.9% -4.1% +6.3% +22.8% ➖ noise
96 duckdb:duckdb -4.8% -4.1% -0.7% +18.3% ➖ noise
96 duckdb:vortex-compact +4.8% -4.1% +9.3% +14.0% ➖ noise
96 duckdb:vortex-file-compressed -8.9% -4.1% -5.0% +10.2% ➖ noise
97 datafusion:vortex-compact -0.2% +3.1% -3.2% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +4.1% +3.1% +0.9% +10.0% ➖ noise
97 duckdb:duckdb -2.4% +3.1% -5.4% +15.5% ➖ noise
97 duckdb:vortex-compact -0.1% +3.1% -3.1% +15.3% ➖ noise
97 duckdb:vortex-file-compressed +2.4% +3.1% -0.7% +11.1% ➖ noise
98 datafusion:vortex-compact +3.6% -4.4% +8.3% +15.1% ➖ noise
98 datafusion:vortex-file-compressed -1.6% -4.4% +2.9% +10.0% ➖ noise
98 duckdb:duckdb -3.4% -4.4% +1.0% +14.4% ➖ noise
98 duckdb:vortex-compact +0.9% -4.4% +5.5% +11.2% ➖ noise
98 duckdb:vortex-file-compressed -1.6% -4.4% +3.0% +10.0% ➖ noise
99 datafusion:vortex-compact -3.1% +3.4% -6.2% +13.7% ➖ noise
99 datafusion:vortex-file-compressed -2.0% +3.4% -5.2% +13.6% ➖ noise
99 duckdb:duckdb +0.4% +3.4% -2.8% +13.0% ➖ noise
99 duckdb:vortex-compact -4.2% +3.4% -7.3% +13.6% ➖ noise
99 duckdb:vortex-file-compressed -1.0% +3.4% -4.2% +16.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Vortex (geomean): 1.081x ➖
Parquet (geomean): 1.063x ➖
Shifts: Parquet (control) +6.3% · Median polish +12.4%


datafusion / vortex-file-compressed (0.945x ➖, 1↑ 2↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 35430556 69208569 0.51
fineweb_q01/datafusion:vortex-file-compressed 703004689 787330284 0.89
fineweb_q02/datafusion:vortex-file-compressed 426701210 580703112 0.73
fineweb_q03/datafusion:vortex-file-compressed 1392443400 1422194965 0.98
fineweb_q04/datafusion:vortex-file-compressed 🚨 1921686637 1393845370 1.38
fineweb_q05/datafusion:vortex-file-compressed 1525218505 1407612960 1.08
fineweb_q06/datafusion:vortex-file-compressed 🚨 2569431146 1543325137 1.66
fineweb_q07/datafusion:vortex-file-compressed 1377823186 1402283994 0.98
fineweb_q08/datafusion:vortex-file-compressed 541734873 724538422 0.75
datafusion / vortex-compact (1.129x ➖, 1↑ 2↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 40212802 68197227 0.59
fineweb_q01/datafusion:vortex-compact 🚨 937376382 695828756 1.35
fineweb_q02/datafusion:vortex-compact 🚨 995956260 622053173 1.60
fineweb_q03/datafusion:vortex-compact 2229655370 1888869331 1.18
fineweb_q04/datafusion:vortex-compact 2674230601 2222412650 1.20
fineweb_q05/datafusion:vortex-compact 2022795821 1676844209 1.21
fineweb_q06/datafusion:vortex-compact 1672355966 1394365281 1.20
fineweb_q07/datafusion:vortex-compact 1504883604 1326790448 1.13
fineweb_q08/datafusion:vortex-compact 406397286 403128764 1.01
datafusion / parquet (1.103x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1273830040 1001643873 1.27
fineweb_q01/datafusion:parquet 1922971405 1658490697 1.16
fineweb_q02/datafusion:parquet 1774375264 1636319568 1.08
fineweb_q03/datafusion:parquet 1876259569 1659651028 1.13
fineweb_q04/datafusion:parquet 1824173909 1767098483 1.03
fineweb_q05/datafusion:parquet 1952600375 1665413254 1.17
fineweb_q06/datafusion:parquet 1795613560 1625085231 1.10
fineweb_q07/datafusion:parquet 1779566278 1686670526 1.06
fineweb_q08/datafusion:parquet 1778858531 1882880888 0.94
duckdb / vortex-file-compressed (1.098x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 95402652 82564791 1.16
fineweb_q01/duckdb:vortex-file-compressed 596093349 638521394 0.93
fineweb_q02/duckdb:vortex-file-compressed 450570911 474385064 0.95
fineweb_q03/duckdb:vortex-file-compressed 1688212419 1449521406 1.16
fineweb_q04/duckdb:vortex-file-compressed 1715416429 1571878253 1.09
fineweb_q05/duckdb:vortex-file-compressed 1673251184 1448542264 1.16
fineweb_q06/duckdb:vortex-file-compressed 1876680521 1626979097 1.15
fineweb_q07/duckdb:vortex-file-compressed 1754778893 1422880389 1.23
fineweb_q08/duckdb:vortex-file-compressed 695767163 639771476 1.09
duckdb / vortex-compact (1.164x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 87789641 73564582 1.19
fineweb_q01/duckdb:vortex-compact 637492191 572614693 1.11
fineweb_q02/duckdb:vortex-compact 682011188 549163715 1.24
fineweb_q03/duckdb:vortex-compact 1965186690 1575994099 1.25
fineweb_q04/duckdb:vortex-compact 2077090868 1775663181 1.17
fineweb_q05/duckdb:vortex-compact 1799397619 1481876729 1.21
fineweb_q06/duckdb:vortex-compact 1712609649 1493246746 1.15
fineweb_q07/duckdb:vortex-compact 1530916096 1402841423 1.09
fineweb_q08/duckdb:vortex-compact 527904493 491702104 1.07
duckdb / parquet (1.024x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1137845784 1083609251 1.05
fineweb_q01/duckdb:parquet 1377072580 1402827955 0.98
fineweb_q02/duckdb:parquet 1444904662 1317964200 1.10
fineweb_q03/duckdb:parquet 3674797966 3670535391 1.00
fineweb_q04/duckdb:parquet 1948081790 1914297542 1.02
fineweb_q05/duckdb:parquet 2053708693 2105629912 0.98
fineweb_q06/duckdb:parquet 4301784604 4317209724 1.00
fineweb_q07/duckdb:parquet 2711872776 2585695733 1.05
fineweb_q08/duckdb:parquet 1117476184 1056893269 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -41.0% +15.6% -49.0% +208.4% ➖ noise
0 datafusion:vortex-file-compressed -48.8% +15.6% -55.7% +224.7% ➖ noise
0 duckdb:vortex-compact +19.3% +15.6% +3.3% +49.5% ➖ noise
0 duckdb:vortex-file-compressed +15.5% +15.6% -0.0% +46.9% ➖ noise
1 datafusion:vortex-compact +34.7% +6.7% +26.3% +63.2% ➖ noise
1 datafusion:vortex-file-compressed -10.7% +6.7% -16.3% +70.2% ➖ noise
1 duckdb:vortex-compact +11.3% +6.7% +4.4% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -6.6% +6.7% -12.5% +33.2% ➖ noise
2 datafusion:vortex-compact +60.1% +9.0% +46.8% +33.1% 🚨 regression
2 datafusion:vortex-file-compressed -26.5% +9.0% -32.6% +51.0% ➖ noise
2 duckdb:vortex-compact +24.2% +9.0% +13.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -5.0% +9.0% -12.9% +47.6% ➖ noise
3 datafusion:vortex-compact +18.0% +6.4% +11.0% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -2.1% +6.4% -8.0% +30.0% ➖ noise
3 duckdb:vortex-compact +24.7% +6.4% +17.2% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +16.5% +6.4% +9.5% +30.0% ➖ noise
4 datafusion:vortex-compact +20.3% +2.5% +17.4% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +37.9% +2.5% +34.5% +40.5% ➖ noise
4 duckdb:vortex-compact +17.0% +2.5% +14.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +9.1% +2.5% +6.5% +30.0% ➖ noise
5 datafusion:vortex-compact +20.6% +6.9% +12.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +8.4% +6.9% +1.3% +30.0% ➖ noise
5 duckdb:vortex-compact +21.4% +6.9% +13.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +15.5% +6.9% +8.0% +30.0% ➖ noise
6 datafusion:vortex-compact +19.9% +4.9% +14.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +66.5% +4.9% +58.7% +67.5% ➖ noise
6 duckdb:vortex-compact +14.7% +4.9% +9.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +15.3% +4.9% +9.9% +30.0% ➖ noise
7 datafusion:vortex-compact +13.4% +5.2% +7.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -1.7% +5.2% -6.6% +30.0% ➖ noise
7 duckdb:vortex-compact +9.1% +5.2% +3.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +23.3% +5.2% +17.2% +30.0% ➖ noise
8 datafusion:vortex-compact +0.8% -0.1% +0.9% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -25.2% -0.1% -25.2% +30.0% ✅ faster
8 duckdb:vortex-compact +7.4% -0.1% +7.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +8.8% -0.1% +8.8% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Vortex (geomean): 0.957x ➖
Parquet (geomean): 0.962x ➖
Shifts: Parquet (control) -3.8% · Median polish -3.6%


duckdb / vortex-file-compressed (0.952x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11303839 12027004 0.94
statpopgen_q01/duckdb:vortex-file-compressed 19978286 21571512 0.93
statpopgen_q02/duckdb:vortex-file-compressed 1387428020 1447049868 0.96
statpopgen_q03/duckdb:vortex-file-compressed 3082120469 3261513051 0.94
statpopgen_q04/duckdb:vortex-file-compressed 3120051916 3269302243 0.95
statpopgen_q05/duckdb:vortex-file-compressed 1449469261 1512004515 0.96
statpopgen_q06/duckdb:vortex-file-compressed 2133272411 2216687968 0.96
statpopgen_q07/duckdb:vortex-file-compressed 233726837 243499796 0.96
statpopgen_q08/duckdb:vortex-file-compressed 271962183 277199267 0.98
statpopgen_q09/duckdb:vortex-file-compressed 2906824898 3096958659 0.94
statpopgen_q10/duckdb:vortex-file-compressed 4683693740 4946467754 0.95
duckdb / vortex-compact (0.963x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11321034 11951014 0.95
statpopgen_q01/duckdb:vortex-compact 169441449 172039085 0.98
statpopgen_q02/duckdb:vortex-compact 1807577716 1858536690 0.97
statpopgen_q03/duckdb:vortex-compact 3495492668 3624389413 0.96
statpopgen_q04/duckdb:vortex-compact 3533444643 3667770633 0.96
statpopgen_q05/duckdb:vortex-compact 1808897453 1902239622 0.95
statpopgen_q06/duckdb:vortex-compact 2682162860 2746381666 0.98
statpopgen_q07/duckdb:vortex-compact 903115081 936126968 0.96
statpopgen_q08/duckdb:vortex-compact 938001597 968156182 0.97
statpopgen_q09/duckdb:vortex-compact 3272053096 3464958601 0.94
statpopgen_q10/duckdb:vortex-compact 5333449128 5598686111 0.95
duckdb / parquet (0.962x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 324522518 335357394 0.97
statpopgen_q01/duckdb:parquet 417365312 420559274 0.99
statpopgen_q02/duckdb:parquet 983425086 1054303528 0.93
statpopgen_q03/duckdb:parquet 1511630276 1557367888 0.97
statpopgen_q04/duckdb:parquet 1511659207 1592239910 0.95
statpopgen_q05/duckdb:parquet 1004973631 1053303184 0.95
statpopgen_q06/duckdb:parquet 1502459340 1542027910 0.97
statpopgen_q07/duckdb:parquet 1304743674 1379221485 0.95
statpopgen_q08/duckdb:parquet 1302774420 1362448058 0.96
statpopgen_q09/duckdb:parquet 1361776752 1396767883 0.97
statpopgen_q10/duckdb:parquet 2654687068 2750660461 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -5.3% -3.2% -2.1% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -6.0% -3.2% -2.9% +16.4% ➖ noise
1 duckdb:vortex-compact -1.5% -0.8% -0.8% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -7.4% -0.8% -6.7% +208.0% ➖ noise
2 duckdb:vortex-compact -2.7% -6.7% +4.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -4.1% -6.7% +2.8% +10.0% ➖ noise
3 duckdb:vortex-compact -3.6% -2.9% -0.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -5.5% -2.9% -2.6% +10.0% ➖ noise
4 duckdb:vortex-compact -3.7% -5.1% +1.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.6% -5.1% +0.5% +10.0% ➖ noise
5 duckdb:vortex-compact -4.9% -4.6% -0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.1% -4.6% +0.5% +10.0% ➖ noise
6 duckdb:vortex-compact -2.3% -2.6% +0.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.8% -2.6% -1.2% +10.0% ➖ noise
7 duckdb:vortex-compact -3.5% -5.4% +2.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.0% -5.4% +1.5% +10.0% ➖ noise
8 duckdb:vortex-compact -3.1% -4.4% +1.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.9% -4.4% +2.6% +10.0% ➖ noise
9 duckdb:vortex-compact -5.6% -2.5% -3.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.1% -2.5% -3.7% +10.0% ➖ noise
10 duckdb:vortex-compact -4.7% -3.5% -1.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -5.3% -3.5% -1.9% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Vortex (geomean): 1.031x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish -0.1%


datafusion / vortex-file-compressed (1.053x ➖, 0↑ 4↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 357408908 396984743 0.90
tpch_q02/datafusion:vortex-file-compressed 🚨 120106998 106069363 1.13
tpch_q03/datafusion:vortex-file-compressed 🚨 226570187 203521583 1.11
tpch_q04/datafusion:vortex-file-compressed 🚨 127473365 107677163 1.18
tpch_q05/datafusion:vortex-file-compressed 371676090 363247471 1.02
tpch_q06/datafusion:vortex-file-compressed 45148391 42846861 1.05
tpch_q07/datafusion:vortex-file-compressed 551636094 539876583 1.02
tpch_q08/datafusion:vortex-file-compressed 355296487 345938535 1.03
tpch_q09/datafusion:vortex-file-compressed 627068309 629865446 1.00
tpch_q10/datafusion:vortex-file-compressed 251105589 239786623 1.05
tpch_q11/datafusion:vortex-file-compressed 84637994 80182685 1.06
tpch_q12/datafusion:vortex-file-compressed 🚨 126488923 114949253 1.10
tpch_q13/datafusion:vortex-file-compressed 222646085 212489898 1.05
tpch_q14/datafusion:vortex-file-compressed 58196211 54817138 1.06
tpch_q15/datafusion:vortex-file-compressed 111790478 103567595 1.08
tpch_q16/datafusion:vortex-file-compressed 75534876 71843787 1.05
tpch_q17/datafusion:vortex-file-compressed 633517069 613638975 1.03
tpch_q18/datafusion:vortex-file-compressed 826441814 814519961 1.01
tpch_q19/datafusion:vortex-file-compressed 92547870 91900991 1.01
tpch_q20/datafusion:vortex-file-compressed 180155102 164066564 1.10
tpch_q21/datafusion:vortex-file-compressed 703257403 656106548 1.07
tpch_q22/datafusion:vortex-file-compressed 62732767 57971833 1.08
datafusion / vortex-compact (1.078x ➖, 0↑ 8↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 415209824 438527369 0.95
tpch_q02/datafusion:vortex-compact 🚨 131865478 109903223 1.20
tpch_q03/datafusion:vortex-compact 🚨 239501457 211739281 1.13
tpch_q04/datafusion:vortex-compact 🚨 143212166 119725667 1.20
tpch_q05/datafusion:vortex-compact 381518777 370766727 1.03
tpch_q06/datafusion:vortex-compact 68849671 64230883 1.07
tpch_q07/datafusion:vortex-compact 576548388 562687184 1.02
tpch_q08/datafusion:vortex-compact 364733765 354419709 1.03
tpch_q09/datafusion:vortex-compact 644291194 649627455 0.99
tpch_q10/datafusion:vortex-compact 286376199 264989674 1.08
tpch_q11/datafusion:vortex-compact 91350319 85132367 1.07
tpch_q12/datafusion:vortex-compact 178266521 165074497 1.08
tpch_q13/datafusion:vortex-compact 276853200 262372722 1.06
tpch_q14/datafusion:vortex-compact 🚨 79774601 72414967 1.10
tpch_q15/datafusion:vortex-compact 🚨 184455473 160598360 1.15
tpch_q16/datafusion:vortex-compact 83036525 76242919 1.09
tpch_q17/datafusion:vortex-compact 640817186 620066499 1.03
tpch_q18/datafusion:vortex-compact 847216933 824291292 1.03
tpch_q19/datafusion:vortex-compact 138139452 134499256 1.03
tpch_q20/datafusion:vortex-compact 🚨 215642629 191767220 1.12
tpch_q21/datafusion:vortex-compact 🚨 743844323 668801118 1.11
tpch_q22/datafusion:vortex-compact 🚨 79014569 67177947 1.18
datafusion / parquet (1.014x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 483680207 459480154 1.05
tpch_q02/datafusion:parquet 172578301 173677910 0.99
tpch_q03/datafusion:parquet 288412548 285841346 1.01
tpch_q04/datafusion:parquet 133222313 130129771 1.02
tpch_q05/datafusion:parquet 439221153 436171062 1.01
tpch_q06/datafusion:parquet 136523219 124568755 1.10
tpch_q07/datafusion:parquet 612125992 607769884 1.01
tpch_q08/datafusion:parquet 473891377 459897578 1.03
tpch_q09/datafusion:parquet 747647518 747532775 1.00
tpch_q10/datafusion:parquet 502237925 498667672 1.01
tpch_q11/datafusion:parquet 120490320 120748973 1.00
tpch_q12/datafusion:parquet 216511027 208523928 1.04
tpch_q13/datafusion:parquet 328081346 332269022 0.99
tpch_q14/datafusion:parquet 163846021 163667164 1.00
tpch_q15/datafusion:parquet 254546342 254632921 1.00
tpch_q16/datafusion:parquet 126995280 126781211 1.00
tpch_q17/datafusion:parquet 683459196 672733122 1.02
tpch_q18/datafusion:parquet 877271715 861055354 1.02
tpch_q19/datafusion:parquet 295163388 293006142 1.01
tpch_q20/datafusion:parquet 298085456 294757305 1.01
tpch_q21/datafusion:parquet 701282155 696628901 1.01
tpch_q22/datafusion:parquet 210210605 212163937 0.99
datafusion / arrow (1.001x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 601730437 602414575 1.00
tpch_q02/datafusion:arrow 162873279 165866916 0.98
tpch_q03/datafusion:arrow 505153413 460082784 1.10
tpch_q04/datafusion:arrow 340038230 340547268 1.00
tpch_q05/datafusion:arrow 913716771 906181111 1.01
tpch_q06/datafusion:arrow 275158027 278876206 0.99
tpch_q07/datafusion:arrow 1218810355 1139995893 1.07
tpch_q08/datafusion:arrow 1102272190 1119626442 0.98
tpch_q09/datafusion:arrow 1313851107 1315394224 1.00
tpch_q10/datafusion:arrow 595663331 586092951 1.02
tpch_q11/datafusion:arrow 133870012 135204604 0.99
tpch_q12/datafusion:arrow 731656829 787571112 0.93
tpch_q13/datafusion:arrow 500911011 505690840 0.99
tpch_q14/datafusion:arrow 312139807 315008561 0.99
tpch_q15/datafusion:arrow 685750915 677915836 1.01
tpch_q16/datafusion:arrow 101313410 101171575 1.00
tpch_q17/datafusion:arrow 1308099121 1289927996 1.01
tpch_q18/datafusion:arrow 1865167895 1847952805 1.01
tpch_q19/datafusion:arrow 490409360 496803380 0.99
tpch_q20/datafusion:arrow 475750761 483061512 0.98
tpch_q21/datafusion:arrow 3002002286 2970789308 1.01
tpch_q22/datafusion:arrow 123862488 126259753 0.98
duckdb / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170089921 170305018 1.00
tpch_q02/duckdb:vortex-file-compressed 51555466 52980934 0.97
tpch_q03/duckdb:vortex-file-compressed 126035751 128535809 0.98
tpch_q04/duckdb:vortex-file-compressed 154116025 152367568 1.01
tpch_q05/duckdb:vortex-file-compressed 128676536 129398414 0.99
tpch_q06/duckdb:vortex-file-compressed 50558958 51195921 0.99
tpch_q07/duckdb:vortex-file-compressed 149587413 147002335 1.02
tpch_q08/duckdb:vortex-file-compressed 170350485 171024504 1.00
tpch_q09/duckdb:vortex-file-compressed 323545213 324540208 1.00
tpch_q10/duckdb:vortex-file-compressed 146454058 145172476 1.01
tpch_q11/duckdb:vortex-file-compressed 32943995 33169968 0.99
tpch_q12/duckdb:vortex-file-compressed 96476360 94790266 1.02
tpch_q13/duckdb:vortex-file-compressed 227137330 228247388 1.00
tpch_q14/duckdb:vortex-file-compressed 66462922 67793894 0.98
tpch_q15/duckdb:vortex-file-compressed 87763986 87403982 1.00
tpch_q16/duckdb:vortex-file-compressed 79134183 76756890 1.03
tpch_q17/duckdb:vortex-file-compressed 98854540 99910391 0.99
tpch_q18/duckdb:vortex-file-compressed 290333469 288788175 1.01
tpch_q19/duckdb:vortex-file-compressed 83977229 84577049 0.99
tpch_q20/duckdb:vortex-file-compressed 159689716 160334843 1.00
tpch_q21/duckdb:vortex-file-compressed 574685370 570112293 1.01
tpch_q22/duckdb:vortex-file-compressed 72672839 71889558 1.01
duckdb / vortex-compact (0.996x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229404067 231407889 0.99
tpch_q02/duckdb:vortex-compact 56171434 56592567 0.99
tpch_q03/duckdb:vortex-compact 137628488 138783189 0.99
tpch_q04/duckdb:vortex-compact 171351948 172827462 0.99
tpch_q05/duckdb:vortex-compact 144082039 145455748 0.99
tpch_q06/duckdb:vortex-compact 83364464 85168749 0.98
tpch_q07/duckdb:vortex-compact 197438956 197406775 1.00
tpch_q08/duckdb:vortex-compact 183117731 183172824 1.00
tpch_q09/duckdb:vortex-compact 351126751 350462088 1.00
tpch_q10/duckdb:vortex-compact 177403022 175602475 1.01
tpch_q11/duckdb:vortex-compact 40575101 40406447 1.00
tpch_q12/duckdb:vortex-compact 201267564 202343294 0.99
tpch_q13/duckdb:vortex-compact 275519526 276985741 0.99
tpch_q14/duckdb:vortex-compact 99423870 98734905 1.01
tpch_q15/duckdb:vortex-compact 113881757 113557185 1.00
tpch_q16/duckdb:vortex-compact 83187382 82919939 1.00
tpch_q17/duckdb:vortex-compact 112558257 113124496 0.99
tpch_q18/duckdb:vortex-compact 286201579 291091902 0.98
tpch_q19/duckdb:vortex-compact 107535451 107907317 1.00
tpch_q20/duckdb:vortex-compact 202099923 202136022 1.00
tpch_q21/duckdb:vortex-compact 610124103 612410116 1.00
tpch_q22/duckdb:vortex-compact 84550381 84912419 1.00
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258504195 259202924 1.00
tpch_q02/duckdb:parquet 94145402 101629143 0.93
tpch_q03/duckdb:parquet 203914512 203901531 1.00
tpch_q04/duckdb:parquet 129356375 131541283 0.98
tpch_q05/duckdb:parquet 215370198 215832846 1.00
tpch_q06/duckdb:parquet 66989437 66502239 1.01
tpch_q07/duckdb:parquet 179453162 176703495 1.02
tpch_q08/duckdb:parquet 251539067 251732184 1.00
tpch_q09/duckdb:parquet 500248027 488023287 1.03
tpch_q10/duckdb:parquet 610061794 606933342 1.01
tpch_q11/duckdb:parquet 55563892 59463321 0.93
tpch_q12/duckdb:parquet 124227610 125033750 0.99
tpch_q13/duckdb:parquet 444200900 449224268 0.99
tpch_q14/duckdb:parquet 175795614 172325009 1.02
tpch_q15/duckdb:parquet 95039538 95613524 0.99
tpch_q16/duckdb:parquet 159167719 164113583 0.97
tpch_q17/duckdb:parquet 175241729 173853602 1.01
tpch_q18/duckdb:parquet 351116870 352577756 1.00
tpch_q19/duckdb:parquet 284641243 277643662 1.03
tpch_q20/duckdb:parquet 232052607 228548397 1.02
tpch_q21/duckdb:parquet 557440227 555842409 1.00
tpch_q22/duckdb:parquet 292585396 289185249 1.01
duckdb / duckdb (1.006x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117039897 117140119 1.00
tpch_q02/duckdb:duckdb 47672477 44649236 1.07
tpch_q03/duckdb:duckdb 97442340 97368965 1.00
tpch_q04/duckdb:duckdb 132795062 131697013 1.01
tpch_q05/duckdb:duckdb 108861512 108721082 1.00
tpch_q06/duckdb:duckdb 37081169 37273035 0.99
tpch_q07/duckdb:duckdb 86375697 86668788 1.00
tpch_q08/duckdb:duckdb 110612354 110319745 1.00
tpch_q09/duckdb:duckdb 276587856 277212173 1.00
tpch_q10/duckdb:duckdb 204748918 199898689 1.02
tpch_q11/duckdb:duckdb 15622825 15435718 1.01
tpch_q12/duckdb:duckdb 84588082 85165402 0.99
tpch_q13/duckdb:duckdb 220932496 221983811 1.00
tpch_q14/duckdb:duckdb 70286461 69982201 1.00
tpch_q15/duckdb:duckdb 78190695 77719400 1.01
tpch_q16/duckdb:duckdb 73649131 73816497 1.00
tpch_q17/duckdb:duckdb 84748950 84924706 1.00
tpch_q18/duckdb:duckdb 213478103 214426450 1.00
tpch_q19/duckdb:duckdb 117571143 116183984 1.01
tpch_q20/duckdb:duckdb 111551905 112124513 0.99
tpch_q21/duckdb:duckdb 290160685 292548535 0.99
tpch_q22/duckdb:duckdb 69068828 66619659 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.1% +2.5% -2.5% +10.0% ➖ noise
1 datafusion:vortex-compact -5.3% +2.5% -7.6% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -10.0% +2.5% -12.1% +10.0% ✅ faster
1 duckdb:duckdb -0.1% +2.5% -2.5% +10.0% ➖ noise
1 duckdb:vortex-compact -0.9% +2.5% -3.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.1% +2.5% -2.5% +10.0% ➖ noise
2 datafusion:arrow -1.8% -4.1% +2.3% +10.0% ➖ noise
2 datafusion:vortex-compact +20.0% -4.1% +25.1% +10.0% 🚨 regression
2 datafusion:vortex-file-compressed +13.2% -4.1% +18.0% +10.0% 🚨 regression
2 duckdb:duckdb +6.8% -4.1% +11.3% +10.0% 🚨 regression
2 duckdb:vortex-compact -0.7% -4.1% +3.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.7% -4.1% +1.4% +10.0% ➖ noise
3 datafusion:arrow +9.8% +0.5% +9.3% +10.0% ➖ noise
3 datafusion:vortex-compact +13.1% +0.5% +12.6% +10.0% 🚨 regression
3 datafusion:vortex-file-compressed +11.3% +0.5% +10.8% +10.0% 🚨 regression
3 duckdb:duckdb +0.1% +0.5% -0.4% +10.0% ➖ noise
3 duckdb:vortex-compact -0.8% +0.5% -1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.9% +0.5% -2.4% +10.0% ➖ noise
4 datafusion:arrow -0.1% +0.3% -0.5% +10.0% ➖ noise
4 datafusion:vortex-compact +19.6% +0.3% +19.2% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed +18.4% +0.3% +18.0% +10.0% 🚨 regression
4 duckdb:duckdb +0.8% +0.3% +0.5% +10.0% ➖ noise
4 duckdb:vortex-compact -0.9% +0.3% -1.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.1% +0.3% +0.8% +10.0% ➖ noise
5 datafusion:arrow +0.8% +0.2% +0.6% +10.0% ➖ noise
5 datafusion:vortex-compact +2.9% +0.2% +2.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.3% +0.2% +2.1% +10.0% ➖ noise
5 duckdb:duckdb +0.1% +0.2% -0.1% +10.0% ➖ noise
5 duckdb:vortex-compact -0.9% +0.2% -1.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.6% +0.2% -0.8% +10.0% ➖ noise
6 datafusion:arrow -1.3% +5.1% -6.1% +10.0% ➖ noise
6 datafusion:vortex-compact +7.2% +5.1% +2.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +5.4% +5.1% +0.3% +10.0% ➖ noise
6 duckdb:duckdb -0.5% +5.1% -5.3% +10.8% ➖ noise
6 duckdb:vortex-compact -2.1% +5.1% -6.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.2% +5.1% -6.0% +10.0% ➖ noise
7 datafusion:arrow +6.9% +1.1% +5.7% +10.0% ➖ noise
7 datafusion:vortex-compact +2.5% +1.1% +1.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +2.2% +1.1% +1.0% +10.0% ➖ noise
7 duckdb:duckdb -0.3% +1.1% -1.5% +10.0% ➖ noise
7 duckdb:vortex-compact +0.0% +1.1% -1.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.8% +1.1% +0.6% +10.0% ➖ noise
8 datafusion:arrow -1.6% +1.5% -3.0% +10.0% ➖ noise
8 datafusion:vortex-compact +2.9% +1.5% +1.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.7% +1.5% +1.2% +10.0% ➖ noise
8 duckdb:duckdb +0.3% +1.5% -1.2% +10.0% ➖ noise
8 duckdb:vortex-compact -0.0% +1.5% -1.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.4% +1.5% -1.8% +10.0% ➖ noise
9 datafusion:arrow -0.1% +1.3% -1.4% +10.0% ➖ noise
9 datafusion:vortex-compact -0.8% +1.3% -2.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.4% +1.3% -1.7% +10.0% ➖ noise
9 duckdb:duckdb -0.2% +1.3% -1.5% +10.0% ➖ noise
9 duckdb:vortex-compact +0.2% +1.3% -1.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.3% +1.3% -1.5% +10.0% ➖ noise
10 datafusion:arrow +1.6% +0.6% +1.0% +10.0% ➖ noise
10 datafusion:vortex-compact +8.1% +0.6% +7.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +4.7% +0.6% +4.1% +10.0% ➖ noise
10 duckdb:duckdb +2.4% +0.6% +1.8% +10.0% ➖ noise
10 duckdb:vortex-compact +1.0% +0.6% +0.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.9% +0.6% +0.3% +10.0% ➖ noise
11 datafusion:arrow -1.0% -3.4% +2.5% +12.9% ➖ noise
11 datafusion:vortex-compact +7.3% -3.4% +11.1% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed +5.6% -3.4% +9.3% +10.0% ➖ noise
11 duckdb:duckdb +1.2% -3.4% +4.8% +11.5% ➖ noise
11 duckdb:vortex-compact +0.4% -3.4% +4.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.7% -3.4% +2.9% +10.0% ➖ noise
12 datafusion:arrow -7.1% +1.6% -8.5% +34.8% ➖ noise
12 datafusion:vortex-compact +8.0% +1.6% +6.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +10.0% +1.6% +8.3% +10.0% ➖ noise
12 duckdb:duckdb -0.7% +1.6% -2.2% +10.0% ➖ noise
12 duckdb:vortex-compact -0.5% +1.6% -2.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.8% +1.6% +0.2% +10.0% ➖ noise
13 datafusion:arrow -0.9% -1.2% +0.2% +10.0% ➖ noise
13 datafusion:vortex-compact +5.5% -1.2% +6.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +4.8% -1.2% +6.0% +10.0% ➖ noise
13 duckdb:duckdb -0.5% -1.2% +0.7% +10.0% ➖ noise
13 duckdb:vortex-compact -0.5% -1.2% +0.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.5% -1.2% +0.7% +10.0% ➖ noise
14 datafusion:arrow -0.9% +1.1% -1.9% +10.0% ➖ noise
14 datafusion:vortex-compact +10.2% +1.1% +9.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +6.2% +1.1% +5.1% +10.0% ➖ noise
14 duckdb:duckdb +0.4% +1.1% -0.6% +10.0% ➖ noise
14 duckdb:vortex-compact +0.7% +1.1% -0.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.0% +1.1% -3.0% +10.0% ➖ noise
15 datafusion:arrow +1.2% -0.3% +1.5% +10.0% ➖ noise
15 datafusion:vortex-compact +14.9% -0.3% +15.2% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed +7.9% -0.3% +8.3% +10.0% ➖ noise
15 duckdb:duckdb +0.6% -0.3% +0.9% +10.0% ➖ noise
15 duckdb:vortex-compact +0.3% -0.3% +0.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.4% -0.3% +0.7% +10.0% ➖ noise
16 datafusion:arrow +0.1% -1.4% +1.6% +10.0% ➖ noise
16 datafusion:vortex-compact +8.9% -1.4% +10.5% +10.0% 🚨 regression
16 datafusion:vortex-file-compressed +5.1% -1.4% +6.7% +10.0% ➖ noise
16 duckdb:duckdb -0.2% -1.4% +1.2% +10.0% ➖ noise
16 duckdb:vortex-compact +0.3% -1.4% +1.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +3.1% -1.4% +4.6% +10.0% ➖ noise
17 datafusion:arrow +1.4% +1.2% +0.2% +10.0% ➖ noise
17 datafusion:vortex-compact +3.3% +1.2% +2.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +3.2% +1.2% +2.0% +10.0% ➖ noise
17 duckdb:duckdb -0.2% +1.2% -1.4% +10.0% ➖ noise
17 duckdb:vortex-compact -0.5% +1.2% -1.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -1.1% +1.2% -2.2% +10.0% ➖ noise
18 datafusion:arrow +0.9% +0.7% +0.2% +10.0% ➖ noise
18 datafusion:vortex-compact +2.8% +0.7% +2.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.5% +0.7% +0.7% +10.0% ➖ noise
18 duckdb:duckdb -0.4% +0.7% -1.2% +10.0% ➖ noise
18 duckdb:vortex-compact -1.7% +0.7% -2.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.5% +0.7% -0.2% +10.0% ➖ noise
19 datafusion:arrow -1.3% +1.6% -2.9% +10.0% ➖ noise
19 datafusion:vortex-compact +2.7% +1.6% +1.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.7% +1.6% -0.9% +10.0% ➖ noise
19 duckdb:duckdb +1.2% +1.6% -0.4% +10.0% ➖ noise
19 duckdb:vortex-compact -0.3% +1.6% -1.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.7% +1.6% -2.3% +10.0% ➖ noise
20 datafusion:arrow -1.5% +1.3% -2.8% +10.0% ➖ noise
20 datafusion:vortex-compact +12.5% +1.3% +11.0% +10.0% 🚨 regression
20 datafusion:vortex-file-compressed +9.8% +1.3% +8.4% +10.0% ➖ noise
20 duckdb:duckdb -0.5% +1.3% -1.8% +10.0% ➖ noise
20 duckdb:vortex-compact -0.0% +1.3% -1.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.4% +1.3% -1.7% +10.0% ➖ noise
21 datafusion:arrow +1.1% +0.5% +0.6% +10.0% ➖ noise
21 datafusion:vortex-compact +11.2% +0.5% +10.7% +10.0% 🚨 regression
21 datafusion:vortex-file-compressed +7.2% +0.5% +6.7% +10.0% ➖ noise
21 duckdb:duckdb -0.8% +0.5% -1.3% +10.0% ➖ noise
21 duckdb:vortex-compact -0.4% +0.5% -0.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.8% +0.5% +0.3% +10.0% ➖ noise
22 datafusion:arrow -1.9% +0.1% -2.0% +10.0% ➖ noise
22 datafusion:vortex-compact +17.6% +0.1% +17.5% +10.0% 🚨 regression
22 datafusion:vortex-file-compressed +8.2% +0.1% +8.1% +10.0% ➖ noise
22 duckdb:duckdb +3.7% +0.1% +3.5% +10.0% ➖ noise
22 duckdb:vortex-compact -0.4% +0.1% -0.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +1.1% +0.1% +1.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.5%
Vortex (geomean): 1.017x ➖
Parquet (geomean): 1.054x ➖
Shifts: Parquet (control) +5.4% · Median polish +1.1%


datafusion / vortex-file-compressed (1.025x ➖, 1↑ 1↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 217161970 202923650 1.07
tpch_q02/datafusion:vortex-file-compressed 455320782 437730376 1.04
tpch_q03/datafusion:vortex-file-compressed 381036151 379148887 1.00
tpch_q04/datafusion:vortex-file-compressed 🚨 262122078 198522513 1.32
tpch_q05/datafusion:vortex-file-compressed 421526037 415268420 1.02
tpch_q06/datafusion:vortex-file-compressed 287237662 291490752 0.99
tpch_q07/datafusion:vortex-file-compressed 364453313 380105848 0.96
tpch_q08/datafusion:vortex-file-compressed 637346899 568515803 1.12
tpch_q09/datafusion:vortex-file-compressed 404665670 319476925 1.27
tpch_q10/datafusion:vortex-file-compressed 480812787 423193840 1.14
tpch_q11/datafusion:vortex-file-compressed 308751677 305302522 1.01
tpch_q12/datafusion:vortex-file-compressed 414551603 375540097 1.10
tpch_q13/datafusion:vortex-file-compressed 186864987 150192423 1.24
tpch_q14/datafusion:vortex-file-compressed 182067351 181511585 1.00
tpch_q15/datafusion:vortex-file-compressed 🚀 331038495 543174980 0.61
tpch_q16/datafusion:vortex-file-compressed 220009932 206697767 1.06
tpch_q17/datafusion:vortex-file-compressed 328600185 358645317 0.92
tpch_q18/datafusion:vortex-file-compressed 291567029 373053520 0.78
tpch_q19/datafusion:vortex-file-compressed 348001340 343650321 1.01
tpch_q20/datafusion:vortex-file-compressed 352555884 362755226 0.97
tpch_q21/datafusion:vortex-file-compressed 427859055 425087555 1.01
tpch_q22/datafusion:vortex-file-compressed 180889772 155302876 1.16
datafusion / vortex-compact (1.148x ➖, 0↑ 6↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 272192130 247739827 1.10
tpch_q02/datafusion:vortex-compact 445217017 418622522 1.06
tpch_q03/datafusion:vortex-compact 383895430 360912510 1.06
tpch_q04/datafusion:vortex-compact 196992634 239472932 0.82
tpch_q05/datafusion:vortex-compact 392076464 369918852 1.06
tpch_q06/datafusion:vortex-compact 308675011 302884892 1.02
tpch_q07/datafusion:vortex-compact 401735375 395245392 1.02
tpch_q08/datafusion:vortex-compact 542444546 482033703 1.13
tpch_q09/datafusion:vortex-compact 460200889 411110422 1.12
tpch_q10/datafusion:vortex-compact 573671628 496623729 1.16
tpch_q11/datafusion:vortex-compact 🚨 356045457 267963613 1.33
tpch_q12/datafusion:vortex-compact 🚨 602592320 447222279 1.35
tpch_q13/datafusion:vortex-compact 🚨 187601318 113566971 1.65
tpch_q14/datafusion:vortex-compact 315462583 287101013 1.10
tpch_q15/datafusion:vortex-compact 491722298 467650776 1.05
tpch_q16/datafusion:vortex-compact 198314114 180482910 1.10
tpch_q17/datafusion:vortex-compact 🚨 502148931 361773017 1.39
tpch_q18/datafusion:vortex-compact 🚨 374931572 276363570 1.36
tpch_q19/datafusion:vortex-compact 507281421 472295921 1.07
tpch_q20/datafusion:vortex-compact 491393995 462973967 1.06
tpch_q21/datafusion:vortex-compact 646831508 540716002 1.20
tpch_q22/datafusion:vortex-compact 🚨 199943964 151070524 1.32
datafusion / parquet (1.105x ➖, 0↑ 4↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 224060380 226543225 0.99
tpch_q02/datafusion:parquet 487531137 468532110 1.04
tpch_q03/datafusion:parquet 301245420 328425329 0.92
tpch_q04/datafusion:parquet 159006448 175155879 0.91
tpch_q05/datafusion:parquet 501872190 456288086 1.10
tpch_q06/datafusion:parquet 157818283 157231600 1.00
tpch_q07/datafusion:parquet 515425957 537528238 0.96
tpch_q08/datafusion:parquet 578223161 582820506 0.99
tpch_q09/datafusion:parquet 463180242 472584142 0.98
tpch_q10/datafusion:parquet 🚨 798072781 506371132 1.58
tpch_q11/datafusion:parquet 🚨 853633653 329376768 2.59
tpch_q12/datafusion:parquet 268937960 240813082 1.12
tpch_q13/datafusion:parquet 420847903 426872643 0.99
tpch_q14/datafusion:parquet 162725631 175834759 0.93
tpch_q15/datafusion:parquet 303170851 287079843 1.06
tpch_q16/datafusion:parquet 167548631 170382290 0.98
tpch_q17/datafusion:parquet 400717365 395239866 1.01
tpch_q18/datafusion:parquet 431668732 438091284 0.99
tpch_q19/datafusion:parquet 547044702 477213692 1.15
tpch_q20/datafusion:parquet 🚨 599991407 415038557 1.45
tpch_q21/datafusion:parquet 🚨 755329161 552089809 1.37
tpch_q22/datafusion:parquet 150191156 145545142 1.03
duckdb / vortex-file-compressed (0.956x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 258512871 268809134 0.96
tpch_q02/duckdb:vortex-file-compressed 981517682 985663407 1.00
tpch_q03/duckdb:vortex-file-compressed 636276418 661838419 0.96
tpch_q04/duckdb:vortex-file-compressed 340593391 374923164 0.91
tpch_q05/duckdb:vortex-file-compressed 890972946 948794311 0.94
tpch_q06/duckdb:vortex-file-compressed 403842371 424787749 0.95
tpch_q07/duckdb:vortex-file-compressed 880107616 856043747 1.03
tpch_q08/duckdb:vortex-file-compressed 960848341 961470602 1.00
tpch_q09/duckdb:vortex-file-compressed 836621823 820699921 1.02
tpch_q10/duckdb:vortex-file-compressed 792805593 791034610 1.00
tpch_q11/duckdb:vortex-file-compressed 479445501 499887077 0.96
tpch_q12/duckdb:vortex-file-compressed 468409684 518108126 0.90
tpch_q13/duckdb:vortex-file-compressed 489853439 470385851 1.04
tpch_q14/duckdb:vortex-file-compressed 475107938 475664102 1.00
tpch_q15/duckdb:vortex-file-compressed 287629265 361669440 0.80
tpch_q16/duckdb:vortex-file-compressed 401610611 362275025 1.11
tpch_q17/duckdb:vortex-file-compressed 705163883 761184287 0.93
tpch_q18/duckdb:vortex-file-compressed 526867821 653085631 0.81
tpch_q19/duckdb:vortex-file-compressed 470237440 444724892 1.06
tpch_q20/duckdb:vortex-file-compressed 822238908 828443836 0.99
tpch_q21/duckdb:vortex-file-compressed 1054679070 1174038642 0.90
tpch_q22/duckdb:vortex-file-compressed 331966412 390477481 0.85
duckdb / vortex-compact (0.950x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 263474688 344368631 0.77
tpch_q02/duckdb:vortex-compact 939419020 969179224 0.97
tpch_q03/duckdb:vortex-compact 594684524 597348841 1.00
tpch_q04/duckdb:vortex-compact 350651199 332526031 1.05
tpch_q05/duckdb:vortex-compact 887983230 900823311 0.99
tpch_q06/duckdb:vortex-compact 392299217 446082827 0.88
tpch_q07/duckdb:vortex-compact 800303015 816678294 0.98
tpch_q08/duckdb:vortex-compact 984217473 1091893671 0.90
tpch_q09/duckdb:vortex-compact 850825775 921962865 0.92
tpch_q10/duckdb:vortex-compact 802344025 697499482 1.15
tpch_q11/duckdb:vortex-compact 504623347 543805091 0.93
tpch_q12/duckdb:vortex-compact 474289346 457270823 1.04
tpch_q13/duckdb:vortex-compact 419037950 449178273 0.93
tpch_q14/duckdb:vortex-compact 415176660 508162866 0.82
tpch_q15/duckdb:vortex-compact 288975006 340812416 0.85
tpch_q16/duckdb:vortex-compact 381746811 387609085 0.98
tpch_q17/duckdb:vortex-compact 644760819 684959089 0.94
tpch_q18/duckdb:vortex-compact 495710435 525439386 0.94
tpch_q19/duckdb:vortex-compact 448994048 481960576 0.93
tpch_q20/duckdb:vortex-compact 765708312 825328847 0.93
tpch_q21/duckdb:vortex-compact 1210065468 1048398008 1.15
tpch_q22/duckdb:vortex-compact 345844142 369472735 0.94
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 472451011 458079892 1.03
tpch_q02/duckdb:parquet 1258167214 1328825667 0.95
tpch_q03/duckdb:parquet 1128492829 971206621 1.16
tpch_q04/duckdb:parquet 582770510 609125210 0.96
tpch_q05/duckdb:parquet 1509217806 1441740890 1.05
tpch_q06/duckdb:parquet 428601361 404733606 1.06
tpch_q07/duckdb:parquet 1358712777 1293861229 1.05
tpch_q08/duckdb:parquet 1790180244 1723817993 1.04
tpch_q09/duckdb:parquet 1403851018 1489573435 0.94
tpch_q10/duckdb:parquet 1286310264 1307894064 0.98
tpch_q11/duckdb:parquet 869307161 886942239 0.98
tpch_q12/duckdb:parquet 656155798 659234284 1.00
tpch_q13/duckdb:parquet 866507136 900131968 0.96
tpch_q14/duckdb:parquet 635460179 654438986 0.97
tpch_q15/duckdb:parquet 505080581 506755579 1.00
tpch_q16/duckdb:parquet 598930749 607556258 0.99
tpch_q17/duckdb:parquet 707050453 782876505 0.90
tpch_q18/duckdb:parquet 916442079 914494411 1.00
tpch_q19/duckdb:parquet 812659370 749098408 1.08
tpch_q20/duckdb:parquet 1084034249 1065350407 1.02
tpch_q21/duckdb:parquet 1139817579 1131537192 1.01
tpch_q22/duckdb:parquet 563574668 546262522 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +9.9% +1.0% +8.8% +70.6% ➖ noise
1 datafusion:vortex-file-compressed +7.0% +1.0% +6.0% +71.8% ➖ noise
1 duckdb:vortex-compact -23.5% +1.0% -24.2% +66.4% ➖ noise
1 duckdb:vortex-file-compressed -3.8% +1.0% -4.8% +48.9% ➖ noise
2 datafusion:vortex-compact +6.4% -0.7% +7.1% +36.3% ➖ noise
2 datafusion:vortex-file-compressed +4.0% -0.7% +4.8% +36.3% ➖ noise
2 duckdb:vortex-compact -3.1% -0.7% -2.3% +36.3% ➖ noise
2 duckdb:vortex-file-compressed -0.4% -0.7% +0.3% +36.3% ➖ noise
3 datafusion:vortex-compact +6.4% +3.2% +3.0% +41.5% ➖ noise
3 datafusion:vortex-file-compressed +0.5% +3.2% -2.7% +58.6% ➖ noise
3 duckdb:vortex-compact -0.4% +3.2% -3.6% +40.7% ➖ noise
3 duckdb:vortex-file-compressed -3.9% +3.2% -6.9% +36.3% ➖ noise
4 datafusion:vortex-compact -17.7% -6.8% -11.7% +36.3% ➖ noise
4 datafusion:vortex-file-compressed +32.0% -6.8% +41.7% +36.3% 🚨 regression
4 duckdb:vortex-compact +5.5% -6.8% +13.2% +36.3% ➖ noise
4 duckdb:vortex-file-compressed -9.2% -6.8% -2.5% +36.3% ➖ noise
5 datafusion:vortex-compact +6.0% +7.3% -1.2% +36.3% ➖ noise
5 datafusion:vortex-file-compressed +1.5% +7.3% -5.4% +36.3% ➖ noise
5 duckdb:vortex-compact -1.4% +7.3% -8.1% +36.3% ➖ noise
5 duckdb:vortex-file-compressed -6.1% +7.3% -12.5% +36.3% ➖ noise
6 datafusion:vortex-compact +1.9% +3.1% -1.2% +36.3% ➖ noise
6 datafusion:vortex-file-compressed -1.5% +3.1% -4.4% +36.3% ➖ noise
6 duckdb:vortex-compact -12.1% +3.1% -14.7% +36.3% ➖ noise
6 duckdb:vortex-file-compressed -4.9% +3.1% -7.8% +36.3% ➖ noise
7 datafusion:vortex-compact +1.6% +0.3% +1.3% +36.3% ➖ noise
7 datafusion:vortex-file-compressed -4.1% +0.3% -4.4% +36.3% ➖ noise
7 duckdb:vortex-compact -2.0% +0.3% -2.3% +36.3% ➖ noise
7 duckdb:vortex-file-compressed +2.8% +0.3% +2.5% +36.3% ➖ noise
8 datafusion:vortex-compact +12.5% +1.5% +10.9% +36.3% ➖ noise
8 datafusion:vortex-file-compressed +12.1% +1.5% +10.4% +36.3% ➖ noise
8 duckdb:vortex-compact -9.9% +1.5% -11.2% +36.3% ➖ noise
8 duckdb:vortex-file-compressed -0.1% +1.5% -1.5% +36.3% ➖ noise
9 datafusion:vortex-compact +11.9% -3.9% +16.5% +36.3% ➖ noise
9 datafusion:vortex-file-compressed +26.7% -3.9% +31.8% +36.3% ➖ noise
9 duckdb:vortex-compact -7.7% -3.9% -4.0% +36.3% ➖ noise
9 duckdb:vortex-file-compressed +1.9% -3.9% +6.1% +36.3% ➖ noise
10 datafusion:vortex-compact +15.5% +24.5% -7.2% +36.3% ➖ noise
10 datafusion:vortex-file-compressed +13.6% +24.5% -8.7% +36.3% ➖ noise
10 duckdb:vortex-compact +15.0% +24.5% -7.6% +36.3% ➖ noise
10 duckdb:vortex-file-compressed +0.2% +24.5% -19.5% +36.3% ➖ noise
11 datafusion:vortex-compact +32.9% +59.4% -16.6% +36.3% ➖ noise
11 datafusion:vortex-file-compressed +1.1% +59.4% -36.5% +36.3% ✅ faster
11 duckdb:vortex-compact -7.2% +59.4% -41.8% +36.3% ✅ faster
11 duckdb:vortex-file-compressed -4.1% +59.4% -39.8% +36.3% ✅ faster
12 datafusion:vortex-compact +34.7% +5.4% +27.8% +36.3% ➖ noise
12 datafusion:vortex-file-compressed +10.4% +5.4% +4.7% +46.5% ➖ noise
12 duckdb:vortex-compact +3.7% +5.4% -1.6% +36.3% ➖ noise
12 duckdb:vortex-file-compressed -9.6% +5.4% -14.2% +36.3% ➖ noise
13 datafusion:vortex-compact +65.2% -2.6% +69.6% +59.9% 🚨 regression
13 datafusion:vortex-file-compressed +24.4% -2.6% +27.7% +63.7% ➖ noise
13 duckdb:vortex-compact -6.7% -2.6% -4.2% +36.3% ➖ noise
13 duckdb:vortex-file-compressed +4.1% -2.6% +6.9% +36.3% ➖ noise
14 datafusion:vortex-compact +9.9% -5.2% +15.9% +36.3% ➖ noise
14 datafusion:vortex-file-compressed +0.3% -5.2% +5.8% +62.4% ➖ noise
14 duckdb:vortex-compact -18.3% -5.2% -13.8% +36.3% ➖ noise
14 duckdb:vortex-file-compressed -0.1% -5.2% +5.4% +36.3% ➖ noise
15 datafusion:vortex-compact +5.1% +2.6% +2.5% +36.3% ➖ noise
15 datafusion:vortex-file-compressed -39.1% +2.6% -40.6% +36.3% ✅ faster
15 duckdb:vortex-compact -15.2% +2.6% -17.4% +36.3% ➖ noise
15 duckdb:vortex-file-compressed -20.5% +2.6% -22.5% +36.3% ➖ noise
16 datafusion:vortex-compact +9.9% -1.5% +11.6% +36.3% ➖ noise
16 datafusion:vortex-file-compressed +6.4% -1.5% +8.1% +36.3% ➖ noise
16 duckdb:vortex-compact -1.5% -1.5% +0.0% +36.3% ➖ noise
16 duckdb:vortex-file-compressed +10.9% -1.5% +12.6% +36.3% ➖ noise
17 datafusion:vortex-compact +38.8% -4.3% +45.1% +36.3% 🚨 regression
17 datafusion:vortex-file-compressed -8.4% -4.3% -4.3% +36.3% ➖ noise
17 duckdb:vortex-compact -5.9% -4.3% -1.6% +36.3% ➖ noise
17 duckdb:vortex-file-compressed -7.4% -4.3% -3.2% +36.3% ➖ noise
18 datafusion:vortex-compact +35.7% -0.6% +36.5% +36.3% 🚨 regression
18 datafusion:vortex-file-compressed -21.8% -0.6% -21.3% +38.9% ➖ noise
18 duckdb:vortex-compact -5.7% -0.6% -5.1% +36.3% ➖ noise
18 duckdb:vortex-file-compressed -19.3% -0.6% -18.8% +36.3% ➖ noise
19 datafusion:vortex-compact +7.4% +11.5% -3.7% +36.3% ➖ noise
19 datafusion:vortex-file-compressed +1.3% +11.5% -9.2% +36.3% ➖ noise
19 duckdb:vortex-compact -6.8% +11.5% -16.5% +36.3% ➖ noise
19 duckdb:vortex-file-compressed +5.7% +11.5% -5.2% +36.3% ➖ noise
20 datafusion:vortex-compact +6.1% +21.3% -12.5% +36.3% ➖ noise
20 datafusion:vortex-file-compressed -2.8% +21.3% -19.9% +36.3% ➖ noise
20 duckdb:vortex-compact -7.2% +21.3% -23.5% +36.3% ➖ noise
20 duckdb:vortex-file-compressed -0.7% +21.3% -18.2% +36.3% ➖ noise
21 datafusion:vortex-compact +19.6% +17.4% +1.9% +36.3% ➖ noise
21 datafusion:vortex-file-compressed +0.7% +17.4% -14.3% +36.3% ➖ noise
21 duckdb:vortex-compact +15.4% +17.4% -1.7% +36.3% ➖ noise
21 duckdb:vortex-file-compressed -10.2% +17.4% -23.5% +36.3% ➖ noise
22 datafusion:vortex-compact +32.4% +3.2% +28.3% +36.3% ➖ noise
22 datafusion:vortex-file-compressed +16.5% +3.2% +12.9% +36.3% ➖ noise
22 duckdb:vortex-compact -6.4% +3.2% -9.3% +36.3% ➖ noise
22 duckdb:vortex-file-compressed -15.0% +3.2% -17.6% +36.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.3%
Vortex (geomean): 1.060x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +1.1%


datafusion / vortex-file-compressed (1.081x ➖, 0↑ 14↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1637408 1684363 0.97
clickbench_q01/datafusion:vortex-file-compressed 14019809 13658573 1.03
clickbench_q02/datafusion:vortex-file-compressed 🚨 34796878 31179576 1.12
clickbench_q03/datafusion:vortex-file-compressed 🚨 40959595 35599218 1.15
clickbench_q04/datafusion:vortex-file-compressed 289124210 280185707 1.03
clickbench_q05/datafusion:vortex-file-compressed 🚨 328439493 292025439 1.12
clickbench_q06/datafusion:vortex-file-compressed 1646397 1681488 0.98
clickbench_q07/datafusion:vortex-file-compressed 17042656 15922539 1.07
clickbench_q08/datafusion:vortex-file-compressed 369390184 350189788 1.05
clickbench_q09/datafusion:vortex-file-compressed 560944801 541365682 1.04
clickbench_q10/datafusion:vortex-file-compressed 🚨 75980398 67996817 1.12
clickbench_q11/datafusion:vortex-file-compressed 🚨 91132262 80819182 1.13
clickbench_q12/datafusion:vortex-file-compressed 277209403 252070803 1.10
clickbench_q13/datafusion:vortex-file-compressed 437396135 403434952 1.08
clickbench_q14/datafusion:vortex-file-compressed 265907478 247254617 1.08
clickbench_q15/datafusion:vortex-file-compressed 326166989 316085178 1.03
clickbench_q16/datafusion:vortex-file-compressed 646385857 643402225 1.00
clickbench_q17/datafusion:vortex-file-compressed 633435437 620843106 1.02
clickbench_q18/datafusion:vortex-file-compressed 1277682206 1266924670 1.01
clickbench_q19/datafusion:vortex-file-compressed 23471279 25057880 0.94
clickbench_q20/datafusion:vortex-file-compressed 335877891 331433652 1.01
clickbench_q21/datafusion:vortex-file-compressed 364220968 367616361 0.99
clickbench_q22/datafusion:vortex-file-compressed 460212770 450243653 1.02
clickbench_q23/datafusion:vortex-file-compressed 🚨 867388310 668549515 1.30
clickbench_q24/datafusion:vortex-file-compressed 🚨 56871340 44108189 1.29
clickbench_q25/datafusion:vortex-file-compressed 🚨 78334532 66169051 1.18
clickbench_q26/datafusion:vortex-file-compressed 🚨 53625010 43809186 1.22
clickbench_q27/datafusion:vortex-file-compressed 🚨 809665070 719910589 1.12
clickbench_q28/datafusion:vortex-file-compressed 6648121612 6442596673 1.03
clickbench_q29/datafusion:vortex-file-compressed 243477031 238323719 1.02
clickbench_q30/datafusion:vortex-file-compressed 🚨 247875059 216020929 1.15
clickbench_q31/datafusion:vortex-file-compressed 🚨 280870757 249398871 1.13
clickbench_q32/datafusion:vortex-file-compressed 1162971973 1095837864 1.06
clickbench_q33/datafusion:vortex-file-compressed 1351256113 1263652494 1.07
clickbench_q34/datafusion:vortex-file-compressed 1331353939 1277569781 1.04
clickbench_q35/datafusion:vortex-file-compressed 465344497 447725064 1.04
clickbench_q36/datafusion:vortex-file-compressed 69744584 68705481 1.02
clickbench_q37/datafusion:vortex-file-compressed 35430628 34653839 1.02
clickbench_q38/datafusion:vortex-file-compressed 🚨 30540589 19358349 1.58
clickbench_q39/datafusion:vortex-file-compressed 138626500 129952681 1.07
clickbench_q40/datafusion:vortex-file-compressed 16850661 15916346 1.06
clickbench_q41/datafusion:vortex-file-compressed 🚨 17178603 15415489 1.11
clickbench_q42/datafusion:vortex-file-compressed 18071433 17157467 1.05
datafusion / parquet (1.012x ➖, 0↑ 2↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 1758109 1515604 1.16
clickbench_q01/datafusion:parquet 19279971 19281992 1.00
clickbench_q02/datafusion:parquet 47869075 47665275 1.00
clickbench_q03/datafusion:parquet 🚨 40914733 37142272 1.10
clickbench_q04/datafusion:parquet 318461447 297975592 1.07
clickbench_q05/datafusion:parquet 377936751 344445120 1.10
clickbench_q06/datafusion:parquet 1691052 1727289 0.98
clickbench_q07/datafusion:parquet 23369364 21735057 1.08
clickbench_q08/datafusion:parquet 392303458 370920287 1.06
clickbench_q09/datafusion:parquet 633919912 616409546 1.03
clickbench_q10/datafusion:parquet 116013347 109816413 1.06
clickbench_q11/datafusion:parquet 137796321 135305889 1.02
clickbench_q12/datafusion:parquet 342060168 345520906 0.99
clickbench_q13/datafusion:parquet 497675800 493248053 1.01
clickbench_q14/datafusion:parquet 338351575 340365898 0.99
clickbench_q15/datafusion:parquet 332822228 335259236 0.99
clickbench_q16/datafusion:parquet 672794328 655274643 1.03
clickbench_q17/datafusion:parquet 641423367 647451463 0.99
clickbench_q18/datafusion:parquet 1319698255 1313720314 1.00
clickbench_q19/datafusion:parquet 28627235 29191614 0.98
clickbench_q20/datafusion:parquet 594612400 614139650 0.97
clickbench_q21/datafusion:parquet 668477698 665856783 1.00
clickbench_q22/datafusion:parquet 996298656 987996562 1.01
clickbench_q23/datafusion:parquet 3793090589 3735639009 1.02
clickbench_q24/datafusion:parquet 83276846 80738615 1.03
clickbench_q25/datafusion:parquet 137584820 135172080 1.02
clickbench_q26/datafusion:parquet 88663883 83393327 1.06
clickbench_q27/datafusion:parquet 1054378096 1037199467 1.02
clickbench_q28/datafusion:parquet 6511035543 6367790690 1.02
clickbench_q29/datafusion:parquet 234853772 249440005 0.94
clickbench_q30/datafusion:parquet 333594469 331592769 1.01
clickbench_q31/datafusion:parquet 366300996 359418351 1.02
clickbench_q32/datafusion:parquet 1138192583 1154662315 0.99
clickbench_q33/datafusion:parquet 1479156710 1462086395 1.01
clickbench_q34/datafusion:parquet 1470558569 1469689502 1.00
clickbench_q35/datafusion:parquet 480726757 476290229 1.01
clickbench_q36/datafusion:parquet 134029284 137670699 0.97
clickbench_q37/datafusion:parquet 56408460 58793446 0.96
clickbench_q38/datafusion:parquet 81050091 82958086 0.98
clickbench_q39/datafusion:parquet 255489864 254449911 1.00
clickbench_q40/datafusion:parquet 28699558 30291588 0.95
clickbench_q41/datafusion:parquet 26843595 28288590 0.95
clickbench_q42/datafusion:parquet 28265407 29136166 0.97
duckdb / vortex-file-compressed (1.040x ➖, 0↑ 8↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6099897 5936808 1.03
clickbench_q01/duckdb:vortex-file-compressed 13878046 13930632 1.00
clickbench_q02/duckdb:vortex-file-compressed 25663251 26312566 0.98
clickbench_q03/duckdb:vortex-file-compressed 29603915 30375322 0.97
clickbench_q04/duckdb:vortex-file-compressed 178111153 180658100 0.99
clickbench_q05/duckdb:vortex-file-compressed 172455569 171717842 1.00
clickbench_q06/duckdb:vortex-file-compressed 18284475 18621005 0.98
clickbench_q07/duckdb:vortex-file-compressed 15507890 15107995 1.03
clickbench_q08/duckdb:vortex-file-compressed 250212048 260474601 0.96
clickbench_q09/duckdb:vortex-file-compressed 331866505 330001313 1.01
clickbench_q10/duckdb:vortex-file-compressed 66819285 66616412 1.00
clickbench_q11/duckdb:vortex-file-compressed 77401172 78886866 0.98
clickbench_q12/duckdb:vortex-file-compressed 191918969 208776701 0.92
clickbench_q13/duckdb:vortex-file-compressed 402174525 393308510 1.02
clickbench_q14/duckdb:vortex-file-compressed 227495538 226465133 1.00
clickbench_q15/duckdb:vortex-file-compressed 236296246 236032974 1.00
clickbench_q16/duckdb:vortex-file-compressed 582170050 580976888 1.00
clickbench_q17/duckdb:vortex-file-compressed 478562673 472613742 1.01
clickbench_q18/duckdb:vortex-file-compressed 970769576 952244514 1.02
clickbench_q19/duckdb:vortex-file-compressed 22290477 22571106 0.99
clickbench_q20/duckdb:vortex-file-compressed 327177345 342378081 0.96
clickbench_q21/duckdb:vortex-file-compressed 371470335 367003325 1.01
clickbench_q22/duckdb:vortex-file-compressed 🚨 602661045 543186166 1.11
clickbench_q23/duckdb:vortex-file-compressed 🚨 1719796134 1179809958 1.46
clickbench_q24/duckdb:vortex-file-compressed 38437923 40072802 0.96
clickbench_q25/duckdb:vortex-file-compressed 76579935 79938637 0.96
clickbench_q26/duckdb:vortex-file-compressed 52469225 49507500 1.06
clickbench_q27/duckdb:vortex-file-compressed 474884358 464431023 1.02
clickbench_q28/duckdb:vortex-file-compressed 2953568709 2960166564 1.00
clickbench_q29/duckdb:vortex-file-compressed 28093004 28509093 0.99
clickbench_q30/duckdb:vortex-file-compressed 191458617 190423510 1.01
clickbench_q31/duckdb:vortex-file-compressed 277793745 280489778 0.99
clickbench_q32/duckdb:vortex-file-compressed 1173100101 1122911901 1.04
clickbench_q33/duckdb:vortex-file-compressed 1168186092 1164936412 1.00
clickbench_q34/duckdb:vortex-file-compressed 1209977457 1251649732 0.97
clickbench_q35/duckdb:vortex-file-compressed 386156838 373250036 1.03
clickbench_q36/duckdb:vortex-file-compressed 🚨 34714271 27902502 1.24
clickbench_q37/duckdb:vortex-file-compressed 🚨 27616618 21398067 1.29
clickbench_q38/duckdb:vortex-file-compressed 🚨 27768449 23233071 1.20
clickbench_q39/duckdb:vortex-file-compressed 45161285 42611067 1.06
clickbench_q40/duckdb:vortex-file-compressed 🚨 24764258 20363085 1.22
clickbench_q41/duckdb:vortex-file-compressed 🚨 24131839 19691859 1.23
clickbench_q42/duckdb:vortex-file-compressed 🚨 26832427 21730142 1.23
duckdb / parquet (1.014x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 26338381 25300639 1.04
clickbench_q01/duckdb:parquet 28004520 27389962 1.02
clickbench_q02/duckdb:parquet 49407912 48238253 1.02
clickbench_q03/duckdb:parquet 38065951 38545334 0.99
clickbench_q04/duckdb:parquet 202705437 201147051 1.01
clickbench_q05/duckdb:parquet 272383382 264922793 1.03
clickbench_q06/duckdb:parquet 46990924 46741890 1.01
clickbench_q07/duckdb:parquet 30098749 28675382 1.05
clickbench_q08/duckdb:parquet 263192777 267037016 0.99
clickbench_q09/duckdb:parquet 394982957 392246037 1.01
clickbench_q10/duckdb:parquet 81013440 80704317 1.00
clickbench_q11/duckdb:parquet 97536787 97732279 1.00
clickbench_q12/duckdb:parquet 295425335 283184456 1.04
clickbench_q13/duckdb:parquet 475679915 476103119 1.00
clickbench_q14/duckdb:parquet 324426438 327325510 0.99
clickbench_q15/duckdb:parquet 256089516 259054866 0.99
clickbench_q16/duckdb:parquet 650847624 642519123 1.01
clickbench_q17/duckdb:parquet 540544495 523908223 1.03
clickbench_q18/duckdb:parquet 1067268110 1060687905 1.01
clickbench_q19/duckdb:parquet 25754594 25683606 1.00
clickbench_q20/duckdb:parquet 429204205 427863304 1.00
clickbench_q21/duckdb:parquet 545734901 546435413 1.00
clickbench_q22/duckdb:parquet 931105647 924630688 1.01
clickbench_q23/duckdb:parquet 298658099 310844241 0.96
clickbench_q24/duckdb:parquet 68103606 69035785 0.99
clickbench_q25/duckdb:parquet 157381193 155176048 1.01
clickbench_q26/duckdb:parquet 48081504 45848924 1.05
clickbench_q27/duckdb:parquet 644887576 637372646 1.01
clickbench_q28/duckdb:parquet 4836961426 4826107239 1.00
clickbench_q29/duckdb:parquet 40733344 40172239 1.01
clickbench_q30/duckdb:parquet 301295493 296878740 1.01
clickbench_q31/duckdb:parquet 367867226 358699524 1.03
clickbench_q32/duckdb:parquet 1201625451 1140252996 1.05
clickbench_q33/duckdb:parquet 1337517887 1227522475 1.09
clickbench_q34/duckdb:parquet 1329162271 1262873200 1.05
clickbench_q35/duckdb:parquet 360609943 362780899 0.99
clickbench_q36/duckdb:parquet 48668784 49770616 0.98
clickbench_q37/duckdb:parquet 30496070 30995497 0.98
clickbench_q38/duckdb:parquet 33256024 33783229 0.98
clickbench_q39/duckdb:parquet 83169781 75691728 1.10
clickbench_q40/duckdb:parquet 18072635 18584821 0.97
clickbench_q41/duckdb:parquet 19673601 18347271 1.07
clickbench_q42/duckdb:parquet 21639912 20846787 1.04
duckdb / duckdb (1.021x ➖, 1↑ 5↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17381135 18212881 0.95
clickbench_q01/duckdb:duckdb 33460882 33323499 1.00
clickbench_q02/duckdb:duckdb 45558982 46169931 0.99
clickbench_q03/duckdb:duckdb 46781415 46902982 1.00
clickbench_q04/duckdb:duckdb 188374953 188690938 1.00
clickbench_q05/duckdb:duckdb 266259879 264264388 1.01
clickbench_q06/duckdb:duckdb 28259955 27779674 1.02
clickbench_q07/duckdb:duckdb 35874326 35506136 1.01
clickbench_q08/duckdb:duckdb 251145818 251295898 1.00
clickbench_q09/duckdb:duckdb 361794934 368842820 0.98
clickbench_q10/duckdb:duckdb 98796272 97449741 1.01
clickbench_q11/duckdb:duckdb 108378774 106599050 1.02
clickbench_q12/duckdb:duckdb 242784031 234136356 1.04
clickbench_q13/duckdb:duckdb 467012774 460449971 1.01
clickbench_q14/duckdb:duckdb 270796631 273907607 0.99
clickbench_q15/duckdb:duckdb 219224947 220373478 0.99
clickbench_q16/duckdb:duckdb 631816080 632984090 1.00
clickbench_q17/duckdb:duckdb 560371434 562648105 1.00
clickbench_q18/duckdb:duckdb 1232890055 1196400668 1.03
clickbench_q19/duckdb:duckdb 34924852 34651122 1.01
clickbench_q20/duckdb:duckdb 🚨 991956659 897551434 1.11
clickbench_q21/duckdb:duckdb 935495546 946419286 0.99
clickbench_q22/duckdb:duckdb 🚨 1115769959 1013203917 1.10
clickbench_q23/duckdb:duckdb 256199883 258455194 0.99
clickbench_q24/duckdb:duckdb 61641245 61145079 1.01
clickbench_q25/duckdb:duckdb 144174004 142340971 1.01
clickbench_q26/duckdb:duckdb 61580523 59736284 1.03
clickbench_q27/duckdb:duckdb 966807761 940856362 1.03
clickbench_q28/duckdb:duckdb 4710385237 4595308904 1.03
clickbench_q29/duckdb:duckdb 49350119 48270501 1.02
clickbench_q30/duckdb:duckdb 258883086 258075886 1.00
clickbench_q31/duckdb:duckdb 435711731 413760567 1.05
clickbench_q32/duckdb:duckdb 1540609610 1463085339 1.05
clickbench_q33/duckdb:duckdb 🚨 2248803519 1872193274 1.20
clickbench_q34/duckdb:duckdb 🚨 2276565666 2025671530 1.12
clickbench_q35/duckdb:duckdb 284526916 281556024 1.01
clickbench_q36/duckdb:duckdb 🚨 41303154 35575724 1.16
clickbench_q37/duckdb:duckdb 31513543 30841876 1.02
clickbench_q38/duckdb:duckdb 31358851 30653704 1.02
clickbench_q39/duckdb:duckdb 🚀 62895680 71580762 0.88
clickbench_q40/duckdb:duckdb 32037068 31411188 1.02
clickbench_q41/duckdb:duckdb 31564942 31218987 1.01
clickbench_q42/duckdb:duckdb 32185759 31848355 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -2.8% +9.9% -11.5% +782.2% ➖ noise
0 duckdb:duckdb -4.6% +9.9% -13.2% +283.5% ➖ noise
0 duckdb:vortex-file-compressed +2.7% +9.9% -6.5% +481.2% ➖ noise
1 datafusion:vortex-file-compressed +2.6% +1.1% +1.5% +29.0% ➖ noise
1 duckdb:duckdb +0.4% +1.1% -0.7% +63.6% ➖ noise
1 duckdb:vortex-file-compressed -0.4% +1.1% -1.5% +23.0% ➖ noise
2 datafusion:vortex-file-compressed +11.6% +1.4% +10.0% +15.9% ➖ noise
2 duckdb:duckdb -1.3% +1.4% -2.7% +23.3% ➖ noise
2 duckdb:vortex-file-compressed -2.5% +1.4% -3.8% +11.6% ➖ noise
3 datafusion:vortex-file-compressed +15.1% +4.3% +10.3% +157.4% ➖ noise
3 duckdb:duckdb -0.3% +4.3% -4.4% +49.9% ➖ noise
3 duckdb:vortex-file-compressed -2.5% +4.3% -6.6% +88.5% ➖ noise
4 datafusion:vortex-file-compressed +3.2% +3.8% -0.6% +10.0% ➖ noise
4 duckdb:duckdb -0.2% +3.8% -3.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.4% +3.8% -5.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +12.5% +6.2% +5.9% +10.0% ➖ noise
5 duckdb:duckdb +0.8% +6.2% -5.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.4% +6.2% -5.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.1% -0.8% -1.3% +40.0% ➖ noise
6 duckdb:duckdb +1.7% -0.8% +2.5% +29.5% ➖ noise
6 duckdb:vortex-file-compressed -1.8% -0.8% -1.0% +15.4% ➖ noise
7 datafusion:vortex-file-compressed +7.0% +6.2% +0.8% +14.2% ➖ noise
7 duckdb:duckdb +1.0% +6.2% -4.9% +10.6% ➖ noise
7 duckdb:vortex-file-compressed +2.6% +6.2% -3.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +5.5% +2.1% +3.3% +10.0% ➖ noise
8 duckdb:duckdb -0.1% +2.1% -2.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.9% +2.1% -5.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.6% +1.8% +1.8% +10.0% ➖ noise
9 duckdb:duckdb -1.9% +1.8% -3.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.6% +1.8% -1.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +11.7% +3.0% +8.5% +10.0% ➖ noise
10 duckdb:duckdb +1.4% +3.0% -1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.3% +3.0% -2.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +12.8% +0.8% +11.8% +10.0% 🚨 regression
11 duckdb:duckdb +1.7% +0.8% +0.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.9% +0.8% -2.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +10.0% +1.6% +8.2% +10.0% ➖ noise
12 duckdb:duckdb +3.7% +1.6% +2.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -8.1% +1.6% -9.5% +10.0% ✅ faster
13 datafusion:vortex-file-compressed +8.4% +0.4% +8.0% +10.0% ➖ noise
13 duckdb:duckdb +1.4% +0.4% +1.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.3% +0.4% +1.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +7.5% -0.7% +8.3% +10.0% ➖ noise
14 duckdb:duckdb -1.1% -0.7% -0.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.5% -0.7% +1.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +3.2% -0.9% +4.2% +10.0% ➖ noise
15 duckdb:duckdb -0.5% -0.9% +0.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.1% -0.9% +1.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.5% +2.0% -1.5% +10.0% ➖ noise
16 duckdb:duckdb -0.2% +2.0% -2.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.2% +2.0% -1.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.0% +1.1% +0.9% +10.0% ➖ noise
17 duckdb:duckdb -0.4% +1.1% -1.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.3% +1.1% +0.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.8% +0.5% +0.3% +10.0% ➖ noise
18 duckdb:duckdb +3.0% +0.5% +2.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.9% +0.5% +1.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -6.3% -0.8% -5.5% +20.3% ➖ noise
19 duckdb:duckdb +0.8% -0.8% +1.6% +12.7% ➖ noise
19 duckdb:vortex-file-compressed -1.2% -0.8% -0.4% +13.9% ➖ noise
20 datafusion:vortex-file-compressed +1.3% -1.4% +2.8% +212.1% ➖ noise
20 duckdb:duckdb +10.5% -1.4% +12.1% +32.3% ➖ noise
20 duckdb:vortex-file-compressed -4.4% -1.4% -3.0% +52.2% ➖ noise
21 datafusion:vortex-file-compressed -0.9% +0.1% -1.1% +10.0% ➖ noise
21 duckdb:duckdb -1.2% +0.1% -1.3% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.2% +0.1% +1.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +2.2% +0.8% +1.4% +14.1% ➖ noise
22 duckdb:duckdb +10.1% +0.8% +9.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +10.9% +0.8% +10.1% +15.9% ➖ noise
23 datafusion:vortex-file-compressed +29.7% -1.2% +31.4% +40.7% ➖ noise
23 duckdb:duckdb -0.9% -1.2% +0.4% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +45.8% -1.2% +47.6% +18.5% 🚨 regression
24 datafusion:vortex-file-compressed +28.9% +0.9% +27.8% +10.0% 🚨 regression
24 duckdb:duckdb +0.8% +0.9% -0.1% +10.3% ➖ noise
24 duckdb:vortex-file-compressed -4.1% +0.9% -4.9% +22.0% ➖ noise
25 datafusion:vortex-file-compressed +18.4% +1.6% +16.5% +10.0% 🚨 regression
25 duckdb:duckdb +1.3% +1.6% -0.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -4.2% +1.6% -5.7% +13.6% ➖ noise
26 datafusion:vortex-file-compressed +22.4% +5.6% +15.9% +11.6% 🚨 regression
26 duckdb:duckdb +3.1% +5.6% -2.4% +14.2% ➖ noise
26 duckdb:vortex-file-compressed +6.0% +5.6% +0.4% +24.4% ➖ noise
27 datafusion:vortex-file-compressed +12.5% +1.4% +10.9% +10.0% 🚨 regression
27 duckdb:duckdb +2.8% +1.4% +1.3% +10.9% ➖ noise
27 duckdb:vortex-file-compressed +2.3% +1.4% +0.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +3.2% +1.2% +1.9% +10.0% ➖ noise
28 duckdb:duckdb +2.5% +1.2% +1.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.2% +1.2% -1.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +2.2% -2.3% +4.6% +10.0% ➖ noise
29 duckdb:duckdb +2.2% -2.3% +4.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -1.5% -2.3% +0.9% +12.5% ➖ noise
30 datafusion:vortex-file-compressed +14.7% +1.0% +13.6% +10.2% 🚨 regression
30 duckdb:duckdb +0.3% +1.0% -0.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.5% +1.0% -0.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +12.6% +2.2% +10.2% +10.0% 🚨 regression
31 duckdb:duckdb +5.3% +2.2% +3.0% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -1.0% +2.2% -3.1% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +6.1% +1.9% +4.1% +18.6% ➖ noise
32 duckdb:duckdb +5.3% +1.9% +3.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +4.5% +1.9% +2.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +6.9% +5.0% +1.8% +10.0% ➖ noise
33 duckdb:duckdb +20.1% +5.0% +14.4% +10.0% 🚨 regression
33 duckdb:vortex-file-compressed +0.3% +5.0% -4.5% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +4.2% +2.6% +1.5% +10.0% ➖ noise
34 duckdb:duckdb +12.4% +2.6% +9.5% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -3.3% +2.6% -5.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +3.9% +0.2% +3.8% +10.0% ➖ noise
35 duckdb:duckdb +1.1% +0.2% +0.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +3.5% +0.2% +3.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.5% -2.4% +4.0% +10.0% ➖ noise
36 duckdb:duckdb +16.1% -2.4% +19.0% +11.0% 🚨 regression
36 duckdb:vortex-file-compressed +24.4% -2.4% +27.5% +10.0% 🚨 regression
37 datafusion:vortex-file-compressed +2.2% -2.8% +5.2% +10.0% ➖ noise
37 duckdb:duckdb +2.2% -2.8% +5.2% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +29.1% -2.8% +32.8% +11.2% 🚨 regression
38 datafusion:vortex-file-compressed +57.8% -1.9% +60.9% +11.4% 🚨 regression
38 duckdb:duckdb +2.3% -1.9% +4.3% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +19.5% -1.9% +21.9% +10.6% 🚨 regression
39 datafusion:vortex-file-compressed +6.7% +5.0% +1.6% +10.0% ➖ noise
39 duckdb:duckdb -12.1% +5.0% -16.3% +13.6% ✅ faster
39 duckdb:vortex-file-compressed +6.0% +5.0% +0.9% +17.1% ➖ noise
40 datafusion:vortex-file-compressed +5.9% -4.0% +10.3% +12.3% ➖ noise
40 duckdb:duckdb +2.0% -4.0% +6.3% +13.0% ➖ noise
40 duckdb:vortex-file-compressed +21.6% -4.0% +26.7% +13.8% 🚨 regression
41 datafusion:vortex-file-compressed +11.4% +0.9% +10.5% +11.9% ➖ noise
41 duckdb:duckdb +1.1% +0.9% +0.2% +11.6% ➖ noise
41 duckdb:vortex-file-compressed +22.5% +0.9% +21.5% +13.4% 🚨 regression
42 datafusion:vortex-file-compressed +5.3% +0.4% +5.0% +10.0% ➖ noise
42 duckdb:duckdb +1.1% +0.4% +0.7% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +23.5% +0.4% +23.0% +10.4% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 20, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 20, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 20, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 20, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 20, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.4%
Vortex (geomean): 0.943x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -4.2%


datafusion / vortex-file-compressed (1.001x ➖, 1↑ 1↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 683320031 691980528 0.99
tpch_q02/datafusion:vortex-file-compressed 711186918 653960450 1.09
tpch_q03/datafusion:vortex-file-compressed 846417194 812063673 1.04
tpch_q04/datafusion:vortex-file-compressed 654964255 630761622 1.04
tpch_q05/datafusion:vortex-file-compressed 949896572 1022532136 0.93
tpch_q06/datafusion:vortex-file-compressed 621711445 695351213 0.89
tpch_q07/datafusion:vortex-file-compressed 1019222178 1016732662 1.00
tpch_q08/datafusion:vortex-file-compressed 1164087223 1097468478 1.06
tpch_q09/datafusion:vortex-file-compressed 1359635846 1211457032 1.12
tpch_q10/datafusion:vortex-file-compressed 🚨 1310316523 926487775 1.41
tpch_q11/datafusion:vortex-file-compressed 484277125 591102926 0.82
tpch_q12/datafusion:vortex-file-compressed 860291901 1053334283 0.82
tpch_q13/datafusion:vortex-file-compressed 442018467 455786725 0.97
tpch_q14/datafusion:vortex-file-compressed 614081720 657207932 0.93
tpch_q15/datafusion:vortex-file-compressed 🚀 1194011638 1714728731 0.70
tpch_q16/datafusion:vortex-file-compressed 346167374 307444440 1.13
tpch_q17/datafusion:vortex-file-compressed 1260465396 1129220213 1.12
tpch_q18/datafusion:vortex-file-compressed 1243931403 1182590587 1.05
tpch_q19/datafusion:vortex-file-compressed 810939668 801095143 1.01
tpch_q20/datafusion:vortex-file-compressed 984562002 1117677389 0.88
tpch_q21/datafusion:vortex-file-compressed 1796219389 1544765222 1.16
tpch_q22/datafusion:vortex-file-compressed 366828875 335660499 1.09
datafusion / vortex-compact (0.989x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 665509994 674837947 0.99
tpch_q02/datafusion:vortex-compact 667810759 645275307 1.03
tpch_q03/datafusion:vortex-compact 675925086 694203035 0.97
tpch_q04/datafusion:vortex-compact 548238489 501988276 1.09
tpch_q05/datafusion:vortex-compact 1084848357 850680819 1.28
tpch_q06/datafusion:vortex-compact 569013751 568155709 1.00
tpch_q07/datafusion:vortex-compact 978213947 951388081 1.03
tpch_q08/datafusion:vortex-compact 1035884136 1087118572 0.95
tpch_q09/datafusion:vortex-compact 1157255798 1162816900 1.00
tpch_q10/datafusion:vortex-compact 951745511 849762270 1.12
tpch_q11/datafusion:vortex-compact 473861877 387725655 1.22
tpch_q12/datafusion:vortex-compact 784243228 870794040 0.90
tpch_q13/datafusion:vortex-compact 426474277 421793510 1.01
tpch_q14/datafusion:vortex-compact 559686286 643658329 0.87
tpch_q15/datafusion:vortex-compact 1070156326 1172380504 0.91
tpch_q16/datafusion:vortex-compact 315834685 385196637 0.82
tpch_q17/datafusion:vortex-compact 1268131898 1206176089 1.05
tpch_q18/datafusion:vortex-compact 1105419117 1167944733 0.95
tpch_q19/datafusion:vortex-compact 883300310 795195566 1.11
tpch_q20/datafusion:vortex-compact 872295738 1095689964 0.80
tpch_q21/datafusion:vortex-compact 1356305227 1564918953 0.87
tpch_q22/datafusion:vortex-compact 348051710 369469002 0.94
datafusion / parquet (1.057x ➖, 0↑ 1↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 767990207 737624812 1.04
tpch_q02/datafusion:parquet 1007828281 873908095 1.15
tpch_q03/datafusion:parquet 1041012259 1175761369 0.89
tpch_q04/datafusion:parquet 445155289 575312550 0.77
tpch_q05/datafusion:parquet 1179137403 1272707094 0.93
tpch_q06/datafusion:parquet 534532957 513579743 1.04
tpch_q07/datafusion:parquet 1291152457 1192182015 1.08
tpch_q08/datafusion:parquet 1803576241 1549994530 1.16
tpch_q09/datafusion:parquet 1832247385 1722408002 1.06
tpch_q10/datafusion:parquet 2186728294 2103117159 1.04
tpch_q11/datafusion:parquet 548004920 570319273 0.96
tpch_q12/datafusion:parquet 729138712 663580862 1.10
tpch_q13/datafusion:parquet 740115723 696241274 1.06
tpch_q14/datafusion:parquet 820104120 795722147 1.03
tpch_q15/datafusion:parquet 1229769705 1171003584 1.05
tpch_q16/datafusion:parquet 449935745 429494793 1.05
tpch_q17/datafusion:parquet 1524941599 1357634346 1.12
tpch_q18/datafusion:parquet 1496747614 1494083749 1.00
tpch_q19/datafusion:parquet 1069192478 933271341 1.15
tpch_q20/datafusion:parquet 1251493083 1105913203 1.13
tpch_q21/datafusion:parquet 1717939774 1692074224 1.02
tpch_q22/datafusion:parquet 🚨 1047416423 645307604 1.62
duckdb / vortex-file-compressed (0.932x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 599955723 642251918 0.93
tpch_q02/duckdb:vortex-file-compressed 1154051265 1176369006 0.98
tpch_q03/duckdb:vortex-file-compressed 836853846 1056573649 0.79
tpch_q04/duckdb:vortex-file-compressed 606548167 695177045 0.87
tpch_q05/duckdb:vortex-file-compressed 1209424829 1177254463 1.03
tpch_q06/duckdb:vortex-file-compressed 756240009 824702150 0.92
tpch_q07/duckdb:vortex-file-compressed 1185923317 1293166451 0.92
tpch_q08/duckdb:vortex-file-compressed 1410018621 1487298087 0.95
tpch_q09/duckdb:vortex-file-compressed 1439458555 1377590868 1.04
tpch_q10/duckdb:vortex-file-compressed 1143687832 1156222963 0.99
tpch_q11/duckdb:vortex-file-compressed 705404344 667030661 1.06
tpch_q12/duckdb:vortex-file-compressed 736073172 755408588 0.97
tpch_q13/duckdb:vortex-file-compressed 953503210 1100654180 0.87
tpch_q14/duckdb:vortex-file-compressed 825981696 891220590 0.93
tpch_q15/duckdb:vortex-file-compressed 536103406 625952172 0.86
tpch_q16/duckdb:vortex-file-compressed 490610077 499024997 0.98
tpch_q17/duckdb:vortex-file-compressed 922928209 986805528 0.94
tpch_q18/duckdb:vortex-file-compressed 959233489 887924893 1.08
tpch_q19/duckdb:vortex-file-compressed 765617532 811067350 0.94
tpch_q20/duckdb:vortex-file-compressed 1221644165 1435778193 0.85
tpch_q21/duckdb:vortex-file-compressed 1969862821 2315998997 0.85
tpch_q22/duckdb:vortex-file-compressed 683691698 824776121 0.83
duckdb / vortex-compact (0.855x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 600044487 747277018 0.80
tpch_q02/duckdb:vortex-compact 979591656 1172561132 0.84
tpch_q03/duckdb:vortex-compact 818406166 951802837 0.86
tpch_q04/duckdb:vortex-compact 509044407 619882416 0.82
tpch_q05/duckdb:vortex-compact 986550895 1339373130 0.74
tpch_q06/duckdb:vortex-compact 724338195 866805056 0.84
tpch_q07/duckdb:vortex-compact 1067121001 1222607641 0.87
tpch_q08/duckdb:vortex-compact 1437953640 1719601833 0.84
tpch_q09/duckdb:vortex-compact 1320035873 1608237976 0.82
tpch_q10/duckdb:vortex-compact 1054685367 1266928270 0.83
tpch_q11/duckdb:vortex-compact 656230078 838183407 0.78
tpch_q12/duckdb:vortex-compact 628900209 753572730 0.83
tpch_q13/duckdb:vortex-compact 846647155 966027192 0.88
tpch_q14/duckdb:vortex-compact 820521910 998557947 0.82
tpch_q15/duckdb:vortex-compact 554130047 611242454 0.91
tpch_q16/duckdb:vortex-compact 474757205 528423240 0.90
tpch_q17/duckdb:vortex-compact 898583170 1014771728 0.89
tpch_q18/duckdb:vortex-compact 803044362 865546965 0.93
tpch_q19/duckdb:vortex-compact 742804625 833375697 0.89
tpch_q20/duckdb:vortex-compact 1282443242 1422191584 0.90
tpch_q21/duckdb:vortex-compact 1720193219 1938822411 0.89
tpch_q22/duckdb:vortex-compact 721805895 737701417 0.98
duckdb / parquet (0.939x ➖, 0↑ 0↓)
name PR 17fa9ff (ns) base e8d64af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 842169528 803192736 1.05
tpch_q02/duckdb:parquet 1508645457 1624730786 0.93
tpch_q03/duckdb:parquet 1682827313 1939879388 0.87
tpch_q04/duckdb:parquet 1012880672 1059578791 0.96
tpch_q05/duckdb:parquet 2128495238 2377718648 0.90
tpch_q06/duckdb:parquet 698091693 760341843 0.92
tpch_q07/duckdb:parquet 1825814037 1859683021 0.98
tpch_q08/duckdb:parquet 2378548281 2506905585 0.95
tpch_q09/duckdb:parquet 2494441019 2631139091 0.95
tpch_q10/duckdb:parquet 3439715733 3315581732 1.04
tpch_q11/duckdb:parquet 1090317766 1168221940 0.93
tpch_q12/duckdb:parquet 1184508829 1300497854 0.91
tpch_q13/duckdb:parquet 1272469696 1249630786 1.02
tpch_q14/duckdb:parquet 1300175305 1313873059 0.99
tpch_q15/duckdb:parquet 876563019 928574277 0.94
tpch_q16/duckdb:parquet 890743364 973016514 0.92
tpch_q17/duckdb:parquet 1246118814 1294732006 0.96
tpch_q18/duckdb:parquet 1435170942 1757305131 0.82
tpch_q19/duckdb:parquet 1448396525 1589069648 0.91
tpch_q20/duckdb:parquet 1959288584 1921318028 1.02
tpch_q21/duckdb:parquet 1704743787 2107480094 0.81
tpch_q22/duckdb:parquet 1082406287 1148339067 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.4% +4.5% -5.6% +44.2% ➖ noise
1 datafusion:vortex-file-compressed -1.3% +4.5% -5.5% +51.8% ➖ noise
1 duckdb:vortex-compact -19.7% +4.5% -23.1% +30.8% ➖ noise
1 duckdb:vortex-file-compressed -6.6% +4.5% -10.6% +36.9% ➖ noise
2 datafusion:vortex-compact +3.5% +3.5% +0.0% +43.9% ➖ noise
2 datafusion:vortex-file-compressed +8.8% +3.5% +5.1% +43.8% ➖ noise
2 duckdb:vortex-compact -16.5% +3.5% -19.3% +40.5% ➖ noise
2 duckdb:vortex-file-compressed -1.9% +3.5% -5.2% +39.8% ➖ noise
3 datafusion:vortex-compact -2.6% -12.4% +11.1% +41.8% ➖ noise
3 datafusion:vortex-file-compressed +4.2% -12.4% +18.9% +50.1% ➖ noise
3 duckdb:vortex-compact -14.0% -12.4% -1.9% +37.6% ➖ noise
3 duckdb:vortex-file-compressed -20.8% -12.4% -9.6% +42.0% ➖ noise
4 datafusion:vortex-compact +9.2% -14.0% +27.0% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +3.8% -14.0% +20.7% +30.0% ➖ noise
4 duckdb:vortex-compact -17.9% -14.0% -4.5% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -12.7% -14.0% +1.5% +30.0% ➖ noise
5 datafusion:vortex-compact +27.5% -8.9% +40.0% +30.0% 🚨 regression
5 datafusion:vortex-file-compressed -7.1% -8.9% +2.0% +30.0% ➖ noise
5 duckdb:vortex-compact -26.3% -8.9% -19.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +2.7% -8.9% +12.8% +30.0% ➖ noise
6 datafusion:vortex-compact +0.2% -2.2% +2.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -10.6% -2.2% -8.5% +30.0% ➖ noise
6 duckdb:vortex-compact -16.4% -2.2% -14.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -8.3% -2.2% -6.2% +30.0% ➖ noise
7 datafusion:vortex-compact +2.8% +3.1% -0.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +0.2% +3.1% -2.8% +30.0% ➖ noise
7 duckdb:vortex-compact -12.7% +3.1% -15.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -8.3% +3.1% -11.1% +30.0% ➖ noise
8 datafusion:vortex-compact -4.7% +5.1% -9.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +6.1% +5.1% +0.9% +30.0% ➖ noise
8 duckdb:vortex-compact -16.4% +5.1% -20.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -5.2% +5.1% -9.8% +30.0% ➖ noise
9 datafusion:vortex-compact -0.5% +0.4% -0.9% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +12.2% +0.4% +11.8% +30.0% ➖ noise
9 duckdb:vortex-compact -17.9% +0.4% -18.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +4.5% +0.4% +4.0% +30.0% ➖ noise
10 datafusion:vortex-compact +12.0% +3.9% +7.8% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +41.4% +3.9% +36.2% +30.5% 🚨 regression
10 duckdb:vortex-compact -16.8% +3.9% -19.8% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -1.1% +3.9% -4.8% +30.0% ➖ noise
11 datafusion:vortex-compact +22.2% -5.3% +29.1% +31.2% ➖ noise
11 datafusion:vortex-file-compressed -18.1% -5.3% -13.5% +30.0% ➖ noise
11 duckdb:vortex-compact -21.7% -5.3% -17.3% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +5.8% -5.3% +11.7% +30.0% ➖ noise
12 datafusion:vortex-compact -9.9% +0.0% -10.0% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -18.3% +0.0% -18.4% +30.0% ➖ noise
12 duckdb:vortex-compact -16.5% +0.0% -16.6% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -2.6% +0.0% -2.6% +30.0% ➖ noise
13 datafusion:vortex-compact +1.1% +4.0% -2.8% +30.0% ➖ noise
13 datafusion:vortex-file-compressed -3.0% +4.0% -6.8% +30.0% ➖ noise
13 duckdb:vortex-compact -12.4% +4.0% -15.8% +47.0% ➖ noise
13 duckdb:vortex-file-compressed -13.4% +4.0% -16.7% +43.9% ➖ noise
14 datafusion:vortex-compact -13.0% +1.0% -13.9% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -6.6% +1.0% -7.5% +30.0% ➖ noise
14 duckdb:vortex-compact -17.8% +1.0% -18.6% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -7.3% +1.0% -8.2% +30.0% ➖ noise
15 datafusion:vortex-compact -8.7% -0.4% -8.3% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -30.4% -0.4% -30.1% +30.0% ✅ faster
15 duckdb:vortex-compact -9.3% -0.4% -8.9% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -14.4% -0.4% -14.0% +30.0% ➖ noise
16 datafusion:vortex-compact -18.0% -2.1% -16.3% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +12.6% -2.1% +15.0% +30.0% ➖ noise
16 duckdb:vortex-compact -10.2% -2.1% -8.3% +30.4% ➖ noise
16 duckdb:vortex-file-compressed -1.7% -2.1% +0.4% +30.0% ➖ noise
17 datafusion:vortex-compact +5.1% +4.0% +1.1% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +11.6% +4.0% +7.4% +30.0% ➖ noise
17 duckdb:vortex-compact -11.4% +4.0% -14.8% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -6.5% +4.0% -10.0% +30.0% ➖ noise
18 datafusion:vortex-compact -5.4% -9.5% +4.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +5.2% -9.5% +16.3% +30.0% ➖ noise
18 duckdb:vortex-compact -7.2% -9.5% +2.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +8.0% -9.5% +19.4% +30.0% ➖ noise
19 datafusion:vortex-compact +11.1% +2.2% +8.7% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +1.2% +2.2% -0.9% +30.0% ➖ noise
19 duckdb:vortex-compact -10.9% +2.2% -12.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -5.6% +2.2% -7.6% +30.0% ➖ noise
20 datafusion:vortex-compact -20.4% +7.4% -25.9% +30.0% ✅ faster
20 datafusion:vortex-file-compressed -11.9% +7.4% -18.0% +30.0% ➖ noise
20 duckdb:vortex-compact -9.8% +7.4% -16.1% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -14.9% +7.4% -20.8% +30.0% ➖ noise
21 datafusion:vortex-compact -13.3% -9.4% -4.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +16.3% -9.4% +28.3% +30.0% ➖ noise
21 duckdb:vortex-compact -11.3% -9.4% -2.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -14.9% -9.4% -6.1% +30.0% ➖ noise
22 datafusion:vortex-compact -5.8% +23.7% -23.8% +30.0% ✅ faster
22 datafusion:vortex-file-compressed +9.3% +23.7% -11.6% +30.0% ➖ noise
22 duckdb:vortex-compact -2.2% +23.7% -20.9% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -17.1% +23.7% -33.0% +32.0% ✅ faster

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 20, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant