Skip to content

ji/remove-double-filter#7315

Draft
joseph-isaacs wants to merge 1 commit intodevelopfrom
ji/remove-double-filter
Draft

ji/remove-double-filter#7315
joseph-isaacs wants to merge 1 commit intodevelopfrom
ji/remove-double-filter

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

Summary

Closes: #000

Testing

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs force-pushed the ji/remove-double-filter branch from ecba214 to a714ea6 Compare April 7, 2026 13:51
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 7, 2026

Merging this PR will improve performance by 20.09%

⚡ 1 improved benchmark
✅ 1121 untouched benchmarks
⏩ 1530 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_bool_canonical_into[(1000, 10)] 59.9 µs 49.9 µs +20.09%

Comparing ji/remove-double-filter (a714ea6) with develop (6c7eb33)

Open in CodSpeed

Footnotes

  1. 1530 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@robert3005 robert3005 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 7, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 7, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a714ea6 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.052x ➖


datafusion / vortex-file-compressed (1.052x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 135742294 129642023 1.05
polarsignals_q01/datafusion:vortex-file-compressed 395165896 389225083 1.02
polarsignals_q02/datafusion:vortex-file-compressed 25684818 23452144 1.10
polarsignals_q03/datafusion:vortex-file-compressed 407039243 383389329 1.06
polarsignals_q04/datafusion:vortex-file-compressed 12901381 11831006 1.09
polarsignals_q05/datafusion:vortex-file-compressed 16172345 15281161 1.06
polarsignals_q06/datafusion:vortex-file-compressed 19630071 19027842 1.03
polarsignals_q07/datafusion:vortex-file-compressed 14884453 14366273 1.04
polarsignals_q08/datafusion:vortex-file-compressed 494722424 472320196 1.05
polarsignals_q09/datafusion:vortex-file-compressed 12078558 11639059 1.04

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 0.957x ➖
Parquet (geomean): 0.952x ➖
Shifts: Parquet (control) -4.8% · Median polish -5.7%


datafusion / vortex-file-compressed (0.948x ➖, 1↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 52530883 54129044 0.97
tpch_q02/datafusion:vortex-file-compressed 34292442 35880065 0.96
tpch_q03/datafusion:vortex-file-compressed 27405938 29574297 0.93
tpch_q04/datafusion:vortex-file-compressed 19162283 20206190 0.95
tpch_q05/datafusion:vortex-file-compressed 55254686 60259168 0.92
tpch_q06/datafusion:vortex-file-compressed 10323595 10776549 0.96
tpch_q07/datafusion:vortex-file-compressed 64916439 70332007 0.92
tpch_q08/datafusion:vortex-file-compressed 47303361 49682462 0.95
tpch_q09/datafusion:vortex-file-compressed 56190279 60470743 0.93
tpch_q10/datafusion:vortex-file-compressed 45683005 48854059 0.94
tpch_q11/datafusion:vortex-file-compressed 19815060 20142596 0.98
tpch_q12/datafusion:vortex-file-compressed 24477187 24244244 1.01
tpch_q13/datafusion:vortex-file-compressed 28469556 29252687 0.97
tpch_q14/datafusion:vortex-file-compressed 16180120 17347425 0.93
tpch_q15/datafusion:vortex-file-compressed 24345417 26133466 0.93
tpch_q16/datafusion:vortex-file-compressed 25315206 26013430 0.97
tpch_q17/datafusion:vortex-file-compressed 🚀 65423984 76833947 0.85
tpch_q18/datafusion:vortex-file-compressed 82081044 89919782 0.91
tpch_q19/datafusion:vortex-file-compressed 23601277 23939757 0.99
tpch_q20/datafusion:vortex-file-compressed 33655479 35697652 0.94
tpch_q21/datafusion:vortex-file-compressed 78560114 82399789 0.95
tpch_q22/datafusion:vortex-file-compressed 17466116 17325524 1.01
datafusion / vortex-compact (0.944x ➖, 2↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59144843 62874043 0.94
tpch_q02/datafusion:vortex-compact 38030099 40381575 0.94
tpch_q03/datafusion:vortex-compact 32028143 33970110 0.94
tpch_q04/datafusion:vortex-compact 24167736 24457766 0.99
tpch_q05/datafusion:vortex-compact 56178608 61947591 0.91
tpch_q06/datafusion:vortex-compact 12566337 13860013 0.91
tpch_q07/datafusion:vortex-compact 70458531 77818290 0.91
tpch_q08/datafusion:vortex-compact 52098823 53685754 0.97
tpch_q09/datafusion:vortex-compact 63327293 67340554 0.94
tpch_q10/datafusion:vortex-compact 🚀 53380037 60021473 0.89
tpch_q11/datafusion:vortex-compact 20221016 21112664 0.96
tpch_q12/datafusion:vortex-compact 34801709 36167802 0.96
tpch_q13/datafusion:vortex-compact 36453134 37906539 0.96
tpch_q14/datafusion:vortex-compact 21272497 22071364 0.96
tpch_q15/datafusion:vortex-compact 34798346 36614668 0.95
tpch_q16/datafusion:vortex-compact 31241357 31059290 1.01
tpch_q17/datafusion:vortex-compact 🚀 70697916 79193466 0.89
tpch_q18/datafusion:vortex-compact 89300476 96063128 0.93
tpch_q19/datafusion:vortex-compact 34838285 35924689 0.97
tpch_q20/datafusion:vortex-compact 39925696 41411523 0.96
tpch_q21/datafusion:vortex-compact 89094400 95371795 0.93
tpch_q22/datafusion:vortex-compact 17104919 18043054 0.95
datafusion / parquet (0.930x ➖, 5↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 96151874 141363815 0.68
tpch_q02/datafusion:parquet 70792693 75250234 0.94
tpch_q03/datafusion:parquet 79527492 85197691 0.93
tpch_q04/datafusion:parquet 50341040 51646356 0.97
tpch_q05/datafusion:parquet 106723385 111462874 0.96
tpch_q06/datafusion:parquet 🚀 35874439 44523053 0.81
tpch_q07/datafusion:parquet 116716566 123672925 0.94
tpch_q08/datafusion:parquet 102241392 104783626 0.98
tpch_q09/datafusion:parquet 138562434 140590128 0.99
tpch_q10/datafusion:parquet 122529844 127489609 0.96
tpch_q11/datafusion:parquet 49288185 51986601 0.95
tpch_q12/datafusion:parquet 🚀 83596074 97562505 0.86
tpch_q13/datafusion:parquet 219020351 237290014 0.92
tpch_q14/datafusion:parquet 47424245 47656678 1.00
tpch_q15/datafusion:parquet 🚀 67420763 78023179 0.86
tpch_q16/datafusion:parquet 53843869 56537867 0.95
tpch_q17/datafusion:parquet 🚀 136017475 155114176 0.88
tpch_q18/datafusion:parquet 178669434 189160278 0.94
tpch_q19/datafusion:parquet 91883868 84184970 1.09
tpch_q20/datafusion:parquet 80128342 82494597 0.97
tpch_q21/datafusion:parquet 154036010 152352573 1.01
tpch_q22/datafusion:parquet 35321810 37349636 0.95
datafusion / arrow (0.912x ➖, 10↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 56320470 69619273 0.81
tpch_q02/datafusion:arrow 22247071 23541211 0.95
tpch_q03/datafusion:arrow 🚀 35182841 40040530 0.88
tpch_q04/datafusion:arrow 🚀 29368024 33869140 0.87
tpch_q05/datafusion:arrow 🚀 78403509 92460072 0.85
tpch_q06/datafusion:arrow 🚀 20534489 24801213 0.83
tpch_q07/datafusion:arrow 117401861 127856838 0.92
tpch_q08/datafusion:arrow 48501079 51388710 0.94
tpch_q09/datafusion:arrow 🚀 73899152 82323088 0.90
tpch_q10/datafusion:arrow 54629286 59729748 0.91
tpch_q11/datafusion:arrow 12222324 12566579 0.97
tpch_q12/datafusion:arrow 60644283 60945082 1.00
tpch_q13/datafusion:arrow 51357411 52457051 0.98
tpch_q14/datafusion:arrow 24696487 27066667 0.91
tpch_q15/datafusion:arrow 🚀 47052303 53708166 0.88
tpch_q16/datafusion:arrow 22306722 21399522 1.04
tpch_q17/datafusion:arrow 🚀 73416316 84298850 0.87
tpch_q18/datafusion:arrow 🚀 147715928 169037283 0.87
tpch_q19/datafusion:arrow 41738961 43745759 0.95
tpch_q20/datafusion:arrow 🚀 39493837 43888323 0.90
tpch_q21/datafusion:arrow 158796224 172583649 0.92
tpch_q22/datafusion:arrow 20475217 21660357 0.95
duckdb / vortex-file-compressed (0.974x ➖, 8↑ 3↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33880892 35318803 0.96
tpch_q02/duckdb:vortex-file-compressed 28089318 30215244 0.93
tpch_q03/duckdb:vortex-file-compressed 31683524 32125125 0.99
tpch_q04/duckdb:vortex-file-compressed 🚀 28118280 31659702 0.89
tpch_q05/duckdb:vortex-file-compressed 🚨 40937292 36081359 1.13
tpch_q06/duckdb:vortex-file-compressed 🚀 8739734 12083265 0.72
tpch_q07/duckdb:vortex-file-compressed 🚀 35286558 42908912 0.82
tpch_q08/duckdb:vortex-file-compressed 47318605 45089872 1.05
tpch_q09/duckdb:vortex-file-compressed 🚀 68223139 91459208 0.75
tpch_q10/duckdb:vortex-file-compressed 43698411 40499837 1.08
tpch_q11/duckdb:vortex-file-compressed 16994629 17115509 0.99
tpch_q12/duckdb:vortex-file-compressed 🚨 35171094 25358498 1.39
tpch_q13/duckdb:vortex-file-compressed 38480785 40264350 0.96
tpch_q14/duckdb:vortex-file-compressed 🚀 21580149 25160830 0.86
tpch_q15/duckdb:vortex-file-compressed 16509099 17811887 0.93
tpch_q16/duckdb:vortex-file-compressed 🚀 28749776 32898629 0.87
tpch_q17/duckdb:vortex-file-compressed 🚨 71039204 28263701 2.51
tpch_q18/duckdb:vortex-file-compressed 50476188 50993261 0.99
tpch_q19/duckdb:vortex-file-compressed 🚀 25458412 36116347 0.70
tpch_q20/duckdb:vortex-file-compressed 35117721 37784868 0.93
tpch_q21/duckdb:vortex-file-compressed 116741595 118056061 0.99
tpch_q22/duckdb:vortex-file-compressed 🚀 17162305 19954855 0.86
duckdb / vortex-compact (0.962x ➖, 7↑ 4↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40304033 42080231 0.96
tpch_q02/duckdb:vortex-compact 39162162 40878225 0.96
tpch_q03/duckdb:vortex-compact 35144095 34996186 1.00
tpch_q04/duckdb:vortex-compact 🚀 32383285 36645205 0.88
tpch_q05/duckdb:vortex-compact 🚨 44920382 40403657 1.11
tpch_q06/duckdb:vortex-compact 🚀 10071960 16242513 0.62
tpch_q07/duckdb:vortex-compact 44374056 46593477 0.95
tpch_q08/duckdb:vortex-compact 🚨 53828918 48915145 1.10
tpch_q09/duckdb:vortex-compact 🚀 77847987 98265102 0.79
tpch_q10/duckdb:vortex-compact 🚨 48703118 43533221 1.12
tpch_q11/duckdb:vortex-compact 22686651 23170972 0.98
tpch_q12/duckdb:vortex-compact 42565503 39957597 1.07
tpch_q13/duckdb:vortex-compact 46182264 48480856 0.95
tpch_q14/duckdb:vortex-compact 🚀 26876138 32304127 0.83
tpch_q15/duckdb:vortex-compact 19768374 20849324 0.95
tpch_q16/duckdb:vortex-compact 🚀 31752236 39473992 0.80
tpch_q17/duckdb:vortex-compact 🚨 73152091 33201098 2.20
tpch_q18/duckdb:vortex-compact 51920743 53466714 0.97
tpch_q19/duckdb:vortex-compact 🚀 30875853 40858206 0.76
tpch_q20/duckdb:vortex-compact 44315605 46871216 0.95
tpch_q21/duckdb:vortex-compact 125386791 125586916 1.00
tpch_q22/duckdb:vortex-compact 🚀 18884332 22351659 0.84
duckdb / parquet (0.975x ➖, 2↑ 3↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 102088552 106693435 0.96
tpch_q02/duckdb:parquet 40114754 42525770 0.94
tpch_q03/duckdb:parquet 81630908 84284134 0.97
tpch_q04/duckdb:parquet 🚨 56246012 50017808 1.12
tpch_q05/duckdb:parquet 67153436 69138602 0.97
tpch_q06/duckdb:parquet 🚨 23949894 21236641 1.13
tpch_q07/duckdb:parquet 75527227 71478012 1.06
tpch_q08/duckdb:parquet 🚀 83189845 101502971 0.82
tpch_q09/duckdb:parquet 157179823 165502829 0.95
tpch_q10/duckdb:parquet 139640750 133684504 1.04
tpch_q11/duckdb:parquet 22188949 24049823 0.92
tpch_q12/duckdb:parquet 🚨 57436371 46501469 1.24
tpch_q13/duckdb:parquet 271732160 295556282 0.92
tpch_q14/duckdb:parquet 48525999 51480437 0.94
tpch_q15/duckdb:parquet 24164399 25109582 0.96
tpch_q16/duckdb:parquet 56460161 60675086 0.93
tpch_q17/duckdb:parquet 54895772 53260820 1.03
tpch_q18/duckdb:parquet 123088843 125686982 0.98
tpch_q19/duckdb:parquet 69887075 74583411 0.94
tpch_q20/duckdb:parquet 🚀 63684356 83744056 0.76
tpch_q21/duckdb:parquet 181643256 187275855 0.97
tpch_q22/duckdb:parquet 53357842 53442521 1.00
duckdb / duckdb (0.964x ➖, 2↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16577606 16731673 0.99
tpch_q02/duckdb:duckdb 13057402 13342480 0.98
tpch_q03/duckdb:duckdb 🚀 18425916 20653062 0.89
tpch_q04/duckdb:duckdb 19483907 19925493 0.98
tpch_q05/duckdb:duckdb 20379629 20774723 0.98
tpch_q06/duckdb:duckdb 5482227 5464984 1.00
tpch_q07/duckdb:duckdb 22412158 24262509 0.92
tpch_q08/duckdb:duckdb 21508946 21917021 0.98
tpch_q09/duckdb:duckdb 🚀 54726520 61985478 0.88
tpch_q10/duckdb:duckdb 45055818 47054602 0.96
tpch_q11/duckdb:duckdb 6153690 6303357 0.98
tpch_q12/duckdb:duckdb 14251122 14897807 0.96
tpch_q13/duckdb:duckdb 37666126 38522530 0.98
tpch_q14/duckdb:duckdb 18610045 19083788 0.98
tpch_q15/duckdb:duckdb 12321847 12274458 1.00
tpch_q16/duckdb:duckdb 24915478 27243779 0.91
tpch_q17/duckdb:duckdb 14055734 14535850 0.97
tpch_q18/duckdb:duckdb 39967799 40088016 1.00
tpch_q19/duckdb:duckdb 28178554 29900937 0.94
tpch_q20/duckdb:duckdb 23175144 23102989 1.00
tpch_q21/duckdb:duckdb 57273344 60346479 0.95
tpch_q22/duckdb:duckdb 24992845 25429403 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -19.1% -19.3% +0.3% +27.7% ➖ noise
1 datafusion:vortex-compact -5.9% -19.3% +16.6% +25.2% ➖ noise
1 datafusion:vortex-file-compressed -3.0% -19.3% +20.3% +26.1% ➖ noise
1 duckdb:duckdb -0.9% -19.3% +22.8% +24.8% ➖ noise
1 duckdb:vortex-compact -4.2% -19.3% +18.7% +23.8% ➖ noise
1 duckdb:vortex-file-compressed -4.1% -19.3% +18.9% +23.9% ➖ noise
2 datafusion:arrow -5.5% -5.8% +0.3% +16.2% ➖ noise
2 datafusion:vortex-compact -5.8% -5.8% -0.0% +16.2% ➖ noise
2 datafusion:vortex-file-compressed -4.4% -5.8% +1.5% +16.2% ➖ noise
2 duckdb:duckdb -2.1% -5.8% +3.9% +16.2% ➖ noise
2 duckdb:vortex-compact -4.2% -5.8% +1.7% +16.2% ➖ noise
2 duckdb:vortex-file-compressed -7.0% -5.8% -1.3% +16.2% ➖ noise
3 datafusion:arrow -12.1% -4.9% -7.6% +16.2% ➖ noise
3 datafusion:vortex-compact -5.7% -4.9% -0.8% +16.2% ➖ noise
3 datafusion:vortex-file-compressed -7.3% -4.9% -2.5% +16.2% ➖ noise
3 duckdb:duckdb -10.8% -4.9% -6.2% +22.0% ➖ noise
3 duckdb:vortex-compact +0.4% -4.9% +5.6% +16.2% ➖ noise
3 duckdb:vortex-file-compressed -1.4% -4.9% +3.7% +16.9% ➖ noise
4 datafusion:arrow -13.3% +4.7% -17.2% +16.2% ✅ faster
4 datafusion:vortex-compact -1.2% +4.7% -5.6% +16.2% ➖ noise
4 datafusion:vortex-file-compressed -5.2% +4.7% -9.4% +16.2% ➖ noise
4 duckdb:duckdb -2.2% +4.7% -6.6% +16.2% ➖ noise
4 duckdb:vortex-compact -11.6% +4.7% -15.6% +16.2% ✅ faster
4 duckdb:vortex-file-compressed -11.2% +4.7% -15.2% +16.2% ✅ faster
5 datafusion:arrow -15.2% -3.6% -12.1% +16.2% ➖ noise
5 datafusion:vortex-compact -9.3% -3.6% -6.0% +16.2% ➖ noise
5 datafusion:vortex-file-compressed -8.3% -3.6% -4.9% +16.2% ➖ noise
5 duckdb:duckdb -1.9% -3.6% +1.7% +16.2% ➖ noise
5 duckdb:vortex-compact +11.2% -3.6% +15.3% +16.2% ➖ noise
5 duckdb:vortex-file-compressed +13.5% -3.6% +17.7% +16.2% 🚨 regression
6 datafusion:arrow -17.2% -4.7% -13.1% +17.4% ➖ noise
6 datafusion:vortex-compact -9.3% -4.7% -4.9% +18.0% ➖ noise
6 datafusion:vortex-file-compressed -4.2% -4.7% +0.5% +20.1% ➖ noise
6 duckdb:duckdb +0.3% -4.7% +5.2% +23.1% ➖ noise
6 duckdb:vortex-compact -38.0% -4.7% -34.9% +20.8% ✅ faster
6 duckdb:vortex-file-compressed -27.7% -4.7% -24.1% +19.2% ✅ faster
7 datafusion:arrow -8.2% -0.1% -8.0% +16.8% ➖ noise
7 datafusion:vortex-compact -9.5% -0.1% -9.3% +16.2% ➖ noise
7 datafusion:vortex-file-compressed -7.7% -0.1% -7.6% +16.2% ➖ noise
7 duckdb:duckdb -7.6% -0.1% -7.5% +16.2% ➖ noise
7 duckdb:vortex-compact -4.8% -0.1% -4.6% +16.2% ➖ noise
7 duckdb:vortex-file-compressed -17.8% -0.1% -17.6% +16.2% ✅ faster
8 datafusion:arrow -5.6% -10.6% +5.5% +16.2% ➖ noise
8 datafusion:vortex-compact -3.0% -10.6% +8.5% +16.2% ➖ noise
8 datafusion:vortex-file-compressed -4.8% -10.6% +6.5% +16.2% ➖ noise
8 duckdb:duckdb -1.9% -10.6% +9.7% +16.2% ➖ noise
8 duckdb:vortex-compact +10.0% -10.6% +23.1% +16.2% 🚨 regression
8 duckdb:vortex-file-compressed +4.9% -10.6% +17.4% +16.2% 🚨 regression
9 datafusion:arrow -10.2% -3.3% -7.2% +16.2% ➖ noise
9 datafusion:vortex-compact -6.0% -3.3% -2.8% +16.2% ➖ noise
9 datafusion:vortex-file-compressed -7.1% -3.3% -4.0% +16.2% ➖ noise
9 duckdb:duckdb -11.7% -3.3% -8.7% +16.2% ➖ noise
9 duckdb:vortex-compact -20.8% -3.3% -18.1% +16.2% ✅ faster
9 duckdb:vortex-file-compressed -25.4% -3.3% -22.9% +16.2% ✅ faster
10 datafusion:arrow -8.5% +0.2% -8.7% +16.2% ➖ noise
10 datafusion:vortex-compact -11.1% +0.2% -11.2% +16.2% ➖ noise
10 datafusion:vortex-file-compressed -6.5% +0.2% -6.7% +16.2% ➖ noise
10 duckdb:duckdb -4.2% +0.2% -4.4% +16.9% ➖ noise
10 duckdb:vortex-compact +11.9% +0.2% +11.7% +16.2% ➖ noise
10 duckdb:vortex-file-compressed +7.9% +0.2% +7.7% +16.2% ➖ noise
11 datafusion:arrow -2.7% -6.5% +4.0% +16.3% ➖ noise
11 datafusion:vortex-compact -4.2% -6.5% +2.4% +16.2% ➖ noise
11 datafusion:vortex-file-compressed -1.6% -6.5% +5.2% +16.2% ➖ noise
11 duckdb:duckdb -2.4% -6.5% +4.4% +16.2% ➖ noise
11 duckdb:vortex-compact -2.1% -6.5% +4.7% +16.2% ➖ noise
11 duckdb:vortex-file-compressed -0.7% -6.5% +6.2% +16.2% ➖ noise
12 datafusion:arrow -0.5% +2.9% -3.3% +16.2% ➖ noise
12 datafusion:vortex-compact -3.8% +2.9% -6.5% +17.0% ➖ noise
12 datafusion:vortex-file-compressed +1.0% +2.9% -1.9% +16.2% ➖ noise
12 duckdb:duckdb -4.3% +2.9% -7.0% +16.2% ➖ noise
12 duckdb:vortex-compact +6.5% +2.9% +3.5% +16.2% ➖ noise
12 duckdb:vortex-file-compressed +38.7% +2.9% +34.8% +16.2% 🚨 regression
13 datafusion:arrow -2.1% -7.9% +6.3% +16.2% ➖ noise
13 datafusion:vortex-compact -3.8% -7.9% +4.4% +16.2% ➖ noise
13 datafusion:vortex-file-compressed -2.7% -7.9% +5.6% +16.2% ➖ noise
13 duckdb:duckdb -2.2% -7.9% +6.1% +16.9% ➖ noise
13 duckdb:vortex-compact -4.7% -7.9% +3.4% +16.2% ➖ noise
13 duckdb:vortex-file-compressed -4.4% -7.9% +3.7% +16.2% ➖ noise
14 datafusion:arrow -8.8% -3.1% -5.8% +16.2% ➖ noise
14 datafusion:vortex-compact -3.6% -3.1% -0.5% +16.2% ➖ noise
14 datafusion:vortex-file-compressed -6.7% -3.1% -3.7% +16.2% ➖ noise
14 duckdb:duckdb -2.5% -3.1% +0.7% +16.3% ➖ noise
14 duckdb:vortex-compact -16.8% -3.1% -14.1% +16.2% ✅ faster
14 duckdb:vortex-file-compressed -14.2% -3.1% -11.4% +16.2% ➖ noise
15 datafusion:arrow -12.4% -8.8% -3.9% +16.2% ➖ noise
15 datafusion:vortex-compact -5.0% -8.8% +4.2% +16.2% ➖ noise
15 datafusion:vortex-file-compressed -6.8% -8.8% +2.2% +16.2% ➖ noise
15 duckdb:duckdb +0.4% -8.8% +10.1% +16.2% ➖ noise
15 duckdb:vortex-compact -5.2% -8.8% +4.0% +16.2% ➖ noise
15 duckdb:vortex-file-compressed -7.3% -8.8% +1.6% +16.2% ➖ noise
16 datafusion:arrow +4.2% -5.9% +10.7% +16.2% ➖ noise
16 datafusion:vortex-compact +0.6% -5.9% +6.8% +16.2% ➖ noise
16 datafusion:vortex-file-compressed -2.7% -5.9% +3.4% +16.2% ➖ noise
16 duckdb:duckdb -8.5% -5.9% -2.9% +16.2% ➖ noise
16 duckdb:vortex-compact -19.6% -5.9% -14.6% +16.2% ✅ faster
16 duckdb:vortex-file-compressed -12.6% -5.9% -7.2% +16.2% ➖ noise
17 datafusion:arrow -12.9% -4.9% -8.4% +16.2% ➖ noise
17 datafusion:vortex-compact -10.7% -4.9% -6.1% +16.2% ➖ noise
17 datafusion:vortex-file-compressed -14.9% -4.9% -10.4% +16.2% ➖ noise
17 duckdb:duckdb -3.3% -4.9% +1.7% +16.2% ➖ noise
17 duckdb:vortex-compact +120.3% -4.9% +131.8% +16.2% 🚨 regression
17 duckdb:vortex-file-compressed +151.3% -4.9% +164.4% +16.2% 🚨 regression
18 datafusion:arrow -12.6% -3.8% -9.1% +16.2% ➖ noise
18 datafusion:vortex-compact -7.0% -3.8% -3.3% +16.2% ➖ noise
18 datafusion:vortex-file-compressed -8.7% -3.8% -5.1% +16.2% ➖ noise
18 duckdb:duckdb -0.3% -3.8% +3.7% +16.2% ➖ noise
18 duckdb:vortex-compact -2.9% -3.8% +1.0% +16.2% ➖ noise
18 duckdb:vortex-file-compressed -1.0% -3.8% +2.9% +16.2% ➖ noise
19 datafusion:arrow -4.6% +1.1% -5.7% +17.7% ➖ noise
19 datafusion:vortex-compact -3.0% +1.1% -4.1% +16.6% ➖ noise
19 datafusion:vortex-file-compressed -1.4% +1.1% -2.5% +18.7% ➖ noise
19 duckdb:duckdb -5.8% +1.1% -6.8% +17.8% ➖ noise
19 duckdb:vortex-compact -24.4% +1.1% -25.3% +16.2% ✅ faster
19 duckdb:vortex-file-compressed -29.5% +1.1% -30.3% +16.4% ✅ faster
20 datafusion:arrow -10.0% -14.1% +4.7% +16.2% ➖ noise
20 datafusion:vortex-compact -3.6% -14.1% +12.2% +16.2% ➖ noise
20 datafusion:vortex-file-compressed -5.7% -14.1% +9.7% +16.2% ➖ noise
20 duckdb:duckdb +0.3% -14.1% +16.7% +16.2% 🚨 regression
20 duckdb:vortex-compact -5.5% -14.1% +10.0% +16.2% ➖ noise
20 duckdb:vortex-file-compressed -7.1% -14.1% +8.1% +16.4% ➖ noise
21 datafusion:arrow -8.0% -1.0% -7.1% +16.2% ➖ noise
21 datafusion:vortex-compact -6.6% -1.0% -5.7% +16.2% ➖ noise
21 datafusion:vortex-file-compressed -4.7% -1.0% -3.7% +16.2% ➖ noise
21 duckdb:duckdb -5.1% -1.0% -4.2% +16.2% ➖ noise
21 duckdb:vortex-compact -0.2% -1.0% +0.8% +16.2% ➖ noise
21 duckdb:vortex-file-compressed -1.1% -1.0% -0.1% +16.2% ➖ noise
22 datafusion:arrow -5.5% -2.8% -2.7% +16.2% ➖ noise
22 datafusion:vortex-compact -5.2% -2.8% -2.4% +16.2% ➖ noise
22 datafusion:vortex-file-compressed +0.8% -2.8% +3.7% +16.2% ➖ noise
22 duckdb:duckdb -1.7% -2.8% +1.1% +16.2% ➖ noise
22 duckdb:vortex-compact -15.5% -2.8% -13.1% +16.2% ➖ noise
22 duckdb:vortex-file-compressed -14.0% -2.8% -11.5% +16.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -5.8%
Vortex (geomean): 1.008x ➖
Parquet (geomean): 1.071x ➖
Shifts: Parquet (control) +7.1% · Median polish +5.0%


datafusion / vortex-file-compressed (1.081x ➖, 1↑ 5↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 6443901 5981328 1.08
fineweb_q01/datafusion:vortex-file-compressed 🚨 35252691 27959954 1.26
fineweb_q02/datafusion:vortex-file-compressed 🚨 37575603 34061251 1.10
fineweb_q03/datafusion:vortex-file-compressed 🚀 86125137 98540671 0.87
fineweb_q04/datafusion:vortex-file-compressed 275996386 266999701 1.03
fineweb_q05/datafusion:vortex-file-compressed 🚨 254674191 231407661 1.10
fineweb_q06/datafusion:vortex-file-compressed 82093164 75383570 1.09
fineweb_q07/datafusion:vortex-file-compressed 🚨 82271310 74545155 1.10
fineweb_q08/datafusion:vortex-file-compressed 🚨 31475575 27978551 1.12
datafusion / vortex-compact (1.092x ➖, 0↑ 2↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5424098 5496826 0.99
fineweb_q01/datafusion:vortex-compact 181226350 168619451 1.07
fineweb_q02/datafusion:vortex-compact 183787991 167890902 1.09
fineweb_q03/datafusion:vortex-compact 1606076193 1502840435 1.07
fineweb_q04/datafusion:vortex-compact 🚨 1793837992 1592475192 1.13
fineweb_q05/datafusion:vortex-compact 1383968650 1281955648 1.08
fineweb_q06/datafusion:vortex-compact 785934707 728967895 1.08
fineweb_q07/datafusion:vortex-compact 821558384 764329233 1.07
fineweb_q08/datafusion:vortex-compact 🚨 27162622 21593812 1.26
datafusion / parquet (1.121x ❌, 0↑ 7↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 7336925 6662999 1.10
fineweb_q01/datafusion:parquet 🚨 307308799 277462769 1.11
fineweb_q02/datafusion:parquet 🚨 315115227 275328493 1.14
fineweb_q03/datafusion:parquet 🚨 313467741 267015782 1.17
fineweb_q04/datafusion:parquet 🚨 328628527 287564731 1.14
fineweb_q05/datafusion:parquet 🚨 324779646 286307052 1.13
fineweb_q06/datafusion:parquet 312341977 284002917 1.10
fineweb_q07/datafusion:parquet 🚨 307562184 274640737 1.12
fineweb_q08/datafusion:parquet 300324205 280218792 1.07
duckdb / vortex-file-compressed (0.933x ➖, 4↑ 1↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3830658 4101664 0.93
fineweb_q01/duckdb:vortex-file-compressed 🚀 30711875 35062120 0.88
fineweb_q02/duckdb:vortex-file-compressed 31078831 28864629 1.08
fineweb_q03/duckdb:vortex-file-compressed 🚨 177120430 154665608 1.15
fineweb_q04/duckdb:vortex-file-compressed 227750839 240502900 0.95
fineweb_q05/duckdb:vortex-file-compressed 209296903 226110306 0.93
fineweb_q06/duckdb:vortex-file-compressed 🚀 63872489 79854739 0.80
fineweb_q07/duckdb:vortex-file-compressed 🚀 64352995 76057530 0.85
fineweb_q08/duckdb:vortex-file-compressed 🚀 25078233 27981111 0.90
duckdb / vortex-compact (0.938x ➖, 2↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 3875879 4367684 0.89
fineweb_q01/duckdb:vortex-compact 🚀 93991141 108057856 0.87
fineweb_q02/duckdb:vortex-compact 105842157 117429323 0.90
fineweb_q03/duckdb:vortex-compact 855908906 920007692 0.93
fineweb_q04/duckdb:vortex-compact 898084949 942647795 0.95
fineweb_q05/duckdb:vortex-compact 844788489 839604746 1.01
fineweb_q06/duckdb:vortex-compact 480428832 492521173 0.98
fineweb_q07/duckdb:vortex-compact 486625861 503278163 0.97
fineweb_q08/duckdb:vortex-compact 22760808 23751707 0.96
duckdb / parquet (1.022x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 39627251 38427392 1.03
fineweb_q01/duckdb:parquet 101209186 97485554 1.04
fineweb_q02/duckdb:parquet 104612016 101934664 1.03
fineweb_q03/duckdb:parquet 328519362 320643625 1.02
fineweb_q04/duckdb:parquet 461444422 460962470 1.00
fineweb_q05/duckdb:parquet 432876833 419209161 1.03
fineweb_q06/duckdb:parquet 210859460 203441744 1.04
fineweb_q07/duckdb:parquet 221443286 219318120 1.01
fineweb_q08/duckdb:parquet 63892848 63975989 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -1.3% +6.6% -7.4% +37.7% ➖ noise
0 datafusion:vortex-file-compressed +7.7% +6.6% +1.1% +62.7% ➖ noise
0 duckdb:vortex-compact -11.3% +6.6% -16.7% +36.4% ➖ noise
0 duckdb:vortex-file-compressed -6.6% +6.6% -12.4% +48.5% ➖ noise
1 datafusion:vortex-compact +7.5% +7.2% +0.2% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +26.1% +7.2% +17.6% +16.0% 🚨 regression
1 duckdb:vortex-compact -13.0% +7.2% -18.9% +20.9% ✅ faster
1 duckdb:vortex-file-compressed -12.4% +7.2% -18.3% +38.2% ➖ noise
2 datafusion:vortex-compact +9.5% +8.4% +1.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +10.3% +8.4% +1.8% +16.3% ➖ noise
2 duckdb:vortex-compact -9.9% +8.4% -16.8% +11.5% ✅ faster
2 duckdb:vortex-file-compressed +7.7% +8.4% -0.7% +13.5% ➖ noise
3 datafusion:vortex-compact +6.9% +9.7% -2.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -12.6% +9.7% -20.3% +34.5% ➖ noise
3 duckdb:vortex-compact -7.0% +9.7% -15.2% +10.0% ✅ faster
3 duckdb:vortex-file-compressed +14.5% +9.7% +4.4% +23.0% ➖ noise
4 datafusion:vortex-compact +12.6% +7.0% +5.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +3.4% +7.0% -3.4% +11.5% ➖ noise
4 duckdb:vortex-compact -4.7% +7.0% -10.9% +10.0% ✅ faster
4 duckdb:vortex-file-compressed -5.3% +7.0% -11.5% +10.0% ✅ faster
5 datafusion:vortex-compact +8.0% +8.2% -0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +10.1% +8.2% +1.7% +13.9% ➖ noise
5 duckdb:vortex-compact +0.6% +8.2% -7.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -7.4% +8.2% -14.5% +10.0% ✅ faster
6 datafusion:vortex-compact +7.8% +6.8% +1.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +8.9% +6.8% +2.0% +26.3% ➖ noise
6 duckdb:vortex-compact -2.5% +6.8% -8.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -20.0% +6.8% -25.1% +16.6% ✅ faster
7 datafusion:vortex-compact +7.5% +6.3% +1.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +10.4% +6.3% +3.8% +13.9% ➖ noise
7 duckdb:vortex-compact -3.3% +6.3% -9.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -15.4% +6.3% -20.4% +10.0% ✅ faster
8 datafusion:vortex-compact +25.8% +3.5% +21.6% +22.5% ➖ noise
8 datafusion:vortex-file-compressed +12.5% +3.5% +8.7% +26.7% ➖ noise
8 duckdb:vortex-compact -4.2% +3.5% -7.4% +14.8% ➖ noise
8 duckdb:vortex-file-compressed -10.4% +3.5% -13.4% +21.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@joseph-isaacs joseph-isaacs added the do not merge Pull requests that are not intended to merge label Apr 7, 2026
@joseph-isaacs joseph-isaacs marked this pull request as draft April 7, 2026 14:08
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +6.3%
Vortex (geomean): 1.073x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.1%


datafusion / vortex-file-compressed (0.932x ➖, 1↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 406689874 411084551 0.99
tpch_q02/datafusion:vortex-file-compressed 112450440 122736825 0.92
tpch_q03/datafusion:vortex-file-compressed 205388017 222602460 0.92
tpch_q04/datafusion:vortex-file-compressed 98847842 107699856 0.92
tpch_q05/datafusion:vortex-file-compressed 377142315 413878529 0.91
tpch_q06/datafusion:vortex-file-compressed 40055750 42932530 0.93
tpch_q07/datafusion:vortex-file-compressed 559558046 605621064 0.92
tpch_q08/datafusion:vortex-file-compressed 375416490 401229103 0.94
tpch_q09/datafusion:vortex-file-compressed 664201499 714409720 0.93
tpch_q10/datafusion:vortex-file-compressed 237521901 250120806 0.95
tpch_q11/datafusion:vortex-file-compressed 🚀 83065899 93946229 0.88
tpch_q12/datafusion:vortex-file-compressed 105356511 115013625 0.92
tpch_q13/datafusion:vortex-file-compressed 222867208 233408516 0.95
tpch_q14/datafusion:vortex-file-compressed 57076540 59429916 0.96
tpch_q15/datafusion:vortex-file-compressed 106766995 113350168 0.94
tpch_q16/datafusion:vortex-file-compressed 76446352 81431951 0.94
tpch_q17/datafusion:vortex-file-compressed 648955773 703873407 0.92
tpch_q18/datafusion:vortex-file-compressed 876008741 954828813 0.92
tpch_q19/datafusion:vortex-file-compressed 97775407 101774300 0.96
tpch_q20/datafusion:vortex-file-compressed 169051201 179137119 0.94
tpch_q21/datafusion:vortex-file-compressed 654499362 709495388 0.92
tpch_q22/datafusion:vortex-file-compressed 61025241 65930977 0.93
datafusion / vortex-compact (1.060x ➖, 0↑ 13↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 436529050 471251144 0.93
tpch_q02/datafusion:vortex-compact 142034656 130089544 1.09
tpch_q03/datafusion:vortex-compact 224955233 231542209 0.97
tpch_q04/datafusion:vortex-compact 🚨 140583431 127386050 1.10
tpch_q05/datafusion:vortex-compact 🚨 486079329 430927859 1.13
tpch_q06/datafusion:vortex-compact 🚨 74003332 67144454 1.10
tpch_q07/datafusion:vortex-compact 🚨 729679031 627670402 1.16
tpch_q08/datafusion:vortex-compact 🚨 482169452 410135893 1.18
tpch_q09/datafusion:vortex-compact 🚨 855253616 727282399 1.18
tpch_q10/datafusion:vortex-compact 🚨 332036991 286293061 1.16
tpch_q11/datafusion:vortex-compact 🚨 111913297 98423630 1.14
tpch_q12/datafusion:vortex-compact 🚨 202732783 179248974 1.13
tpch_q13/datafusion:vortex-compact 🚨 319574934 289876088 1.10
tpch_q14/datafusion:vortex-compact 🚨 86911092 78415998 1.11
tpch_q15/datafusion:vortex-compact 🚨 199059948 176732008 1.13
tpch_q16/datafusion:vortex-compact 🚨 97422700 87286895 1.12
tpch_q17/datafusion:vortex-compact 701017274 714464226 0.98
tpch_q18/datafusion:vortex-compact 902935761 976311604 0.92
tpch_q19/datafusion:vortex-compact 139354769 146588024 0.95
tpch_q20/datafusion:vortex-compact 199954132 211041153 0.95
tpch_q21/datafusion:vortex-compact 706509983 749673093 0.94
tpch_q22/datafusion:vortex-compact 73079381 77294351 0.95
datafusion / parquet (1.014x ➖, 0↑ 2↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 478052622 441572907 1.08
tpch_q02/datafusion:parquet 188817475 198344304 0.95
tpch_q03/datafusion:parquet 298457447 318309774 0.94
tpch_q04/datafusion:parquet 133619314 139410119 0.96
tpch_q05/datafusion:parquet 458365622 483196543 0.95
tpch_q06/datafusion:parquet 131218018 132387556 0.99
tpch_q07/datafusion:parquet 639514063 671984889 0.95
tpch_q08/datafusion:parquet 572078772 520482234 1.10
tpch_q09/datafusion:parquet 🚨 914289717 824444578 1.11
tpch_q10/datafusion:parquet 582975496 532465996 1.09
tpch_q11/datafusion:parquet 154504708 141030532 1.10
tpch_q12/datafusion:parquet 229593012 229339017 1.00
tpch_q13/datafusion:parquet 381073366 351861716 1.08
tpch_q14/datafusion:parquet 173763773 172787947 1.01
tpch_q15/datafusion:parquet 287189366 265175056 1.08
tpch_q16/datafusion:parquet 152835065 144901835 1.05
tpch_q17/datafusion:parquet 🚨 839161673 733141601 1.14
tpch_q18/datafusion:parquet 915108681 942551092 0.97
tpch_q19/datafusion:parquet 268555932 287544103 0.93
tpch_q20/datafusion:parquet 308770412 322576986 0.96
tpch_q21/datafusion:parquet 735539325 793306935 0.93
tpch_q22/datafusion:parquet 219318253 222796450 0.98
datafusion / arrow (1.007x ➖, 1↑ 8↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 724665919 648040505 1.12
tpch_q02/datafusion:arrow 🚨 194734871 176387153 1.10
tpch_q03/datafusion:arrow 🚨 602143777 505688412 1.19
tpch_q04/datafusion:arrow 🚨 449265197 381002854 1.18
tpch_q05/datafusion:arrow 🚨 1132440294 1001606959 1.13
tpch_q06/datafusion:arrow 🚨 345564209 299926922 1.15
tpch_q07/datafusion:arrow 🚨 1430188458 1256448485 1.14
tpch_q08/datafusion:arrow 1116907523 1233698521 0.91
tpch_q09/datafusion:arrow 1309469270 1434296773 0.91
tpch_q10/datafusion:arrow 590285617 649640592 0.91
tpch_q11/datafusion:arrow 156369670 158485071 0.99
tpch_q12/datafusion:arrow 🚨 809645449 727859805 1.11
tpch_q13/datafusion:arrow 528847896 539025886 0.98
tpch_q14/datafusion:arrow 319269703 337603459 0.95
tpch_q15/datafusion:arrow 693955466 766850635 0.90
tpch_q16/datafusion:arrow 107169145 113240567 0.95
tpch_q17/datafusion:arrow 1337173620 1415676042 0.94
tpch_q18/datafusion:arrow 1828349254 1961175290 0.93
tpch_q19/datafusion:arrow 543011307 551461391 0.98
tpch_q20/datafusion:arrow 525952739 554085553 0.95
tpch_q21/datafusion:arrow 2886649608 2959871223 0.98
tpch_q22/datafusion:arrow 🚀 137929234 160173073 0.86
duckdb / vortex-file-compressed (1.243x ❌, 1↑ 11↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 178458324 180867571 0.99
tpch_q02/duckdb:vortex-file-compressed 54905188 54844526 1.00
tpch_q03/duckdb:vortex-file-compressed 134606060 133488485 1.01
tpch_q04/duckdb:vortex-file-compressed 162705933 155160717 1.05
tpch_q05/duckdb:vortex-file-compressed 🚨 165654939 137007559 1.21
tpch_q06/duckdb:vortex-file-compressed 🚀 38273567 49551457 0.77
tpch_q07/duckdb:vortex-file-compressed 153576798 157270705 0.98
tpch_q08/duckdb:vortex-file-compressed 🚨 230799026 185832619 1.24
tpch_q09/duckdb:vortex-file-compressed 🚨 478360835 344734595 1.39
tpch_q10/duckdb:vortex-file-compressed 🚨 244219323 163677735 1.49
tpch_q11/duckdb:vortex-file-compressed 🚨 47664230 38510996 1.24
tpch_q12/duckdb:vortex-file-compressed 🚨 217846514 94215157 2.31
tpch_q13/duckdb:vortex-file-compressed 286075690 262545140 1.09
tpch_q14/duckdb:vortex-file-compressed 72290856 75581259 0.96
tpch_q15/duckdb:vortex-file-compressed 🚨 120672870 104114079 1.16
tpch_q16/duckdb:vortex-file-compressed 86666563 85160568 1.02
tpch_q17/duckdb:vortex-file-compressed 🚨 605398190 108307384 5.59
tpch_q18/duckdb:vortex-file-compressed 🚨 330949791 289133561 1.14
tpch_q19/duckdb:vortex-file-compressed 93963377 95029931 0.99
tpch_q20/duckdb:vortex-file-compressed 🚨 207161422 174196449 1.19
tpch_q21/duckdb:vortex-file-compressed 🚨 1170660874 600230132 1.95
tpch_q22/duckdb:vortex-file-compressed 76299068 80659713 0.95
duckdb / vortex-compact (1.078x ➖, 4↑ 7↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 233020107 234075714 1.00
tpch_q02/duckdb:vortex-compact 58221695 62104206 0.94
tpch_q03/duckdb:vortex-compact 161973906 149746815 1.08
tpch_q04/duckdb:vortex-compact 188496690 188883307 1.00
tpch_q05/duckdb:vortex-compact 🚨 191038776 156160873 1.22
tpch_q06/duckdb:vortex-compact 🚀 56301386 88301862 0.64
tpch_q07/duckdb:vortex-compact 210425161 215376022 0.98
tpch_q08/duckdb:vortex-compact 🚨 268432310 198908069 1.35
tpch_q09/duckdb:vortex-compact 🚨 464477380 378327947 1.23
tpch_q10/duckdb:vortex-compact 🚨 253257873 199579652 1.27
tpch_q11/duckdb:vortex-compact 42277528 44019211 0.96
tpch_q12/duckdb:vortex-compact 🚨 260022915 214386833 1.21
tpch_q13/duckdb:vortex-compact 298031761 311859207 0.96
tpch_q14/duckdb:vortex-compact 🚀 81410254 107440069 0.76
tpch_q15/duckdb:vortex-compact 120056118 124965963 0.96
tpch_q16/duckdb:vortex-compact 82081066 89884580 0.91
tpch_q17/duckdb:vortex-compact 🚨 524977853 125694755 4.18
tpch_q18/duckdb:vortex-compact 297132814 301393693 0.99
tpch_q19/duckdb:vortex-compact 🚀 98951109 119194733 0.83
tpch_q20/duckdb:vortex-compact 212570265 215250660 0.99
tpch_q21/duckdb:vortex-compact 🚨 1060723244 668805939 1.59
tpch_q22/duckdb:vortex-compact 🚀 76844419 93389800 0.82
duckdb / parquet (0.986x ➖, 1↑ 1↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 260108827 256967461 1.01
tpch_q02/duckdb:parquet 95982798 100589979 0.95
tpch_q03/duckdb:parquet 209280765 219295495 0.95
tpch_q04/duckdb:parquet 136389473 134585283 1.01
tpch_q05/duckdb:parquet 217979703 226893040 0.96
tpch_q06/duckdb:parquet 67474272 67248832 1.00
tpch_q07/duckdb:parquet 184407361 188829335 0.98
tpch_q08/duckdb:parquet 259963987 265117847 0.98
tpch_q09/duckdb:parquet 473190203 476331007 0.99
tpch_q10/duckdb:parquet 599253177 616060038 0.97
tpch_q11/duckdb:parquet 🚨 46879640 41084235 1.14
tpch_q12/duckdb:parquet 124486123 127156494 0.98
tpch_q13/duckdb:parquet 🚀 398708683 459562254 0.87
tpch_q14/duckdb:parquet 178266854 173981361 1.02
tpch_q15/duckdb:parquet 97419273 98801508 0.99
tpch_q16/duckdb:parquet 165049983 164004106 1.01
tpch_q17/duckdb:parquet 179963528 180357613 1.00
tpch_q18/duckdb:parquet 351804809 364704770 0.96
tpch_q19/duckdb:parquet 280523962 281374761 1.00
tpch_q20/duckdb:parquet 230692577 233361712 0.99
tpch_q21/duckdb:parquet 570105770 594181042 0.96
tpch_q22/duckdb:parquet 290054978 294959959 0.98
duckdb / duckdb (1.083x ➖, 0↑ 5↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 124248613 118333818 1.05
tpch_q02/duckdb:duckdb 🚨 52343464 46539269 1.12
tpch_q03/duckdb:duckdb 🚨 110017674 99939933 1.10
tpch_q04/duckdb:duckdb 149694891 137444026 1.09
tpch_q05/duckdb:duckdb 123570265 112357327 1.10
tpch_q06/duckdb:duckdb 41393683 39395723 1.05
tpch_q07/duckdb:duckdb 94935403 88011975 1.08
tpch_q08/duckdb:duckdb 122627491 112974475 1.09
tpch_q09/duckdb:duckdb 🚨 316510329 282449241 1.12
tpch_q10/duckdb:duckdb 225361894 212605097 1.06
tpch_q11/duckdb:duckdb 🚨 18224909 15832337 1.15
tpch_q12/duckdb:duckdb 92484813 85766561 1.08
tpch_q13/duckdb:duckdb 283926160 258577725 1.10
tpch_q14/duckdb:duckdb 🚨 81224046 71662509 1.13
tpch_q15/duckdb:duckdb 86638125 79453604 1.09
tpch_q16/duckdb:duckdb 81700766 76407105 1.07
tpch_q17/duckdb:duckdb 92379544 85803450 1.08
tpch_q18/duckdb:duckdb 239966491 220364055 1.09
tpch_q19/duckdb:duckdb 126938079 118138405 1.07
tpch_q20/duckdb:duckdb 119289048 113655572 1.05
tpch_q21/duckdb:duckdb 320372519 317778810 1.01
tpch_q22/duckdb:duckdb 68919499 65505360 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +11.8% +4.7% +6.8% +12.5% ➖ noise
1 datafusion:vortex-compact -7.4% +4.7% -11.5% +13.8% ➖ noise
1 datafusion:vortex-file-compressed -1.1% +4.7% -5.5% +13.8% ➖ noise
1 duckdb:duckdb +5.0% +4.7% +0.3% +12.4% ➖ noise
1 duckdb:vortex-compact -0.5% +4.7% -4.9% +12.5% ➖ noise
1 duckdb:vortex-file-compressed -1.3% +4.7% -5.7% +12.7% ➖ noise
2 datafusion:arrow +10.4% -4.7% +15.8% +12.3% 🚨 regression
2 datafusion:vortex-compact +9.2% -4.7% +14.6% +18.6% ➖ noise
2 datafusion:vortex-file-compressed -8.4% -4.7% -3.9% +12.3% ➖ noise
2 duckdb:duckdb +12.5% -4.7% +18.0% +12.6% 🚨 regression
2 duckdb:vortex-compact -6.3% -4.7% -1.6% +12.3% ➖ noise
2 duckdb:vortex-file-compressed +0.1% -4.7% +5.0% +12.3% ➖ noise
3 datafusion:arrow +19.1% -5.4% +25.9% +12.3% 🚨 regression
3 datafusion:vortex-compact -2.8% -5.4% +2.7% +12.3% ➖ noise
3 datafusion:vortex-file-compressed -7.7% -5.4% -2.5% +12.3% ➖ noise
3 duckdb:duckdb +10.1% -5.4% +16.4% +12.3% 🚨 regression
3 duckdb:vortex-compact +8.2% -5.4% +14.3% +12.3% 🚨 regression
3 duckdb:vortex-file-compressed +0.8% -5.4% +6.6% +12.3% ➖ noise
4 datafusion:arrow +17.9% -1.4% +19.6% +12.3% 🚨 regression
4 datafusion:vortex-compact +10.4% -1.4% +12.0% +12.3% ➖ noise
4 datafusion:vortex-file-compressed -8.2% -1.4% -6.9% +12.3% ➖ noise
4 duckdb:duckdb +8.9% -1.4% +10.5% +12.3% ➖ noise
4 duckdb:vortex-compact -0.2% -1.4% +1.3% +12.3% ➖ noise
4 duckdb:vortex-file-compressed +4.9% -1.4% +6.4% +12.3% ➖ noise
5 datafusion:arrow +13.1% -4.5% +18.4% +12.3% 🚨 regression
5 datafusion:vortex-compact +12.8% -4.5% +18.2% +12.3% 🚨 regression
5 datafusion:vortex-file-compressed -8.9% -4.5% -4.5% +12.3% ➖ noise
5 duckdb:duckdb +10.0% -4.5% +15.2% +12.3% 🚨 regression
5 duckdb:vortex-compact +22.3% -4.5% +28.1% +12.3% 🚨 regression
5 duckdb:vortex-file-compressed +20.9% -4.5% +26.7% +12.3% 🚨 regression
6 datafusion:arrow +15.2% -0.3% +15.5% +12.3% 🚨 regression
6 datafusion:vortex-compact +10.2% -0.3% +10.5% +12.3% ➖ noise
6 datafusion:vortex-file-compressed -6.7% -0.3% -6.4% +12.3% ➖ noise
6 duckdb:duckdb +5.1% -0.3% +5.4% +14.9% ➖ noise
6 duckdb:vortex-compact -36.2% -0.3% -36.1% +15.6% ✅ faster
6 duckdb:vortex-file-compressed -22.8% -0.3% -22.5% +12.3% ✅ faster
7 datafusion:arrow +13.8% -3.6% +18.1% +12.3% 🚨 regression
7 datafusion:vortex-compact +16.3% -3.6% +20.6% +12.3% 🚨 regression
7 datafusion:vortex-file-compressed -7.6% -3.6% -4.2% +12.3% ➖ noise
7 duckdb:duckdb +7.9% -3.6% +11.9% +12.3% ➖ noise
7 duckdb:vortex-compact -2.3% -3.6% +1.3% +12.3% ➖ noise
7 duckdb:vortex-file-compressed -2.3% -3.6% +1.3% +12.3% ➖ noise
8 datafusion:arrow -9.5% +3.8% -12.8% +12.3% ✅ faster
8 datafusion:vortex-compact +17.6% +3.8% +13.2% +12.3% 🚨 regression
8 datafusion:vortex-file-compressed -6.4% +3.8% -9.9% +12.3% ➖ noise
8 duckdb:duckdb +8.5% +3.8% +4.6% +12.3% ➖ noise
8 duckdb:vortex-compact +35.0% +3.8% +30.0% +12.3% 🚨 regression
8 duckdb:vortex-file-compressed +24.2% +3.8% +19.6% +12.3% 🚨 regression
9 datafusion:arrow -8.7% +5.0% -13.0% +12.3% ✅ faster
9 datafusion:vortex-compact +17.6% +5.0% +12.0% +12.3% ➖ noise
9 datafusion:vortex-file-compressed -7.0% +5.0% -11.4% +12.3% ✅ faster
9 duckdb:duckdb +12.1% +5.0% +6.8% +12.3% ➖ noise
9 duckdb:vortex-compact +22.8% +5.0% +17.0% +12.3% 🚨 regression
9 duckdb:vortex-file-compressed +38.8% +5.0% +32.2% +12.3% 🚨 regression
10 datafusion:arrow -9.1% +3.2% -12.0% +12.3% ✅ faster
10 datafusion:vortex-compact +16.0% +3.2% +12.4% +12.3% 🚨 regression
10 datafusion:vortex-file-compressed -5.0% +3.2% -8.0% +12.3% ➖ noise
10 duckdb:duckdb +6.0% +3.2% +2.7% +12.3% ➖ noise
10 duckdb:vortex-compact +26.9% +3.2% +23.0% +12.3% 🚨 regression
10 duckdb:vortex-file-compressed +49.2% +3.2% +44.6% +12.3% 🚨 regression
11 datafusion:arrow -1.3% +11.8% -11.8% +12.3% ✅ faster
11 datafusion:vortex-compact +13.7% +11.8% +1.7% +12.3% ➖ noise
11 datafusion:vortex-file-compressed -11.6% +11.8% -20.9% +12.3% ✅ faster
11 duckdb:duckdb +15.1% +11.8% +3.0% +20.4% ➖ noise
11 duckdb:vortex-compact -4.0% +11.8% -14.1% +15.0% ✅ faster
11 duckdb:vortex-file-compressed +23.8% +11.8% +10.7% +13.4% ➖ noise
12 datafusion:arrow +11.2% -1.0% +12.4% +39.6% ➖ noise
12 datafusion:vortex-compact +13.1% -1.0% +14.2% +12.3% 🚨 regression
12 datafusion:vortex-file-compressed -8.4% -1.0% -7.5% +12.3% ➖ noise
12 duckdb:duckdb +7.8% -1.0% +8.9% +12.3% ➖ noise
12 duckdb:vortex-compact +21.3% -1.0% +22.5% +12.3% 🚨 regression
12 duckdb:vortex-file-compressed +131.2% -1.0% +133.6% +12.3% 🚨 regression
13 datafusion:arrow -1.9% -3.1% +1.2% +12.3% ➖ noise
13 datafusion:vortex-compact +10.2% -3.1% +13.7% +12.3% 🚨 regression
13 datafusion:vortex-file-compressed -4.5% -3.1% -1.5% +12.3% ➖ noise
13 duckdb:duckdb +9.8% -3.1% +13.3% +12.3% 🚨 regression
13 duckdb:vortex-compact -4.4% -3.1% -1.4% +12.3% ➖ noise
13 duckdb:vortex-file-compressed +9.0% -3.1% +12.4% +12.3% 🚨 regression
14 datafusion:arrow -5.4% +1.5% -6.8% +12.3% ➖ noise
14 datafusion:vortex-compact +10.8% +1.5% +9.2% +12.3% ➖ noise
14 datafusion:vortex-file-compressed -4.0% +1.5% -5.4% +13.7% ➖ noise
14 duckdb:duckdb +13.3% +1.5% +11.7% +12.3% ➖ noise
14 duckdb:vortex-compact -24.2% +1.5% -25.4% +12.3% ✅ faster
14 duckdb:vortex-file-compressed -4.4% +1.5% -5.8% +12.3% ➖ noise
15 datafusion:arrow -9.5% +3.3% -12.4% +12.3% ✅ faster
15 datafusion:vortex-compact +12.6% +3.3% +9.0% +12.3% ➖ noise
15 datafusion:vortex-file-compressed -5.8% +3.3% -8.9% +12.3% ➖ noise
15 duckdb:duckdb +9.0% +3.3% +5.5% +12.3% ➖ noise
15 duckdb:vortex-compact -3.9% +3.3% -7.0% +12.3% ➖ noise
15 duckdb:vortex-file-compressed +15.9% +3.3% +12.2% +12.3% ➖ noise
16 datafusion:arrow -5.4% +3.0% -8.1% +12.3% ➖ noise
16 datafusion:vortex-compact +11.6% +3.0% +8.3% +12.3% ➖ noise
16 datafusion:vortex-file-compressed -6.1% +3.0% -8.9% +12.3% ➖ noise
16 duckdb:duckdb +6.9% +3.0% +3.8% +12.3% ➖ noise
16 duckdb:vortex-compact -8.7% +3.0% -11.4% +12.3% ✅ faster
16 duckdb:vortex-file-compressed +1.8% +3.0% -1.2% +12.3% ➖ noise
17 datafusion:arrow -5.5% +6.9% -11.6% +12.3% ✅ faster
17 datafusion:vortex-compact -1.9% +6.9% -8.2% +12.3% ➖ noise
17 datafusion:vortex-file-compressed -7.8% +6.9% -13.7% +12.3% ✅ faster
17 duckdb:duckdb +7.7% +6.9% +0.7% +12.3% ➖ noise
17 duckdb:vortex-compact +317.7% +6.9% +290.8% +12.3% 🚨 regression
17 duckdb:vortex-file-compressed +459.0% +6.9% +423.0% +12.3% 🚨 regression
18 datafusion:arrow -6.8% -3.2% -3.7% +12.3% ➖ noise
18 datafusion:vortex-compact -7.5% -3.2% -4.4% +12.3% ➖ noise
18 datafusion:vortex-file-compressed -8.3% -3.2% -5.2% +12.3% ➖ noise
18 duckdb:duckdb +8.9% -3.2% +12.5% +12.3% 🚨 regression
18 duckdb:vortex-compact -1.4% -3.2% +1.9% +12.3% ➖ noise
18 duckdb:vortex-file-compressed +14.5% -3.2% +18.3% +12.3% 🚨 regression
19 datafusion:arrow -1.5% -3.5% +2.0% +12.3% ➖ noise
19 datafusion:vortex-compact -4.9% -3.5% -1.5% +12.3% ➖ noise
19 datafusion:vortex-file-compressed -3.9% -3.5% -0.4% +12.3% ➖ noise
19 duckdb:duckdb +7.4% -3.5% +11.4% +12.3% ➖ noise
19 duckdb:vortex-compact -17.0% -3.5% -14.0% +12.3% ✅ faster
19 duckdb:vortex-file-compressed -1.1% -3.5% +2.5% +12.3% ➖ noise
20 datafusion:arrow -5.1% -2.7% -2.4% +12.3% ➖ noise
20 datafusion:vortex-compact -5.3% -2.7% -2.6% +12.3% ➖ noise
20 datafusion:vortex-file-compressed -5.6% -2.7% -3.0% +12.3% ➖ noise
20 duckdb:duckdb +5.0% -2.7% +7.9% +12.3% ➖ noise
20 duckdb:vortex-compact -1.2% -2.7% +1.5% +12.3% ➖ noise
20 duckdb:vortex-file-compressed +18.9% -2.7% +22.3% +12.3% 🚨 regression
21 datafusion:arrow -2.5% -5.7% +3.4% +12.3% ➖ noise
21 datafusion:vortex-compact -5.8% -5.7% -0.1% +12.3% ➖ noise
21 datafusion:vortex-file-compressed -7.8% -5.7% -2.2% +12.3% ➖ noise
21 duckdb:duckdb +0.8% -5.7% +6.9% +12.3% ➖ noise
21 duckdb:vortex-compact +58.6% -5.7% +68.2% +12.3% 🚨 regression
21 duckdb:vortex-file-compressed +95.0% -5.7% +106.8% +12.3% 🚨 regression
22 datafusion:arrow -13.9% -1.6% -12.5% +12.3% ✅ faster
22 datafusion:vortex-compact -5.5% -1.6% -3.9% +12.3% ➖ noise
22 datafusion:vortex-file-compressed -7.4% -1.6% -5.9% +12.3% ➖ noise
22 duckdb:duckdb +5.2% -1.6% +6.9% +12.3% ➖ noise
22 duckdb:vortex-compact -17.7% -1.6% -16.4% +12.3% ✅ faster
22 duckdb:vortex-file-compressed -5.4% -1.6% -3.9% +12.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.2%
Vortex (geomean): 0.986x ➖
Parquet (geomean): 1.019x ➖
Shifts: Parquet (control) +1.9% · Median polish -1.0%


datafusion / vortex-file-compressed (1.030x ➖, 0↑ 2↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 214190947 206686894 1.04
tpch_q02/datafusion:vortex-file-compressed 443365364 458922460 0.97
tpch_q03/datafusion:vortex-file-compressed 411639779 373719267 1.10
tpch_q04/datafusion:vortex-file-compressed 227243479 233389031 0.97
tpch_q05/datafusion:vortex-file-compressed 404360338 439856287 0.92
tpch_q06/datafusion:vortex-file-compressed 282760669 265310562 1.07
tpch_q07/datafusion:vortex-file-compressed 353840858 369533535 0.96
tpch_q08/datafusion:vortex-file-compressed 666230687 526119108 1.27
tpch_q09/datafusion:vortex-file-compressed 🚨 485580563 333159665 1.46
tpch_q10/datafusion:vortex-file-compressed 449873082 491240802 0.92
tpch_q11/datafusion:vortex-file-compressed 335247168 345801213 0.97
tpch_q12/datafusion:vortex-file-compressed 391399347 393212698 1.00
tpch_q13/datafusion:vortex-file-compressed 231340460 216850681 1.07
tpch_q14/datafusion:vortex-file-compressed 208247235 192834929 1.08
tpch_q15/datafusion:vortex-file-compressed 334436161 315501245 1.06
tpch_q16/datafusion:vortex-file-compressed 210499860 202431430 1.04
tpch_q17/datafusion:vortex-file-compressed 🚨 450928142 346645806 1.30
tpch_q18/datafusion:vortex-file-compressed 284479090 356336430 0.80
tpch_q19/datafusion:vortex-file-compressed 359658989 385691732 0.93
tpch_q20/datafusion:vortex-file-compressed 387421334 446871799 0.87
tpch_q21/datafusion:vortex-file-compressed 570111522 474758161 1.20
tpch_q22/datafusion:vortex-file-compressed 141015495 153785474 0.92
datafusion / vortex-compact (0.971x ➖, 1↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 271160865 243828068 1.11
tpch_q02/datafusion:vortex-compact 414478997 464941843 0.89
tpch_q03/datafusion:vortex-compact 399698715 408433921 0.98
tpch_q04/datafusion:vortex-compact 241506734 263504116 0.92
tpch_q05/datafusion:vortex-compact 🚀 347184158 543634166 0.64
tpch_q06/datafusion:vortex-compact 282029870 310224583 0.91
tpch_q07/datafusion:vortex-compact 438519850 392709830 1.12
tpch_q08/datafusion:vortex-compact 533775088 534952109 1.00
tpch_q09/datafusion:vortex-compact 416063851 376933744 1.10
tpch_q10/datafusion:vortex-compact 505682632 551086818 0.92
tpch_q11/datafusion:vortex-compact 276628805 296456131 0.93
tpch_q12/datafusion:vortex-compact 401748499 391743959 1.03
tpch_q13/datafusion:vortex-compact 210863441 219804551 0.96
tpch_q14/datafusion:vortex-compact 239555870 278011034 0.86
tpch_q15/datafusion:vortex-compact 436039086 518351310 0.84
tpch_q16/datafusion:vortex-compact 164592709 198386214 0.83
tpch_q17/datafusion:vortex-compact 315077049 324668536 0.97
tpch_q18/datafusion:vortex-compact 329818741 290210498 1.14
tpch_q19/datafusion:vortex-compact 489143974 448626151 1.09
tpch_q20/datafusion:vortex-compact 512488380 470797132 1.09
tpch_q21/datafusion:vortex-compact 654544348 533771191 1.23
tpch_q22/datafusion:vortex-compact 162408741 161375358 1.01
datafusion / parquet (1.079x ➖, 1↑ 3↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 229454488 230351307 1.00
tpch_q02/datafusion:parquet 448228973 446021240 1.00
tpch_q03/datafusion:parquet 🚀 327132599 527848936 0.62
tpch_q04/datafusion:parquet 194337720 152603580 1.27
tpch_q05/datafusion:parquet 521779051 494431933 1.06
tpch_q06/datafusion:parquet 143863714 136481660 1.05
tpch_q07/datafusion:parquet 567276670 485574628 1.17
tpch_q08/datafusion:parquet 647947410 666867473 0.97
tpch_q09/datafusion:parquet 🚨 699479049 525097044 1.33
tpch_q10/datafusion:parquet 719756062 793058432 0.91
tpch_q11/datafusion:parquet 432519774 358560166 1.21
tpch_q12/datafusion:parquet 366086691 303449970 1.21
tpch_q13/datafusion:parquet 440679872 446361041 0.99
tpch_q14/datafusion:parquet 🚨 227538137 174940592 1.30
tpch_q15/datafusion:parquet 🚨 413169270 282847239 1.46
tpch_q16/datafusion:parquet 203377335 177056696 1.15
tpch_q17/datafusion:parquet 503121252 392646379 1.28
tpch_q18/datafusion:parquet 482030762 457616897 1.05
tpch_q19/datafusion:parquet 409798391 321898988 1.27
tpch_q20/datafusion:parquet 376294313 351023725 1.07
tpch_q21/datafusion:parquet 563699393 558864478 1.01
tpch_q22/datafusion:parquet 130362447 171765420 0.76
duckdb / vortex-file-compressed (0.994x ➖, 1↑ 1↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 272025712 277764714 0.98
tpch_q02/duckdb:vortex-file-compressed 972993298 993116611 0.98
tpch_q03/duckdb:vortex-file-compressed 781749825 718217107 1.09
tpch_q04/duckdb:vortex-file-compressed 486962200 406567231 1.20
tpch_q05/duckdb:vortex-file-compressed 890870077 937432274 0.95
tpch_q06/duckdb:vortex-file-compressed 🚀 323923910 647177852 0.50
tpch_q07/duckdb:vortex-file-compressed 927612212 823250197 1.13
tpch_q08/duckdb:vortex-file-compressed 1068255787 1045409960 1.02
tpch_q09/duckdb:vortex-file-compressed 1030903646 897385918 1.15
tpch_q10/duckdb:vortex-file-compressed 907432945 749599345 1.21
tpch_q11/duckdb:vortex-file-compressed 640511128 500024949 1.28
tpch_q12/duckdb:vortex-file-compressed 🚨 671058161 439420774 1.53
tpch_q13/duckdb:vortex-file-compressed 463866227 486927117 0.95
tpch_q14/duckdb:vortex-file-compressed 396462706 479621006 0.83
tpch_q15/duckdb:vortex-file-compressed 271308366 323687487 0.84
tpch_q16/duckdb:vortex-file-compressed 357363622 381784491 0.94
tpch_q17/duckdb:vortex-file-compressed 630602407 668704607 0.94
tpch_q18/duckdb:vortex-file-compressed 776746032 597852677 1.30
tpch_q19/duckdb:vortex-file-compressed 479802480 524760039 0.91
tpch_q20/duckdb:vortex-file-compressed 728193471 895470398 0.81
tpch_q21/duckdb:vortex-file-compressed 1201928955 1129058990 1.06
tpch_q22/duckdb:vortex-file-compressed 293902524 375784974 0.78
duckdb / vortex-compact (0.952x ➖, 1↑ 1↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 284327539 284983251 1.00
tpch_q02/duckdb:vortex-compact 917427378 993747623 0.92
tpch_q03/duckdb:vortex-compact 682803699 667334556 1.02
tpch_q04/duckdb:vortex-compact 374465115 326804227 1.15
tpch_q05/duckdb:vortex-compact 856705747 830092527 1.03
tpch_q06/duckdb:vortex-compact 295805730 406495204 0.73
tpch_q07/duckdb:vortex-compact 727453659 858068447 0.85
tpch_q08/duckdb:vortex-compact 1024594672 987816986 1.04
tpch_q09/duckdb:vortex-compact 892099479 935177240 0.95
tpch_q10/duckdb:vortex-compact 852684788 733793840 1.16
tpch_q11/duckdb:vortex-compact 568772632 467967141 1.22
tpch_q12/duckdb:vortex-compact 🚨 633405214 473215451 1.34
tpch_q13/duckdb:vortex-compact 430627197 466474232 0.92
tpch_q14/duckdb:vortex-compact 397062487 473023795 0.84
tpch_q15/duckdb:vortex-compact 357562889 303222301 1.18
tpch_q16/duckdb:vortex-compact 338811468 404605336 0.84
tpch_q17/duckdb:vortex-compact 🚀 444895734 685929016 0.65
tpch_q18/duckdb:vortex-compact 457973402 526897400 0.87
tpch_q19/duckdb:vortex-compact 453531357 521757054 0.87
tpch_q20/duckdb:vortex-compact 743354806 764164754 0.97
tpch_q21/duckdb:vortex-compact 1021553667 1113970786 0.92
tpch_q22/duckdb:vortex-compact 280023137 358664034 0.78
duckdb / parquet (0.961x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 490814981 488096762 1.01
tpch_q02/duckdb:parquet 1342834438 1354321382 0.99
tpch_q03/duckdb:parquet 1086814593 1111246397 0.98
tpch_q04/duckdb:parquet 685134828 656478092 1.04
tpch_q05/duckdb:parquet 1459829699 1743163315 0.84
tpch_q06/duckdb:parquet 506230126 470446314 1.08
tpch_q07/duckdb:parquet 1338059959 1369622089 0.98
tpch_q08/duckdb:parquet 1628024164 1797564936 0.91
tpch_q09/duckdb:parquet 1463628656 1700500715 0.86
tpch_q10/duckdb:parquet 1329051539 1271392860 1.05
tpch_q11/duckdb:parquet 955285715 1007057199 0.95
tpch_q12/duckdb:parquet 616260516 683028324 0.90
tpch_q13/duckdb:parquet 880106517 944695704 0.93
tpch_q14/duckdb:parquet 750775834 662270176 1.13
tpch_q15/duckdb:parquet 578660923 554082668 1.04
tpch_q16/duckdb:parquet 546381899 629791650 0.87
tpch_q17/duckdb:parquet 748087922 864158346 0.87
tpch_q18/duckdb:parquet 900838905 901405202 1.00
tpch_q19/duckdb:parquet 820311343 936069605 0.88
tpch_q20/duckdb:parquet 1155603193 1209354739 0.96
tpch_q21/duckdb:parquet 1234803441 1215118314 1.02
tpch_q22/duckdb:parquet 506102176 529385562 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +11.2% +0.1% +11.1% +174.8% ➖ noise
1 datafusion:vortex-file-compressed +3.6% +0.1% +3.5% +159.7% ➖ noise
1 duckdb:vortex-compact -0.2% +0.1% -0.3% +53.9% ➖ noise
1 duckdb:vortex-file-compressed -2.1% +0.1% -2.1% +45.9% ➖ noise
2 datafusion:vortex-compact -10.9% -0.2% -10.7% +68.2% ➖ noise
2 datafusion:vortex-file-compressed -3.4% -0.2% -3.2% +45.8% ➖ noise
2 duckdb:vortex-compact -7.7% -0.2% -7.5% +32.9% ➖ noise
2 duckdb:vortex-file-compressed -2.0% -0.2% -1.9% +30.2% ➖ noise
3 datafusion:vortex-compact -2.1% -22.1% +25.7% +104.0% ➖ noise
3 datafusion:vortex-file-compressed +10.1% -22.1% +41.5% +108.0% ➖ noise
3 duckdb:vortex-compact +2.3% -22.1% +31.4% +55.6% ➖ noise
3 duckdb:vortex-file-compressed +8.8% -22.1% +39.8% +38.0% 🚨 regression
4 datafusion:vortex-compact -8.3% +15.3% -20.5% +62.8% ➖ noise
4 datafusion:vortex-file-compressed -2.6% +15.3% -15.5% +61.7% ➖ noise
4 duckdb:vortex-compact +14.6% +15.3% -0.6% +56.9% ➖ noise
4 duckdb:vortex-file-compressed +19.8% +15.3% +3.9% +57.2% ➖ noise
5 datafusion:vortex-compact -36.1% -6.0% -32.1% +36.4% ✅ faster
5 datafusion:vortex-file-compressed -8.1% -6.0% -2.2% +30.6% ➖ noise
5 duckdb:vortex-compact +3.2% -6.0% +9.8% +30.2% ➖ noise
5 duckdb:vortex-file-compressed -5.0% -6.0% +1.1% +30.2% ➖ noise
6 datafusion:vortex-compact -9.1% +6.5% -14.6% +30.2% ➖ noise
6 datafusion:vortex-file-compressed +6.6% +6.5% +0.1% +30.2% ➖ noise
6 duckdb:vortex-compact -27.2% +6.5% -31.7% +30.2% ✅ faster
6 duckdb:vortex-file-compressed -49.9% +6.5% -53.0% +50.0% ✅ faster
7 datafusion:vortex-compact +11.7% +6.8% +4.5% +30.2% ➖ noise
7 datafusion:vortex-file-compressed -4.2% +6.8% -10.4% +36.2% ➖ noise
7 duckdb:vortex-compact -15.2% +6.8% -20.6% +30.2% ➖ noise
7 duckdb:vortex-file-compressed +12.7% +6.8% +5.5% +30.2% ➖ noise
8 datafusion:vortex-compact -0.2% -6.2% +6.4% +30.2% ➖ noise
8 datafusion:vortex-file-compressed +26.6% -6.2% +35.0% +30.5% 🚨 regression
8 duckdb:vortex-compact +3.7% -6.2% +10.6% +30.2% ➖ noise
8 duckdb:vortex-file-compressed +2.2% -6.2% +8.9% +30.2% ➖ noise
9 datafusion:vortex-compact +10.4% +7.1% +3.1% +30.2% ➖ noise
9 datafusion:vortex-file-compressed +45.8% +7.1% +36.1% +58.0% ➖ noise
9 duckdb:vortex-compact -4.6% +7.1% -10.9% +30.2% ➖ noise
9 duckdb:vortex-file-compressed +14.9% +7.1% +7.3% +30.2% ➖ noise
10 datafusion:vortex-compact -8.2% -2.6% -5.8% +59.5% ➖ noise
10 datafusion:vortex-file-compressed -8.4% -2.6% -6.0% +43.3% ➖ noise
10 duckdb:vortex-compact +16.2% -2.6% +19.3% +32.4% ➖ noise
10 duckdb:vortex-file-compressed +21.1% -2.6% +24.3% +30.2% ➖ noise
11 datafusion:vortex-compact -6.7% +7.0% -12.8% +30.2% ➖ noise
11 datafusion:vortex-file-compressed -3.1% +7.0% -9.4% +37.8% ➖ noise
11 duckdb:vortex-compact +21.5% +7.0% +13.6% +30.2% ➖ noise
11 duckdb:vortex-file-compressed +28.1% +7.0% +19.7% +30.2% ➖ noise
12 datafusion:vortex-compact +2.6% +4.3% -1.7% +30.5% ➖ noise
12 datafusion:vortex-file-compressed -0.5% +4.3% -4.6% +46.3% ➖ noise
12 duckdb:vortex-compact +33.9% +4.3% +28.3% +30.2% ➖ noise
12 duckdb:vortex-file-compressed +52.7% +4.3% +46.4% +30.7% 🚨 regression
13 datafusion:vortex-compact -4.1% -4.1% +0.0% +76.3% ➖ noise
13 datafusion:vortex-file-compressed +6.7% -4.1% +11.2% +71.0% ➖ noise
13 duckdb:vortex-compact -7.7% -4.1% -3.7% +30.2% ➖ noise
13 duckdb:vortex-file-compressed -4.7% -4.1% -0.7% +50.0% ➖ noise
14 datafusion:vortex-compact -13.8% +21.4% -29.0% +30.2% ✅ faster
14 datafusion:vortex-file-compressed +8.0% +21.4% -11.1% +30.2% ➖ noise
14 duckdb:vortex-compact -16.1% +21.4% -30.9% +30.2% ✅ faster
14 duckdb:vortex-file-compressed -17.3% +21.4% -31.9% +30.2% ✅ faster
15 datafusion:vortex-compact -15.9% +23.5% -31.9% +30.2% ✅ faster
15 datafusion:vortex-file-compressed +6.0% +23.5% -14.2% +30.2% ➖ noise
15 duckdb:vortex-compact +17.9% +23.5% -4.5% +30.2% ➖ noise
15 duckdb:vortex-file-compressed -16.2% +23.5% -32.1% +30.2% ✅ faster
16 datafusion:vortex-compact -17.0% -0.2% -16.9% +30.2% ➖ noise
16 datafusion:vortex-file-compressed +4.0% -0.2% +4.2% +91.6% ➖ noise
16 duckdb:vortex-compact -16.3% -0.2% -16.1% +30.2% ➖ noise
16 duckdb:vortex-file-compressed -6.4% -0.2% -6.2% +30.2% ➖ noise
17 datafusion:vortex-compact -3.0% +5.3% -7.9% +45.4% ➖ noise
17 datafusion:vortex-file-compressed +30.1% +5.3% +23.5% +43.5% ➖ noise
17 duckdb:vortex-compact -35.1% +5.3% -38.4% +30.2% ✅ faster
17 duckdb:vortex-file-compressed -5.7% +5.3% -10.5% +39.2% ➖ noise
18 datafusion:vortex-compact +13.6% +2.6% +10.8% +30.2% ➖ noise
18 datafusion:vortex-file-compressed -20.2% +2.6% -22.2% +32.5% ➖ noise
18 duckdb:vortex-compact -13.1% +2.6% -15.3% +30.2% ➖ noise
18 duckdb:vortex-file-compressed +29.9% +2.6% +26.6% +30.2% ➖ noise
19 datafusion:vortex-compact +9.0% +5.6% +3.2% +30.2% ➖ noise
19 datafusion:vortex-file-compressed -6.7% +5.6% -11.7% +36.0% ➖ noise
19 duckdb:vortex-compact -13.1% +5.6% -17.7% +30.2% ➖ noise
19 duckdb:vortex-file-compressed -8.6% +5.6% -13.4% +30.2% ➖ noise
20 datafusion:vortex-compact +8.9% +1.2% +7.6% +30.2% ➖ noise
20 datafusion:vortex-file-compressed -13.3% +1.2% -14.3% +31.5% ➖ noise
20 duckdb:vortex-compact -2.7% +1.2% -3.9% +30.2% ➖ noise
20 duckdb:vortex-file-compressed -18.7% +1.2% -19.7% +30.2% ➖ noise
21 datafusion:vortex-compact +22.6% +1.2% +21.1% +30.2% ➖ noise
21 datafusion:vortex-file-compressed +20.1% +1.2% +18.6% +30.2% ➖ noise
21 duckdb:vortex-compact -8.3% +1.2% -9.4% +30.2% ➖ noise
21 duckdb:vortex-file-compressed +6.5% +1.2% +5.1% +30.2% ➖ noise
22 datafusion:vortex-compact +0.6% -14.8% +18.1% +30.2% ➖ noise
22 datafusion:vortex-file-compressed -8.3% -14.8% +7.6% +30.2% ➖ noise
22 duckdb:vortex-compact -21.9% -14.8% -8.3% +30.2% ➖ noise
22 duckdb:vortex-file-compressed -21.8% -14.8% -8.2% +30.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Vortex (geomean): 1.014x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -1.7%


datafusion / vortex-file-compressed (1.209x ➖, 0↑ 2↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 40557065 34230005 1.18
fineweb_q01/datafusion:vortex-file-compressed 🚨 970521196 581123222 1.67
fineweb_q02/datafusion:vortex-file-compressed 953479165 774549617 1.23
fineweb_q03/datafusion:vortex-file-compressed 1385552103 1371958969 1.01
fineweb_q04/datafusion:vortex-file-compressed 1512448784 1393147252 1.09
fineweb_q05/datafusion:vortex-file-compressed 1420446645 1439280820 0.99
fineweb_q06/datafusion:vortex-file-compressed 1653846230 1702687792 0.97
fineweb_q07/datafusion:vortex-file-compressed 1578337038 1445594848 1.09
fineweb_q08/datafusion:vortex-file-compressed 🚨 1175120069 597335748 1.97
datafusion / vortex-compact (1.005x ➖, 1↑ 2↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 32921702 60365182 0.55
fineweb_q01/datafusion:vortex-compact 🚨 701753135 529537439 1.33
fineweb_q02/datafusion:vortex-compact 🚨 834899550 602006372 1.39
fineweb_q03/datafusion:vortex-compact 1841335309 1871221173 0.98
fineweb_q04/datafusion:vortex-compact 2249892749 2270529252 0.99
fineweb_q05/datafusion:vortex-compact 1730595549 1727938001 1.00
fineweb_q06/datafusion:vortex-compact 1446895815 1446469275 1.00
fineweb_q07/datafusion:vortex-compact 1365910304 1291829946 1.06
fineweb_q08/datafusion:vortex-compact 399168388 394490443 1.01
datafusion / parquet (1.024x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1082603507 1069341571 1.01
fineweb_q01/datafusion:parquet 1818779995 1781059322 1.02
fineweb_q02/datafusion:parquet 1912029653 1839001939 1.04
fineweb_q03/datafusion:parquet 1811968424 2014273838 0.90
fineweb_q04/datafusion:parquet 1805425423 1910080421 0.95
fineweb_q05/datafusion:parquet 1884245941 1773081477 1.06
fineweb_q06/datafusion:parquet 1937067934 1796361131 1.08
fineweb_q07/datafusion:parquet 1922289922 1846915816 1.04
fineweb_q08/datafusion:parquet 1957331385 1727314546 1.13
duckdb / vortex-file-compressed (0.889x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 78133939 91165549 0.86
fineweb_q01/duckdb:vortex-file-compressed 598933407 675983528 0.89
fineweb_q02/duckdb:vortex-file-compressed 490857957 484722909 1.01
fineweb_q03/duckdb:vortex-file-compressed 1483719073 1581792702 0.94
fineweb_q04/duckdb:vortex-file-compressed 1484764563 1690844071 0.88
fineweb_q05/duckdb:vortex-file-compressed 1465006465 1601862137 0.91
fineweb_q06/duckdb:vortex-file-compressed 1614399435 1812334916 0.89
fineweb_q07/duckdb:vortex-file-compressed 1492697763 2091652124 0.71
fineweb_q08/duckdb:vortex-file-compressed 735374736 784158640 0.94
duckdb / vortex-compact (0.978x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 91547503 94404683 0.97
fineweb_q01/duckdb:vortex-compact 546512593 548553996 1.00
fineweb_q02/duckdb:vortex-compact 600988367 568436446 1.06
fineweb_q03/duckdb:vortex-compact 1569546418 1758467461 0.89
fineweb_q04/duckdb:vortex-compact 1669225650 1802117411 0.93
fineweb_q05/duckdb:vortex-compact 1472877396 1611592958 0.91
fineweb_q06/duckdb:vortex-compact 1389438359 1493772882 0.93
fineweb_q07/duckdb:vortex-compact 1321775435 1453623547 0.91
fineweb_q08/duckdb:vortex-compact 574370139 458671430 1.25
duckdb / parquet (0.983x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1117606693 1116624675 1.00
fineweb_q01/duckdb:parquet 1649623458 1781202420 0.93
fineweb_q02/duckdb:parquet 1633493747 1693915314 0.96
fineweb_q03/duckdb:parquet 4262064937 4313517490 0.99
fineweb_q04/duckdb:parquet 2011969269 1871274606 1.08
fineweb_q05/duckdb:parquet 2669247375 2806556878 0.95
fineweb_q06/duckdb:parquet 3492248170 3463321145 1.01
fineweb_q07/duckdb:parquet 4009287243 4099372209 0.98
fineweb_q08/duckdb:parquet 1066730622 1113258422 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -45.5% +0.7% -45.8% +160.1% ➖ noise
0 datafusion:vortex-file-compressed +18.5% +0.7% +17.7% +148.5% ➖ noise
0 duckdb:vortex-compact -3.0% +0.7% -3.7% +47.2% ➖ noise
0 duckdb:vortex-file-compressed -14.3% +0.7% -14.9% +49.5% ➖ noise
1 datafusion:vortex-compact +32.5% -2.8% +36.3% +68.1% ➖ noise
1 datafusion:vortex-file-compressed +67.0% -2.8% +71.7% +74.8% ➖ noise
1 duckdb:vortex-compact -0.4% -2.8% +2.4% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -11.4% -2.8% -8.9% +30.0% ➖ noise
2 datafusion:vortex-compact +38.7% +0.1% +38.5% +30.0% 🚨 regression
2 datafusion:vortex-file-compressed +23.1% +0.1% +22.9% +41.5% ➖ noise
2 duckdb:vortex-compact +5.7% +0.1% +5.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +1.3% +0.1% +1.1% +30.0% ➖ noise
3 datafusion:vortex-compact -1.6% -5.7% +4.4% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +1.0% -5.7% +7.1% +30.0% ➖ noise
3 duckdb:vortex-compact -10.7% -5.7% -5.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -6.2% -5.7% -0.5% +30.0% ➖ noise
4 datafusion:vortex-compact -0.9% +0.8% -1.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +8.6% +0.8% +7.7% +30.0% ➖ noise
4 duckdb:vortex-compact -7.4% +0.8% -8.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -12.2% +0.8% -12.9% +30.0% ➖ noise
5 datafusion:vortex-compact +0.2% +0.5% -0.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -1.3% +0.5% -1.8% +30.0% ➖ noise
5 duckdb:vortex-compact -8.6% +0.5% -9.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -8.5% +0.5% -9.0% +30.0% ➖ noise
6 datafusion:vortex-compact +0.0% +4.3% -4.1% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -2.9% +4.3% -6.9% +30.0% ➖ noise
6 duckdb:vortex-compact -7.0% +4.3% -10.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -10.9% +4.3% -14.6% +30.0% ➖ noise
7 datafusion:vortex-compact +5.7% +0.9% +4.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +9.2% +0.9% +8.2% +30.0% ➖ noise
7 duckdb:vortex-compact -9.1% +0.9% -9.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -28.6% +0.9% -29.3% +30.0% ✅ faster
8 datafusion:vortex-compact +1.2% +4.2% -2.9% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +96.7% +4.2% +88.8% +36.9% 🚨 regression
8 duckdb:vortex-compact +25.2% +4.2% +20.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -6.2% +4.2% -10.0% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: Random Access

Vortex (geomean): 0.871x ✅
Parquet (geomean): 0.999x ➖


unknown / unknown (0.952x ➖, 10↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2145184 2322892 0.92
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1308378 1296415 1.01
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11601172091 11880657208 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11162395388 11228165446 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8087899 8741445 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6144214 6624282 0.93
random-access/feature-vectors/uniform/lance-tokio-local-disk 1486898 1506918 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2388536 2416586 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11252119757 11213835266 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11272246218 11289921854 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 12602368 14147186 0.89
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12514794 14331999 0.87
random-access/lance-tokio-local-disk 762256 751968 1.01
random-access/lance-tokio-local-disk-footer 1376890 1368155 1.01
random-access/nested-lists/correlated/lance-tokio-local-disk 274775 276772 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 720085 724103 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk 139153106 136852859 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 138573090 137597144 1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 698391 831904 0.84
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 773834 785610 0.99
random-access/nested-lists/uniform/lance-tokio-local-disk 1167293 1207003 0.97
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1656060 1706131 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk 140626859 138640733 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 141388233 139084145 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 2331531 2640791 0.88
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2462499 2686512 0.92
random-access/nested-structs/correlated/lance-tokio-local-disk 435596 442843 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 649649 655398 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk 26150364 26555074 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 26449080 26517440 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk 904008 857812 1.05
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 897458 894574 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk 2841234 2958006 0.96
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3074869 3198310 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 26095447 26502647 0.98
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 26008867 26463494 0.98
random-access/nested-structs/uniform/vortex-tokio-local-disk 1819281 1754227 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1807339 1826553 0.99
random-access/parquet-tokio-local-disk 184352025 184543966 1.00
random-access/parquet-tokio-local-disk-footer 184920195 183720111 1.01
random-access/taxi/correlated/lance-tokio-local-disk 996874 977052 1.02
random-access/taxi/correlated/lance-tokio-local-disk-footer 1692498 1668065 1.01
random-access/taxi/correlated/parquet-tokio-local-disk 271885614 276480737 0.98
random-access/taxi/correlated/parquet-tokio-local-disk-footer 278585081 274813397 1.01
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1704977 2486265 0.69
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1703198 2202108 0.77
random-access/taxi/uniform/lance-tokio-local-disk 8984850 8661003 1.04
random-access/taxi/uniform/lance-tokio-local-disk-footer 9593047 9406985 1.02
random-access/taxi/uniform/parquet-tokio-local-disk 289275044 288320157 1.00
random-access/taxi/uniform/parquet-tokio-local-disk-footer 291667518 289236414 1.01
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4325818 5486986 0.79
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4385452 5407099 0.81
random-access/vortex-tokio-local-disk 🚀 1227500 1785515 0.69
random-access/vortex-tokio-local-disk-footer 🚀 1249504 1681984 0.74

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Vortex (geomean): 0.967x ➖
Parquet (geomean): 0.983x ➖
Shifts: Parquet (control) -1.7% · Median polish -1.5%


duckdb / vortex-file-compressed (0.947x ➖, 1↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10742377 11502709 0.93
statpopgen_q01/duckdb:vortex-file-compressed 🚀 19403346 26615449 0.73
statpopgen_q02/duckdb:vortex-file-compressed 1285076832 1299034704 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3057731150 3133240670 0.98
statpopgen_q04/duckdb:vortex-file-compressed 3005403825 3127548229 0.96
statpopgen_q05/duckdb:vortex-file-compressed 1361581900 1421906632 0.96
statpopgen_q06/duckdb:vortex-file-compressed 2056199013 2071570221 0.99
statpopgen_q07/duckdb:vortex-file-compressed 214960568 220774682 0.97
statpopgen_q08/duckdb:vortex-file-compressed 228919006 236669036 0.97
statpopgen_q09/duckdb:vortex-file-compressed 2834956291 2901545001 0.98
statpopgen_q10/duckdb:vortex-file-compressed 4661766390 4676993090 1.00
duckdb / vortex-compact (0.987x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10865998 11153371 0.97
statpopgen_q01/duckdb:vortex-compact 166269041 167442767 0.99
statpopgen_q02/duckdb:vortex-compact 1806618101 1823600392 0.99
statpopgen_q03/duckdb:vortex-compact 3505613178 3515723804 1.00
statpopgen_q04/duckdb:vortex-compact 3574300583 3570065655 1.00
statpopgen_q05/duckdb:vortex-compact 1825251577 1905511639 0.96
statpopgen_q06/duckdb:vortex-compact 2664412382 2699320941 0.99
statpopgen_q07/duckdb:vortex-compact 955017261 963729760 0.99
statpopgen_q08/duckdb:vortex-compact 993181369 1002974349 0.99
statpopgen_q09/duckdb:vortex-compact 3334579350 3356025591 0.99
statpopgen_q10/duckdb:vortex-compact 5366498386 5435986023 0.99
duckdb / parquet (0.983x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 308788638 320729617 0.96
statpopgen_q01/duckdb:parquet 394557709 406589143 0.97
statpopgen_q02/duckdb:parquet 982719774 990870219 0.99
statpopgen_q03/duckdb:parquet 1494190354 1530876831 0.98
statpopgen_q04/duckdb:parquet 1496209493 1515901635 0.99
statpopgen_q05/duckdb:parquet 991864419 1020027564 0.97
statpopgen_q06/duckdb:parquet 1485230364 1490927380 1.00
statpopgen_q07/duckdb:parquet 1868068971 1895214245 0.99
statpopgen_q08/duckdb:parquet 1873638461 1896006470 0.99
statpopgen_q09/duckdb:parquet 1375064710 1396819898 0.98
statpopgen_q10/duckdb:parquet 2649421506 2659779436 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -2.6% -3.7% +1.2% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -6.6% -3.7% -3.0% +10.0% ➖ noise
1 duckdb:vortex-compact -0.7% -3.0% +2.3% +25.8% ➖ noise
1 duckdb:vortex-file-compressed -27.1% -3.0% -24.9% +207.9% ➖ noise
2 duckdb:vortex-compact -0.9% -0.8% -0.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.1% -0.8% -0.3% +10.0% ➖ noise
3 duckdb:vortex-compact -0.3% -2.4% +2.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.4% -2.4% -0.0% +10.0% ➖ noise
4 duckdb:vortex-compact +0.1% -1.3% +1.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.9% -1.3% -2.6% +10.0% ➖ noise
5 duckdb:vortex-compact -4.2% -2.8% -1.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.2% -2.8% -1.5% +10.0% ➖ noise
6 duckdb:vortex-compact -1.3% -0.4% -0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.7% -0.4% -0.4% +10.0% ➖ noise
7 duckdb:vortex-compact -0.9% -1.4% +0.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.6% -1.4% -1.2% +10.0% ➖ noise
8 duckdb:vortex-compact -1.0% -1.2% +0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.3% -1.2% -2.1% +10.0% ➖ noise
9 duckdb:vortex-compact -0.6% -1.6% +0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.3% -1.6% -0.7% +10.0% ➖ noise
10 duckdb:vortex-compact -1.3% -0.4% -0.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.3% -0.4% +0.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.5%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.982x ➖
Shifts: Parquet (control) -1.8% · Median polish -2.3%


datafusion / vortex-file-compressed (0.984x ➖, 8↑ 3↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2905067 1976268 1.47
clickbench_q01/datafusion:vortex-file-compressed 15752083 14484399 1.09
clickbench_q02/datafusion:vortex-file-compressed 37258849 34074595 1.09
clickbench_q03/datafusion:vortex-file-compressed 🚨 43461128 38431558 1.13
clickbench_q04/datafusion:vortex-file-compressed 336972809 311199541 1.08
clickbench_q05/datafusion:vortex-file-compressed 331095909 331908708 1.00
clickbench_q06/datafusion:vortex-file-compressed 1916594 2025411 0.95
clickbench_q07/datafusion:vortex-file-compressed 17802112 18264333 0.97
clickbench_q08/datafusion:vortex-file-compressed 385755093 382199300 1.01
clickbench_q09/datafusion:vortex-file-compressed 574506062 577694886 0.99
clickbench_q10/datafusion:vortex-file-compressed 75246351 74678410 1.01
clickbench_q11/datafusion:vortex-file-compressed 84869674 88067077 0.96
clickbench_q12/datafusion:vortex-file-compressed 280835326 282978267 0.99
clickbench_q13/datafusion:vortex-file-compressed 423836567 427897995 0.99
clickbench_q14/datafusion:vortex-file-compressed 265114998 262595409 1.01
clickbench_q15/datafusion:vortex-file-compressed 371443560 370786841 1.00
clickbench_q16/datafusion:vortex-file-compressed 706822332 704630365 1.00
clickbench_q17/datafusion:vortex-file-compressed 719503539 714530032 1.01
clickbench_q18/datafusion:vortex-file-compressed 1435882372 1400967440 1.02
clickbench_q19/datafusion:vortex-file-compressed 25031121 24703254 1.01
clickbench_q20/datafusion:vortex-file-compressed 361466820 354077632 1.02
clickbench_q21/datafusion:vortex-file-compressed 418612676 419059501 1.00
clickbench_q22/datafusion:vortex-file-compressed 512194585 506246923 1.01
clickbench_q23/datafusion:vortex-file-compressed 🚨 968584349 819455155 1.18
clickbench_q24/datafusion:vortex-file-compressed 51178169 51502887 0.99
clickbench_q25/datafusion:vortex-file-compressed 71063530 76011947 0.93
clickbench_q26/datafusion:vortex-file-compressed 46068091 46100625 1.00
clickbench_q27/datafusion:vortex-file-compressed 817294607 792508249 1.03
clickbench_q28/datafusion:vortex-file-compressed 6930148172 6694063884 1.04
clickbench_q29/datafusion:vortex-file-compressed 246226119 236837308 1.04
clickbench_q30/datafusion:vortex-file-compressed 🚀 235114014 283828562 0.83
clickbench_q31/datafusion:vortex-file-compressed 🚀 282717964 327919347 0.86
clickbench_q32/datafusion:vortex-file-compressed 1390317759 1447141509 0.96
clickbench_q33/datafusion:vortex-file-compressed 🚀 1447498687 1694413994 0.85
clickbench_q34/datafusion:vortex-file-compressed 🚀 1420652129 1717183374 0.83
clickbench_q35/datafusion:vortex-file-compressed 🚀 523194949 606913718 0.86
clickbench_q36/datafusion:vortex-file-compressed 🚀 83499378 95104554 0.88
clickbench_q37/datafusion:vortex-file-compressed 40169009 43469729 0.92
clickbench_q38/datafusion:vortex-file-compressed 🚀 22408896 26727072 0.84
clickbench_q39/datafusion:vortex-file-compressed 152369519 168054401 0.91
clickbench_q40/datafusion:vortex-file-compressed 18758293 20819214 0.90
clickbench_q41/datafusion:vortex-file-compressed 18764547 19252742 0.97
clickbench_q42/datafusion:vortex-file-compressed 🚀 19242267 21772415 0.88
datafusion / parquet (0.963x ➖, 15↑ 7↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1845350 2386781 0.77
clickbench_q01/datafusion:parquet 🚀 20801356 23146961 0.90
clickbench_q02/datafusion:parquet 57749143 62337628 0.93
clickbench_q03/datafusion:parquet 44618678 46898219 0.95
clickbench_q04/datafusion:parquet 🚀 362660437 436313824 0.83
clickbench_q05/datafusion:parquet 🚀 406883319 461904991 0.88
clickbench_q06/datafusion:parquet 🚀 1823775 2351269 0.78
clickbench_q07/datafusion:parquet 27889407 28731453 0.97
clickbench_q08/datafusion:parquet 🚀 445794752 517157747 0.86
clickbench_q09/datafusion:parquet 🚀 681514446 794410719 0.86
clickbench_q10/datafusion:parquet 🚀 114754582 135325065 0.85
clickbench_q11/datafusion:parquet 🚀 142670941 162891504 0.88
clickbench_q12/datafusion:parquet 🚀 382487474 453422761 0.84
clickbench_q13/datafusion:parquet 🚀 529384085 637973948 0.83
clickbench_q14/datafusion:parquet 🚀 380465454 437857044 0.87
clickbench_q15/datafusion:parquet 🚀 409459160 480488936 0.85
clickbench_q16/datafusion:parquet 🚀 737723269 862408205 0.86
clickbench_q17/datafusion:parquet 🚀 726386680 845453076 0.86
clickbench_q18/datafusion:parquet 1555763056 1685211883 0.92
clickbench_q19/datafusion:parquet 36857456 38068672 0.97
clickbench_q20/datafusion:parquet 627838015 683268639 0.92
clickbench_q21/datafusion:parquet 690997178 756214979 0.91
clickbench_q22/datafusion:parquet 999091681 1097738563 0.91
clickbench_q23/datafusion:parquet 4211802475 4173229723 1.01
clickbench_q24/datafusion:parquet 91167901 91672747 0.99
clickbench_q25/datafusion:parquet 153764131 146997434 1.05
clickbench_q26/datafusion:parquet 🚨 98427545 89216073 1.10
clickbench_q27/datafusion:parquet 🚨 1206861065 1087009108 1.11
clickbench_q28/datafusion:parquet 6690611676 6731304862 0.99
clickbench_q29/datafusion:parquet 233715648 244017725 0.96
clickbench_q30/datafusion:parquet 366032885 362236207 1.01
clickbench_q31/datafusion:parquet 386766270 383397556 1.01
clickbench_q32/datafusion:parquet 1223083218 1164798890 1.05
clickbench_q33/datafusion:parquet 1643807052 1503953080 1.09
clickbench_q34/datafusion:parquet 🚨 1856202341 1531600139 1.21
clickbench_q35/datafusion:parquet 🚨 663448549 546133119 1.21
clickbench_q36/datafusion:parquet 🚨 173099877 151212271 1.14
clickbench_q37/datafusion:parquet 🚨 67605519 61048717 1.11
clickbench_q38/datafusion:parquet 100971498 92313724 1.09
clickbench_q39/datafusion:parquet 🚨 328252014 278399261 1.18
clickbench_q40/datafusion:parquet 36928653 34949390 1.06
clickbench_q41/datafusion:parquet 32791328 31943051 1.03
clickbench_q42/datafusion:parquet 35986327 33119710 1.09
duckdb / vortex-file-compressed (0.959x ➖, 13↑ 5↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6261697 6926288 0.90
clickbench_q01/duckdb:vortex-file-compressed 🚀 12879784 15156777 0.85
clickbench_q02/duckdb:vortex-file-compressed 25960250 27317380 0.95
clickbench_q03/duckdb:vortex-file-compressed 30100429 32926755 0.91
clickbench_q04/duckdb:vortex-file-compressed 🚀 171104362 192864595 0.89
clickbench_q05/duckdb:vortex-file-compressed 🚀 197068013 226857713 0.87
clickbench_q06/duckdb:vortex-file-compressed 🚀 18501923 20878583 0.89
clickbench_q07/duckdb:vortex-file-compressed 17059171 16488786 1.03
clickbench_q08/duckdb:vortex-file-compressed 264928842 291512775 0.91
clickbench_q09/duckdb:vortex-file-compressed 377097924 414972387 0.91
clickbench_q10/duckdb:vortex-file-compressed 74653038 81809688 0.91
clickbench_q11/duckdb:vortex-file-compressed 86469643 92894955 0.93
clickbench_q12/duckdb:vortex-file-compressed 🚀 215793991 247433343 0.87
clickbench_q13/duckdb:vortex-file-compressed 🚀 438786870 492824708 0.89
clickbench_q14/duckdb:vortex-file-compressed 🚀 246817624 275122200 0.90
clickbench_q15/duckdb:vortex-file-compressed 213720041 213697605 1.00
clickbench_q16/duckdb:vortex-file-compressed 🚨 741679618 612146760 1.21
clickbench_q17/duckdb:vortex-file-compressed 🚨 565510262 510692525 1.11
clickbench_q18/duckdb:vortex-file-compressed 1241095230 1177897464 1.05
clickbench_q19/duckdb:vortex-file-compressed 21468704 20432960 1.05
clickbench_q20/duckdb:vortex-file-compressed 361351317 393894557 0.92
clickbench_q21/duckdb:vortex-file-compressed 406132840 416489807 0.98
clickbench_q22/duckdb:vortex-file-compressed 🚀 608895369 682758635 0.89
clickbench_q23/duckdb:vortex-file-compressed 🚀 769735503 894137581 0.86
clickbench_q24/duckdb:vortex-file-compressed 🚨 51713644 42233777 1.22
clickbench_q25/duckdb:vortex-file-compressed 81499004 78386120 1.04
clickbench_q26/duckdb:vortex-file-compressed 43093296 41537232 1.04
clickbench_q27/duckdb:vortex-file-compressed 🚨 583972035 499358024 1.17
clickbench_q28/duckdb:vortex-file-compressed 🚨 3291619674 2991474856 1.10
clickbench_q29/duckdb:vortex-file-compressed 29133452 29690659 0.98
clickbench_q30/duckdb:vortex-file-compressed 180920499 183482951 0.99
clickbench_q31/duckdb:vortex-file-compressed 266257813 266563511 1.00
clickbench_q32/duckdb:vortex-file-compressed 1310446037 1337538563 0.98
clickbench_q33/duckdb:vortex-file-compressed 1481319332 1487517983 1.00
clickbench_q34/duckdb:vortex-file-compressed 1608416735 1697824631 0.95
clickbench_q35/duckdb:vortex-file-compressed 370425099 401104570 0.92
clickbench_q36/duckdb:vortex-file-compressed 🚀 32103025 36682947 0.88
clickbench_q37/duckdb:vortex-file-compressed 23640322 25265176 0.94
clickbench_q38/duckdb:vortex-file-compressed 🚀 25334967 28919016 0.88
clickbench_q39/duckdb:vortex-file-compressed 43982735 46704753 0.94
clickbench_q40/duckdb:vortex-file-compressed 🚀 23347131 26964652 0.87
clickbench_q41/duckdb:vortex-file-compressed 🚀 22276743 24929470 0.89
clickbench_q42/duckdb:vortex-file-compressed 24366954 24952535 0.98
duckdb / parquet (1.001x ➖, 2↑ 7↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 229455327 267203795 0.86
clickbench_q01/duckdb:parquet 50575724 53627362 0.94
clickbench_q02/duckdb:parquet 65862050 70549958 0.93
clickbench_q03/duckdb:parquet 65480108 69457011 0.94
clickbench_q04/duckdb:parquet 210071890 226206622 0.93
clickbench_q05/duckdb:parquet 309132140 311051835 0.99
clickbench_q06/duckdb:parquet 66412549 65476760 1.01
clickbench_q07/duckdb:parquet 57118766 57040858 1.00
clickbench_q08/duckdb:parquet 301142378 296074331 1.02
clickbench_q09/duckdb:parquet 444551983 405296719 1.10
clickbench_q10/duckdb:parquet 🚨 105711835 95686763 1.10
clickbench_q11/duckdb:parquet 🚨 121309434 106673869 1.14
clickbench_q12/duckdb:parquet 🚨 332115412 297156488 1.12
clickbench_q13/duckdb:parquet 🚨 589791605 511938896 1.15
clickbench_q14/duckdb:parquet 🚨 375320141 329680326 1.14
clickbench_q15/duckdb:parquet 🚨 274445365 242861585 1.13
clickbench_q16/duckdb:parquet 640990210 613198831 1.05
clickbench_q17/duckdb:parquet 509824638 513742117 0.99
clickbench_q18/duckdb:parquet 1076706695 1053191722 1.02
clickbench_q19/duckdb:parquet 50474243 48961825 1.03
clickbench_q20/duckdb:parquet 432859396 433266443 1.00
clickbench_q21/duckdb:parquet 560646609 558086812 1.00
clickbench_q22/duckdb:parquet 934661767 937372962 1.00
clickbench_q23/duckdb:parquet 314513210 320060589 0.98
clickbench_q24/duckdb:parquet 81580964 78248401 1.04
clickbench_q25/duckdb:parquet 142730983 140893608 1.01
clickbench_q26/duckdb:parquet 53736709 52763958 1.02
clickbench_q27/duckdb:parquet 646109307 642098178 1.01
clickbench_q28/duckdb:parquet 4859022177 4837170270 1.00
clickbench_q29/duckdb:parquet 62503240 61349121 1.02
clickbench_q30/duckdb:parquet 308928686 308631905 1.00
clickbench_q31/duckdb:parquet 351249610 352421383 1.00
clickbench_q32/duckdb:parquet 🚨 1334243207 1172248218 1.14
clickbench_q33/duckdb:parquet 1431052301 1455040989 0.98
clickbench_q34/duckdb:parquet 🚀 1322333779 1523408269 0.87
clickbench_q35/duckdb:parquet 356957968 384219883 0.93
clickbench_q36/duckdb:parquet 65486302 68697018 0.95
clickbench_q37/duckdb:parquet 53440001 58365392 0.92
clickbench_q38/duckdb:parquet 59706618 63044845 0.95
clickbench_q39/duckdb:parquet 97683073 106752934 0.92
clickbench_q40/duckdb:parquet 56414118 60048517 0.94
clickbench_q41/duckdb:parquet 60019507 64640928 0.93
clickbench_q42/duckdb:parquet 53148403 56805156 0.94
duckdb / duckdb (0.988x ➖, 6↑ 1↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18700168 17403065 1.07
clickbench_q01/duckdb:duckdb 34578492 33970586 1.02
clickbench_q02/duckdb:duckdb 46731351 45404702 1.03
clickbench_q03/duckdb:duckdb 48903433 47451660 1.03
clickbench_q04/duckdb:duckdb 220455887 226211202 0.97
clickbench_q05/duckdb:duckdb 328581791 338409629 0.97
clickbench_q06/duckdb:duckdb 36180747 35052848 1.03
clickbench_q07/duckdb:duckdb 37065993 35830456 1.03
clickbench_q08/duckdb:duckdb 330198379 333917776 0.99
clickbench_q09/duckdb:duckdb 🚀 475578403 542795727 0.88
clickbench_q10/duckdb:duckdb 98889122 101416746 0.98
clickbench_q11/duckdb:duckdb 107652271 107500679 1.00
clickbench_q12/duckdb:duckdb 330482397 358177725 0.92
clickbench_q13/duckdb:duckdb 🚀 570624662 650280122 0.88
clickbench_q14/duckdb:duckdb 🚀 373480643 421564501 0.89
clickbench_q15/duckdb:duckdb 270778026 296042805 0.91
clickbench_q16/duckdb:duckdb 764659274 781137881 0.98
clickbench_q17/duckdb:duckdb 645112784 627923475 1.03
clickbench_q18/duckdb:duckdb 1451674923 1324770895 1.10
clickbench_q19/duckdb:duckdb 37354922 35175220 1.06
clickbench_q20/duckdb:duckdb 🚨 1205706300 1082123852 1.11
clickbench_q21/duckdb:duckdb 1190018661 1188093443 1.00
clickbench_q22/duckdb:duckdb 1207463256 1165941172 1.04
clickbench_q23/duckdb:duckdb 254865094 251345525 1.01
clickbench_q24/duckdb:duckdb 61704658 60782233 1.02
clickbench_q25/duckdb:duckdb 124693019 128248826 0.97
clickbench_q26/duckdb:duckdb 56954048 56790467 1.00
clickbench_q27/duckdb:duckdb 🚀 1037773461 1270720635 0.82
clickbench_q28/duckdb:duckdb 4616281375 4737999014 0.97
clickbench_q29/duckdb:duckdb 50434362 49307790 1.02
clickbench_q30/duckdb:duckdb 283488662 305420392 0.93
clickbench_q31/duckdb:duckdb 🚀 395387817 468333953 0.84
clickbench_q32/duckdb:duckdb 🚀 1525804986 1707222413 0.89
clickbench_q33/duckdb:duckdb 2164636752 2322001819 0.93
clickbench_q34/duckdb:duckdb 2352886103 2302917599 1.02
clickbench_q35/duckdb:duckdb 293314897 269516925 1.09
clickbench_q36/duckdb:duckdb 42805852 41254699 1.04
clickbench_q37/duckdb:duckdb 32805130 32233245 1.02
clickbench_q38/duckdb:duckdb 32302098 31110397 1.04
clickbench_q39/duckdb:duckdb 63643904 63288878 1.01
clickbench_q40/duckdb:duckdb 33366917 32602969 1.02
clickbench_q41/duckdb:duckdb 31056852 31391103 0.99
clickbench_q42/duckdb:duckdb 33082758 32333607 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +47.0% -18.5% +80.4% +568.8% ➖ noise
0 duckdb:duckdb +7.5% -18.5% +31.9% +249.7% ➖ noise
0 duckdb:vortex-file-compressed -9.6% -18.5% +11.0% +290.9% ➖ noise
1 datafusion:vortex-file-compressed +8.8% -7.9% +18.1% +31.2% ➖ noise
1 duckdb:duckdb +1.8% -7.9% +10.6% +59.7% ➖ noise
1 duckdb:vortex-file-compressed -15.0% -7.9% -7.7% +22.2% ➖ noise
2 datafusion:vortex-file-compressed +9.3% -7.0% +17.6% +25.4% ➖ noise
2 duckdb:duckdb +2.9% -7.0% +10.7% +22.7% ➖ noise
2 duckdb:vortex-file-compressed -5.0% -7.0% +2.2% +19.2% ➖ noise
3 datafusion:vortex-file-compressed +13.1% -5.3% +19.4% +131.8% ➖ noise
3 duckdb:duckdb +3.1% -5.3% +8.8% +57.8% ➖ noise
3 duckdb:vortex-file-compressed -8.6% -5.3% -3.5% +34.2% ➖ noise
4 datafusion:vortex-file-compressed +8.3% -12.1% +23.2% +15.3% 🚨 regression
4 duckdb:duckdb -2.5% -12.1% +10.9% +15.3% ➖ noise
4 duckdb:vortex-file-compressed -11.3% -12.1% +1.0% +15.3% ➖ noise
5 datafusion:vortex-file-compressed -0.2% -6.4% +6.6% +15.3% ➖ noise
5 duckdb:duckdb -2.9% -6.4% +3.8% +15.3% ➖ noise
5 duckdb:vortex-file-compressed -13.1% -6.4% -7.2% +15.3% ➖ noise
6 datafusion:vortex-file-compressed -5.4% -11.3% +6.7% +41.4% ➖ noise
6 duckdb:duckdb +3.2% -11.3% +16.4% +27.0% ➖ noise
6 duckdb:vortex-file-compressed -11.4% -11.3% -0.1% +16.0% ➖ noise
7 datafusion:vortex-file-compressed -2.5% -1.4% -1.1% +15.3% ➖ noise
7 duckdb:duckdb +3.4% -1.4% +4.9% +15.3% ➖ noise
7 duckdb:vortex-file-compressed +3.5% -1.4% +4.9% +15.3% ➖ noise
8 datafusion:vortex-file-compressed +0.9% -6.4% +7.8% +15.3% ➖ noise
8 duckdb:duckdb -1.1% -6.4% +5.6% +15.3% ➖ noise
8 duckdb:vortex-file-compressed -9.1% -6.4% -2.9% +15.3% ➖ noise
9 datafusion:vortex-file-compressed -0.6% -3.0% +2.5% +15.3% ➖ noise
9 duckdb:duckdb -12.4% -3.0% -9.7% +15.3% ➖ noise
9 duckdb:vortex-file-compressed -9.1% -3.0% -6.3% +15.3% ➖ noise
10 datafusion:vortex-file-compressed +0.8% -3.2% +4.1% +15.3% ➖ noise
10 duckdb:duckdb -2.5% -3.2% +0.7% +15.3% ➖ noise
10 duckdb:vortex-file-compressed -8.7% -3.2% -5.7% +15.3% ➖ noise
11 datafusion:vortex-file-compressed -3.6% -0.2% -3.4% +15.3% ➖ noise
11 duckdb:duckdb +0.1% -0.2% +0.3% +15.3% ➖ noise
11 duckdb:vortex-file-compressed -6.9% -0.2% -6.7% +15.3% ➖ noise
12 datafusion:vortex-file-compressed -0.8% -2.9% +2.2% +15.3% ➖ noise
12 duckdb:duckdb -7.7% -2.9% -5.0% +15.3% ➖ noise
12 duckdb:vortex-file-compressed -12.8% -2.9% -10.2% +15.3% ➖ noise
13 datafusion:vortex-file-compressed -0.9% -2.2% +1.3% +15.3% ➖ noise
13 duckdb:duckdb -12.2% -2.2% -10.3% +15.3% ➖ noise
13 duckdb:vortex-file-compressed -11.0% -2.2% -8.9% +15.3% ➖ noise
14 datafusion:vortex-file-compressed +1.0% -0.5% +1.5% +15.3% ➖ noise
14 duckdb:duckdb -11.4% -0.5% -10.9% +15.3% ➖ noise
14 duckdb:vortex-file-compressed -10.3% -0.5% -9.8% +15.3% ➖ noise
15 datafusion:vortex-file-compressed +0.2% -1.9% +2.1% +15.3% ➖ noise
15 duckdb:duckdb -8.5% -1.9% -6.8% +15.3% ➖ noise
15 duckdb:vortex-file-compressed +0.0% -1.9% +1.9% +15.3% ➖ noise
16 datafusion:vortex-file-compressed +0.3% -5.4% +6.1% +15.3% ➖ noise
16 duckdb:duckdb -2.1% -5.4% +3.5% +15.3% ➖ noise
16 duckdb:vortex-file-compressed +21.2% -5.4% +28.1% +15.3% 🚨 regression
17 datafusion:vortex-file-compressed +0.7% -7.7% +9.1% +15.3% ➖ noise
17 duckdb:duckdb +2.7% -7.7% +11.3% +15.3% ➖ noise
17 duckdb:vortex-file-compressed +10.7% -7.7% +19.9% +15.3% 🚨 regression
18 datafusion:vortex-file-compressed +2.5% -2.9% +5.5% +15.3% ➖ noise
18 duckdb:duckdb +9.6% -2.9% +12.8% +15.3% ➖ noise
18 duckdb:vortex-file-compressed +5.4% -2.9% +8.5% +15.3% ➖ noise
19 datafusion:vortex-file-compressed +1.3% -0.1% +1.4% +16.7% ➖ noise
19 duckdb:duckdb +6.2% -0.1% +6.3% +15.3% ➖ noise
19 duckdb:vortex-file-compressed +5.1% -0.1% +5.2% +29.8% ➖ noise
20 datafusion:vortex-file-compressed +2.1% -4.2% +6.5% +174.4% ➖ noise
20 duckdb:duckdb +11.4% -4.2% +16.3% +22.4% ➖ noise
20 duckdb:vortex-file-compressed -8.3% -4.2% -4.3% +15.3% ➖ noise
21 datafusion:vortex-file-compressed -0.1% -4.2% +4.3% +15.3% ➖ noise
21 duckdb:duckdb +0.2% -4.2% +4.5% +15.3% ➖ noise
21 duckdb:vortex-file-compressed -2.5% -4.2% +1.8% +15.3% ➖ noise
22 datafusion:vortex-file-compressed +1.2% -4.7% +6.2% +15.3% ➖ noise
22 duckdb:duckdb +3.6% -4.7% +8.7% +15.3% ➖ noise
22 duckdb:vortex-file-compressed -10.8% -4.7% -6.4% +16.4% ➖ noise
23 datafusion:vortex-file-compressed +18.2% -0.4% +18.7% +36.4% ➖ noise
23 duckdb:duckdb +1.4% -0.4% +1.8% +15.3% ➖ noise
23 duckdb:vortex-file-compressed -13.9% -0.4% -13.6% +43.3% ➖ noise
24 datafusion:vortex-file-compressed -0.6% +1.8% -2.4% +23.1% ➖ noise
24 duckdb:duckdb +1.5% +1.8% -0.3% +15.3% ➖ noise
24 duckdb:vortex-file-compressed +22.4% +1.8% +20.3% +42.7% ➖ noise
25 datafusion:vortex-file-compressed -6.5% +2.9% -9.2% +15.3% ➖ noise
25 duckdb:duckdb -2.8% +2.9% -5.5% +15.3% ➖ noise
25 duckdb:vortex-file-compressed +4.0% +2.9% +1.0% +15.3% ➖ noise
26 datafusion:vortex-file-compressed -0.1% +6.0% -5.7% +18.5% ➖ noise
26 duckdb:duckdb +0.3% +6.0% -5.4% +15.3% ➖ noise
26 duckdb:vortex-file-compressed +3.7% +6.0% -2.1% +21.6% ➖ noise
27 datafusion:vortex-file-compressed +3.1% +5.7% -2.4% +15.3% ➖ noise
27 duckdb:duckdb -18.3% +5.7% -22.7% +15.3% ✅ faster
27 duckdb:vortex-file-compressed +16.9% +5.7% +10.6% +15.3% ➖ noise
28 datafusion:vortex-file-compressed +3.5% -0.1% +3.6% +15.3% ➖ noise
28 duckdb:duckdb -2.6% -0.1% -2.5% +15.3% ➖ noise
28 duckdb:vortex-file-compressed +10.0% -0.1% +10.1% +15.3% ➖ noise
29 datafusion:vortex-file-compressed +4.0% -1.2% +5.2% +15.3% ➖ noise
29 duckdb:duckdb +2.3% -1.2% +3.5% +15.3% ➖ noise
29 duckdb:vortex-file-compressed -1.9% -1.2% -0.7% +15.3% ➖ noise
30 datafusion:vortex-file-compressed -17.2% +0.6% -17.6% +15.3% ✅ faster
30 duckdb:duckdb -7.2% +0.6% -7.7% +15.3% ➖ noise
30 duckdb:vortex-file-compressed -1.4% +0.6% -2.0% +15.3% ➖ noise
31 datafusion:vortex-file-compressed -13.8% +0.3% -14.0% +15.3% ✅ faster
31 duckdb:duckdb -15.6% +0.3% -15.8% +15.3% ✅ faster
31 duckdb:vortex-file-compressed -0.1% +0.3% -0.4% +15.3% ➖ noise
32 datafusion:vortex-file-compressed -3.9% +9.3% -12.1% +16.2% ➖ noise
32 duckdb:duckdb -10.6% +9.3% -18.2% +15.3% ✅ faster
32 duckdb:vortex-file-compressed -2.0% +9.3% -10.4% +15.3% ➖ noise
33 datafusion:vortex-file-compressed -14.6% +3.7% -17.6% +16.0% ✅ faster
33 duckdb:duckdb -6.8% +3.7% -10.1% +15.3% ➖ noise
33 duckdb:vortex-file-compressed -0.4% +3.7% -4.0% +15.3% ➖ noise
34 datafusion:vortex-file-compressed -17.3% +2.6% -19.3% +15.3% ✅ faster
34 duckdb:duckdb +2.2% +2.6% -0.4% +15.3% ➖ noise
34 duckdb:vortex-file-compressed -5.3% +2.6% -7.6% +15.3% ➖ noise
35 datafusion:vortex-file-compressed -13.8% +6.2% -18.9% +15.3% ✅ faster
35 duckdb:duckdb +8.8% +6.2% +2.4% +15.3% ➖ noise
35 duckdb:vortex-file-compressed -7.6% +6.2% -13.1% +15.3% ➖ noise
36 datafusion:vortex-file-compressed -12.2% +4.5% -16.0% +15.3% ✅ faster
36 duckdb:duckdb +3.8% +4.5% -0.7% +15.3% ➖ noise
36 duckdb:vortex-file-compressed -12.5% +4.5% -16.2% +15.3% ✅ faster
37 datafusion:vortex-file-compressed -7.6% +0.7% -8.2% +15.3% ➖ noise
37 duckdb:duckdb +1.8% +0.7% +1.1% +15.3% ➖ noise
37 duckdb:vortex-file-compressed -6.4% +0.7% -7.1% +15.3% ➖ noise
38 datafusion:vortex-file-compressed -16.2% +1.8% -17.6% +15.3% ✅ faster
38 duckdb:duckdb +3.8% +1.8% +2.0% +15.3% ➖ noise
38 duckdb:vortex-file-compressed -12.4% +1.8% -13.9% +15.3% ✅ faster
39 datafusion:vortex-file-compressed -9.3% +3.9% -12.7% +15.3% ➖ noise
39 duckdb:duckdb +0.6% +3.9% -3.2% +18.5% ➖ noise
39 duckdb:vortex-file-compressed -5.8% +3.9% -9.3% +15.3% ➖ noise
40 datafusion:vortex-file-compressed -9.9% -0.4% -9.6% +15.3% ➖ noise
40 duckdb:duckdb +2.3% -0.4% +2.7% +15.3% ➖ noise
40 duckdb:vortex-file-compressed -13.4% -0.4% -13.1% +17.3% ➖ noise
41 datafusion:vortex-file-compressed -2.5% -2.4% -0.2% +15.3% ➖ noise
41 duckdb:duckdb -1.1% -2.4% +1.3% +15.3% ➖ noise
41 duckdb:vortex-file-compressed -10.6% -2.4% -8.5% +15.3% ➖ noise
42 datafusion:vortex-file-compressed -11.6% +0.8% -12.3% +15.3% ➖ noise
42 duckdb:duckdb +2.3% +0.8% +1.5% +15.3% ➖ noise
42 duckdb:vortex-file-compressed -2.3% +0.8% -3.1% +15.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

File Sizes: Clickbench on NVME

File Scale Format Base HEAD Change %
hits_16.vortex 1.0 vortex-compact 48.91 MB 0 B 48.91 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.37 MB 0 B 75.37 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.01 MB 0 B 66.01 MB -100.0%
hits_24.vortex 1.0 vortex-compact 44.27 MB 0 B 44.27 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.71 MB 0 B 75.71 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.47 MB 0 B 73.47 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.57 MB 0 B 69.57 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.48 MB 0 B 90.48 MB -100.0%
hits_22.vortex 1.0 vortex-compact 45.47 MB 0 B 45.47 MB -100.0%
hits_98.vortex 1.0 vortex-compact 72.85 MB 0 B 72.85 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.65 MB 0 B 129.65 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.00 MB 0 B 46.00 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.16 MB 0 B 42.16 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.24 MB 0 B 53.24 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.56 MB 0 B 67.56 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.17 MB 0 B 17.17 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.25 MB 0 B 78.25 MB -100.0%
hits_79.vortex 1.0 vortex-compact 85.77 MB 0 B 85.77 MB -100.0%
hits_90.vortex 1.0 vortex-compact 81.85 MB 0 B 81.85 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.19 MB 0 B 61.19 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.50 MB 0 B 66.50 MB -100.0%
hits_20.vortex 1.0 vortex-compact 37.87 MB 0 B 37.87 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.38 MB 0 B 53.38 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.81 MB 0 B 71.81 MB -100.0%
hits_10.vortex 1.0 vortex-compact 50.24 MB 0 B 50.24 MB -100.0%
hits_84.vortex 1.0 vortex-compact 73.39 MB 0 B 73.39 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.08 MB 0 B 64.08 MB -100.0%
hits_44.vortex 1.0 vortex-compact 132.77 MB 0 B 132.77 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.38 MB 0 B 73.38 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.23 MB 0 B 63.23 MB -100.0%
hits_50.vortex 1.0 vortex-compact 113.52 MB 0 B 113.52 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.37 MB 0 B 91.37 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.52 MB 0 B 64.52 MB -100.0%
hits_31.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.36 MB 0 B 117.36 MB -100.0%
hits_49.vortex 1.0 vortex-compact 50.56 MB 0 B 50.56 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.02 MB 0 B 70.02 MB -100.0%
hits_4.vortex 1.0 vortex-compact 72.12 MB 0 B 72.12 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.15 MB 0 B 74.15 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.77 MB 0 B 61.77 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.34 MB 0 B 48.34 MB -100.0%
hits_55.vortex 1.0 vortex-compact 93.47 MB 0 B 93.47 MB -100.0%
hits_11.vortex 1.0 vortex-compact 54.11 MB 0 B 54.11 MB -100.0%
hits_26.vortex 1.0 vortex-compact 72.91 MB 0 B 72.91 MB -100.0%
hits_95.vortex 1.0 vortex-compact 57.98 MB 0 B 57.98 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.16 MB 0 B 63.16 MB -100.0%
hits_75.vortex 1.0 vortex-compact 44.43 MB 0 B 44.43 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.44 MB 0 B 57.44 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.40 MB 0 B 77.40 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.51 MB 0 B 58.51 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.14 MB 0 B 169.14 MB -100.0%
hits_76.vortex 1.0 vortex-compact 76.92 MB 0 B 76.92 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.52 MB 0 B 52.52 MB -100.0%
hits_19.vortex 1.0 vortex-compact 44.60 MB 0 B 44.60 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.43 MB 0 B 51.43 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.09 MB 0 B 129.09 MB -100.0%
hits_23.vortex 1.0 vortex-compact 44.94 MB 0 B 44.94 MB -100.0%
hits_64.vortex 1.0 vortex-compact 53.71 MB 0 B 53.71 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.45 MB 0 B 164.45 MB -100.0%
hits_62.vortex 1.0 vortex-compact 74.82 MB 0 B 74.82 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.29 MB 0 B 63.29 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.23 MB 0 B 64.23 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.15 MB 0 B 95.15 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.23 MB 0 B 54.23 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.60 MB 0 B 68.60 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.52 MB 0 B 83.52 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.05 MB 0 B 61.05 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.29 MB 0 B 94.29 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.76 MB 0 B 118.76 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.41 MB 0 B 118.41 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.66 MB 0 B 59.66 MB -100.0%
hits_33.vortex 1.0 vortex-compact 36.75 MB 0 B 36.75 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_41.vortex 1.0 vortex-compact 165.98 MB 0 B 165.98 MB -100.0%
hits_68.vortex 1.0 vortex-compact 77.23 MB 0 B 77.23 MB -100.0%
hits_73.vortex 1.0 vortex-compact 70.34 MB 0 B 70.34 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.13 MB 0 B 58.13 MB -100.0%
hits_53.vortex 1.0 vortex-compact 62.40 MB 0 B 62.40 MB -100.0%
hits_72.vortex 1.0 vortex-compact 51.85 MB 0 B 51.85 MB -100.0%
hits_13.vortex 1.0 vortex-compact 68.18 MB 0 B 68.18 MB -100.0%
hits_52.vortex 1.0 vortex-compact 64.99 MB 0 B 64.99 MB -100.0%
hits_39.vortex 1.0 vortex-compact 49.59 MB 0 B 49.59 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.84 MB 0 B 65.84 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.70 MB 0 B 69.70 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.83 MB 0 B 90.83 MB -100.0%
hits_29.vortex 1.0 vortex-compact 37.54 MB 0 B 37.54 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.18 MB 0 B 63.18 MB -100.0%
hits_51.vortex 1.0 vortex-compact 167.36 MB 0 B 167.36 MB -100.0%
hits_0.vortex 1.0 vortex-compact 58.43 MB 0 B 58.43 MB -100.0%
hits_67.vortex 1.0 vortex-compact 113.78 MB 0 B 113.78 MB -100.0%
hits_40.vortex 1.0 vortex-compact 75.84 MB 0 B 75.84 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.28 MB 0 B 49.28 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.27 MB 0 B 69.27 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.71 MB 0 B 58.71 MB -100.0%
hits_89.vortex 1.0 vortex-compact 113.85 MB 0 B 113.85 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.56 MB 0 B 97.56 MB -100.0%
hits_32.vortex 1.0 vortex-compact 45.07 MB 0 B 45.07 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.80 MB 0 B 69.80 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.08 MB 0 B 18.08 MB -100.0%
hits_86.vortex 1.0 vortex-compact 48.97 MB 0 B 48.97 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.90 MB 0 B 80.90 MB -100.0%

Totals:

  • vortex-compact: 7.08 GB → 0 B (-100.0%)
  • vortex-file-compressed: 14.65 GB → 14.65 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.0%
Vortex (geomean): 1.066x ➖
Parquet (geomean): 1.035x ➖
Shifts: Parquet (control) +3.5% · Median polish +3.5%


datafusion / vortex-file-compressed (1.035x ➖, 1↑ 4↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 1090052136 714358521 1.53
tpch_q02/datafusion:vortex-file-compressed 🚨 1292700116 622477699 2.08
tpch_q03/datafusion:vortex-file-compressed 1067342589 1057500592 1.01
tpch_q04/datafusion:vortex-file-compressed 610989440 651673989 0.94
tpch_q05/datafusion:vortex-file-compressed 963137497 1347815758 0.71
tpch_q06/datafusion:vortex-file-compressed 597639073 788923266 0.76
tpch_q07/datafusion:vortex-file-compressed 1004739888 1277440992 0.79
tpch_q08/datafusion:vortex-file-compressed 1133258455 1152772378 0.98
tpch_q09/datafusion:vortex-file-compressed 1283550692 1253009613 1.02
tpch_q10/datafusion:vortex-file-compressed 941249317 938069414 1.00
tpch_q11/datafusion:vortex-file-compressed 465509193 507287379 0.92
tpch_q12/datafusion:vortex-file-compressed 933007387 880656782 1.06
tpch_q13/datafusion:vortex-file-compressed 425739335 417562511 1.02
tpch_q14/datafusion:vortex-file-compressed 644167564 604490450 1.07
tpch_q15/datafusion:vortex-file-compressed 1153204710 1061269701 1.09
tpch_q16/datafusion:vortex-file-compressed 312257017 328376742 0.95
tpch_q17/datafusion:vortex-file-compressed 🚨 1543665777 1170250069 1.32
tpch_q18/datafusion:vortex-file-compressed 1536021614 1241689877 1.24
tpch_q19/datafusion:vortex-file-compressed 🚨 1091258795 752271510 1.45
tpch_q20/datafusion:vortex-file-compressed 1272207706 1100816279 1.16
tpch_q21/datafusion:vortex-file-compressed 1786158205 1814210223 0.98
tpch_q22/datafusion:vortex-file-compressed 🚀 432795968 764537501 0.57
datafusion / vortex-compact (1.039x ➖, 0↑ 1↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 671932222 711410625 0.94
tpch_q02/datafusion:vortex-compact 644308985 583707111 1.10
tpch_q03/datafusion:vortex-compact 776869430 677360802 1.15
tpch_q04/datafusion:vortex-compact 528547591 552973019 0.96
tpch_q05/datafusion:vortex-compact 878878730 921620519 0.95
tpch_q06/datafusion:vortex-compact 571999474 588530010 0.97
tpch_q07/datafusion:vortex-compact 977122654 1004167859 0.97
tpch_q08/datafusion:vortex-compact 1061370683 1257852704 0.84
tpch_q09/datafusion:vortex-compact 1200126528 1267407980 0.95
tpch_q10/datafusion:vortex-compact 983773438 939645036 1.05
tpch_q11/datafusion:vortex-compact 397665288 404925398 0.98
tpch_q12/datafusion:vortex-compact 807711882 830441081 0.97
tpch_q13/datafusion:vortex-compact 402176499 401639593 1.00
tpch_q14/datafusion:vortex-compact 593976805 577864380 1.03
tpch_q15/datafusion:vortex-compact 1062321334 1017407336 1.04
tpch_q16/datafusion:vortex-compact 321427277 320972942 1.00
tpch_q17/datafusion:vortex-compact 1129991721 1200510068 0.94
tpch_q18/datafusion:vortex-compact 1099486144 1091611645 1.01
tpch_q19/datafusion:vortex-compact 791705641 823813569 0.96
tpch_q20/datafusion:vortex-compact 1005508304 873545383 1.15
tpch_q21/datafusion:vortex-compact 1978070193 1598088614 1.24
tpch_q22/datafusion:vortex-compact 🚨 1228634503 607799709 2.02
datafusion / parquet (1.017x ➖, 1↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 867000221 817540857 1.06
tpch_q02/datafusion:parquet 🚀 645705964 950609147 0.68
tpch_q03/datafusion:parquet 1031730342 1023325252 1.01
tpch_q04/datafusion:parquet 499809987 464002400 1.08
tpch_q05/datafusion:parquet 1134074543 1140905104 0.99
tpch_q06/datafusion:parquet 521522101 499374430 1.04
tpch_q07/datafusion:parquet 1259696760 1372256648 0.92
tpch_q08/datafusion:parquet 1631099397 1504176228 1.08
tpch_q09/datafusion:parquet 1850583453 1770469984 1.05
tpch_q10/datafusion:parquet 1920188081 1947323127 0.99
tpch_q11/datafusion:parquet 564836229 470360103 1.20
tpch_q12/datafusion:parquet 662387972 676087444 0.98
tpch_q13/datafusion:parquet 673432559 690848280 0.97
tpch_q14/datafusion:parquet 760296723 769708621 0.99
tpch_q15/datafusion:parquet 1161629887 1148310228 1.01
tpch_q16/datafusion:parquet 372532968 360828235 1.03
tpch_q17/datafusion:parquet 1302057642 1379824140 0.94
tpch_q18/datafusion:parquet 1536245631 1460206418 1.05
tpch_q19/datafusion:parquet 1086192112 967680434 1.12
tpch_q20/datafusion:parquet 1216126857 1203207618 1.01
tpch_q21/datafusion:parquet 2080085731 1702348170 1.22
tpch_q22/datafusion:parquet 766749419 714537456 1.07
duckdb / vortex-file-compressed (1.087x ➖, 2↑ 4↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 677913504 708428208 0.96
tpch_q02/duckdb:vortex-file-compressed 1324325357 1311259599 1.01
tpch_q03/duckdb:vortex-file-compressed 1104862413 970939732 1.14
tpch_q04/duckdb:vortex-file-compressed 785518105 669949530 1.17
tpch_q05/duckdb:vortex-file-compressed 1516839156 1175388081 1.29
tpch_q06/duckdb:vortex-file-compressed 🚀 578682790 888063106 0.65
tpch_q07/duckdb:vortex-file-compressed 🚨 1448102106 1076176067 1.35
tpch_q08/duckdb:vortex-file-compressed 1732671061 1498284360 1.16
tpch_q09/duckdb:vortex-file-compressed 1953968259 1509442749 1.29
tpch_q10/duckdb:vortex-file-compressed 🚨 1921198717 1131021433 1.70
tpch_q11/duckdb:vortex-file-compressed 🚨 957811130 683318325 1.40
tpch_q12/duckdb:vortex-file-compressed 🚨 1406280021 808731199 1.74
tpch_q13/duckdb:vortex-file-compressed 1262330183 1077790529 1.17
tpch_q14/duckdb:vortex-file-compressed 683221101 876953995 0.78
tpch_q15/duckdb:vortex-file-compressed 598793704 617677606 0.97
tpch_q16/duckdb:vortex-file-compressed 429325475 531022558 0.81
tpch_q17/duckdb:vortex-file-compressed 1167480969 1095607510 1.07
tpch_q18/duckdb:vortex-file-compressed 1016229286 937863242 1.08
tpch_q19/duckdb:vortex-file-compressed 813449265 780333319 1.04
tpch_q20/duckdb:vortex-file-compressed 1239157248 1280260565 0.97
tpch_q21/duckdb:vortex-file-compressed 2471337667 2063318856 1.20
tpch_q22/duckdb:vortex-file-compressed 🚀 521031453 750066327 0.69
duckdb / vortex-compact (1.105x ➖, 0↑ 4↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 659492016 620261061 1.06
tpch_q02/duckdb:vortex-compact 1137641459 1123718248 1.01
tpch_q03/duckdb:vortex-compact 1019518523 912402107 1.12
tpch_q04/duckdb:vortex-compact 692972525 598443914 1.16
tpch_q05/duckdb:vortex-compact 1338668419 1048018114 1.28
tpch_q06/duckdb:vortex-compact 603698554 816878177 0.74
tpch_q07/duckdb:vortex-compact 1388459630 1092917646 1.27
tpch_q08/duckdb:vortex-compact 🚨 1642901622 1237138544 1.33
tpch_q09/duckdb:vortex-compact 1675313583 1339095776 1.25
tpch_q10/duckdb:vortex-compact 🚨 1687948916 1131551963 1.49
tpch_q11/duckdb:vortex-compact 🚨 981316919 717080245 1.37
tpch_q12/duckdb:vortex-compact 🚨 1110933967 716501839 1.55
tpch_q13/duckdb:vortex-compact 1024307171 855581100 1.20
tpch_q14/duckdb:vortex-compact 675679044 888697546 0.76
tpch_q15/duckdb:vortex-compact 557660477 572169658 0.97
tpch_q16/duckdb:vortex-compact 405568121 436638779 0.93
tpch_q17/duckdb:vortex-compact 1148136311 959854948 1.20
tpch_q18/duckdb:vortex-compact 763417424 714231391 1.07
tpch_q19/duckdb:vortex-compact 789142883 773856710 1.02
tpch_q20/duckdb:vortex-compact 1226299853 1161060735 1.06
tpch_q21/duckdb:vortex-compact 2369006794 1851726119 1.28
tpch_q22/duckdb:vortex-compact 475510007 676185599 0.70
duckdb / parquet (1.054x ➖, 0↑ 1↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 995216288 1024016314 0.97
tpch_q02/duckdb:parquet 1491131431 1578462248 0.94
tpch_q03/duckdb:parquet 1852856521 1689989703 1.10
tpch_q04/duckdb:parquet 1154976173 1182315652 0.98
tpch_q05/duckdb:parquet 2347696746 2164758910 1.08
tpch_q06/duckdb:parquet 868488262 899521656 0.97
tpch_q07/duckdb:parquet 1883773919 1934465598 0.97
tpch_q08/duckdb:parquet 2580001300 2370105457 1.09
tpch_q09/duckdb:parquet 2499905282 2323823396 1.08
tpch_q10/duckdb:parquet 3575573107 3100203236 1.15
tpch_q11/duckdb:parquet 1073889677 1009255010 1.06
tpch_q12/duckdb:parquet 1199988085 1090609664 1.10
tpch_q13/duckdb:parquet 1317632052 1305396464 1.01
tpch_q14/duckdb:parquet 1381549810 1218072556 1.13
tpch_q15/duckdb:parquet 1011946630 889527912 1.14
tpch_q16/duckdb:parquet 🚨 914723353 660246922 1.39
tpch_q17/duckdb:parquet 1292000694 1300948036 0.99
tpch_q18/duckdb:parquet 1529192658 1377322443 1.11
tpch_q19/duckdb:parquet 1631574755 1581715000 1.03
tpch_q20/duckdb:parquet 1709306480 1713011672 1.00
tpch_q21/duckdb:parquet 2011752101 1893494768 1.06
tpch_q22/duckdb:parquet 1085912387 1185866089 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.5% +1.5% -7.0% +75.9% ➖ noise
1 datafusion:vortex-file-compressed +52.6% +1.5% +50.3% +126.4% ➖ noise
1 duckdb:vortex-compact +6.3% +1.5% +4.7% +41.4% ➖ noise
1 duckdb:vortex-file-compressed -4.3% +1.5% -5.7% +31.1% ➖ noise
2 datafusion:vortex-compact +10.4% -19.9% +37.8% +68.8% ➖ noise
2 datafusion:vortex-file-compressed +107.7% -19.9% +159.2% +73.3% 🚨 regression
2 duckdb:vortex-compact +1.2% -19.9% +26.4% +60.2% ➖ noise
2 duckdb:vortex-file-compressed +1.0% -19.9% +26.1% +45.7% ➖ noise
3 datafusion:vortex-compact +14.7% +5.1% +9.1% +83.0% ➖ noise
3 datafusion:vortex-file-compressed +0.9% +5.1% -4.0% +72.9% ➖ noise
3 duckdb:vortex-compact +11.7% +5.1% +6.3% +71.3% ➖ noise
3 duckdb:vortex-file-compressed +13.8% +5.1% +8.2% +80.2% ➖ noise
4 datafusion:vortex-compact -4.4% +2.6% -6.8% +53.5% ➖ noise
4 datafusion:vortex-file-compressed -6.2% +2.6% -8.6% +68.2% ➖ noise
4 duckdb:vortex-compact +15.8% +2.6% +12.9% +56.1% ➖ noise
4 duckdb:vortex-file-compressed +17.3% +2.6% +14.3% +30.4% ➖ noise
5 datafusion:vortex-compact -4.6% +3.8% -8.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -28.5% +3.8% -31.2% +30.0% ✅ faster
5 duckdb:vortex-compact +27.7% +3.8% +23.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +29.1% +3.8% +24.3% +30.0% ➖ noise
6 datafusion:vortex-compact -2.8% +0.4% -3.2% +30.8% ➖ noise
6 datafusion:vortex-file-compressed -24.2% +0.4% -24.6% +35.2% ➖ noise
6 duckdb:vortex-compact -26.1% +0.4% -26.4% +36.0% ➖ noise
6 duckdb:vortex-file-compressed -34.8% +0.4% -35.1% +30.0% ✅ faster
7 datafusion:vortex-compact -2.7% -5.5% +2.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -21.3% -5.5% -16.8% +30.0% ➖ noise
7 duckdb:vortex-compact +27.0% -5.5% +34.4% +30.0% 🚨 regression
7 duckdb:vortex-file-compressed +34.6% -5.5% +42.3% +30.0% 🚨 regression
8 datafusion:vortex-compact -15.6% +8.6% -22.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -1.7% +8.6% -9.5% +32.0% ➖ noise
8 duckdb:vortex-compact +32.8% +8.6% +22.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +15.6% +8.6% +6.4% +30.0% ➖ noise
9 datafusion:vortex-compact -5.3% +6.0% -10.7% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +2.4% +6.0% -3.4% +30.0% ➖ noise
9 duckdb:vortex-compact +25.1% +6.0% +18.0% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +29.4% +6.0% +22.1% +30.0% ➖ noise
10 datafusion:vortex-compact +4.7% +6.6% -1.8% +37.9% ➖ noise
10 datafusion:vortex-file-compressed +0.3% +6.6% -5.9% +37.7% ➖ noise
10 duckdb:vortex-compact +49.2% +6.6% +39.9% +37.9% 🚨 regression
10 duckdb:vortex-file-compressed +69.9% +6.6% +59.3% +51.0% 🚨 regression
11 datafusion:vortex-compact -1.8% +13.0% -13.1% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -8.2% +13.0% -18.8% +30.0% ➖ noise
11 duckdb:vortex-compact +36.8% +13.0% +21.1% +37.2% ➖ noise
11 duckdb:vortex-file-compressed +40.2% +13.0% +24.0% +30.0% ➖ noise
12 datafusion:vortex-compact -2.7% +3.8% -6.3% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +5.9% +3.8% +2.0% +30.0% ➖ noise
12 duckdb:vortex-compact +55.0% +3.8% +49.3% +33.8% 🚨 regression
12 duckdb:vortex-file-compressed +73.9% +3.8% +67.5% +30.0% 🚨 regression
13 datafusion:vortex-compact +0.1% -0.8% +0.9% +84.6% ➖ noise
13 datafusion:vortex-file-compressed +2.0% -0.8% +2.8% +47.3% ➖ noise
13 duckdb:vortex-compact +19.7% -0.8% +20.7% +72.3% ➖ noise
13 duckdb:vortex-file-compressed +17.1% -0.8% +18.1% +72.4% ➖ noise
14 datafusion:vortex-compact +2.8% +5.8% -2.9% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +6.6% +5.8% +0.7% +30.0% ➖ noise
14 duckdb:vortex-compact -24.0% +5.8% -28.2% +35.4% ✅ faster
14 duckdb:vortex-file-compressed -22.1% +5.8% -26.4% +30.0% ✅ faster
15 datafusion:vortex-compact +4.4% +7.3% -2.7% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +8.7% +7.3% +1.3% +30.0% ➖ noise
15 duckdb:vortex-compact -2.5% +7.3% -9.1% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -3.1% +7.3% -9.6% +30.0% ➖ noise
16 datafusion:vortex-compact +0.1% +19.6% -16.3% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -4.9% +19.6% -20.5% +30.1% ➖ noise
16 duckdb:vortex-compact -7.1% +19.6% -22.3% +30.5% ➖ noise
16 duckdb:vortex-file-compressed -19.2% +19.6% -32.4% +46.2% ✅ faster
17 datafusion:vortex-compact -5.9% -3.2% -2.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +31.9% -3.2% +36.3% +30.0% 🚨 regression
17 duckdb:vortex-compact +19.6% -3.2% +23.6% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +6.6% -3.2% +10.1% +30.0% ➖ noise
18 datafusion:vortex-compact +0.7% +8.1% -6.8% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +23.7% +8.1% +14.5% +30.0% ➖ noise
18 duckdb:vortex-compact +6.9% +8.1% -1.1% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +8.4% +8.1% +0.3% +30.0% ➖ noise
19 datafusion:vortex-compact -3.9% +7.6% -10.7% +36.4% ➖ noise
19 datafusion:vortex-file-compressed +45.1% +7.6% +34.8% +31.5% 🚨 regression
19 duckdb:vortex-compact +2.0% +7.6% -5.2% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +4.2% +7.6% -3.1% +30.0% ➖ noise
20 datafusion:vortex-compact +15.1% +0.4% +14.6% +41.2% ➖ noise
20 datafusion:vortex-file-compressed +15.6% +0.4% +15.1% +30.0% ➖ noise
20 duckdb:vortex-compact +5.6% +0.4% +5.2% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -3.2% +0.4% -3.6% +30.0% ➖ noise
21 datafusion:vortex-compact +23.8% +13.9% +8.6% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -1.5% +13.9% -13.6% +30.0% ➖ noise
21 duckdb:vortex-compact +27.9% +13.9% +12.3% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +19.8% +13.9% +5.1% +30.0% ➖ noise
22 datafusion:vortex-compact +102.1% -0.9% +103.9% +127.6% ➖ noise
22 datafusion:vortex-file-compressed -43.4% -0.9% -42.9% +78.1% ➖ noise
22 duckdb:vortex-compact -29.7% -0.9% -29.1% +46.5% ➖ noise
22 duckdb:vortex-file-compressed -30.5% -0.9% -29.9% +80.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +6.9%
Vortex (geomean): 1.080x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.3%


datafusion / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 30072476 27679936 1.09
tpcds_q02/datafusion:vortex-file-compressed 54709254 53432712 1.02
tpcds_q03/datafusion:vortex-file-compressed 20592872 19984637 1.03
tpcds_q04/datafusion:vortex-file-compressed 291924873 291666417 1.00
tpcds_q05/datafusion:vortex-file-compressed 53595198 53867259 0.99
tpcds_q06/datafusion:vortex-file-compressed 50853789 51366755 0.99
tpcds_q07/datafusion:vortex-file-compressed 53545839 49388128 1.08
tpcds_q08/datafusion:vortex-file-compressed 38314884 38466857 1.00
tpcds_q09/datafusion:vortex-file-compressed 54876357 54341176 1.01
tpcds_q10/datafusion:vortex-file-compressed 46726987 46584167 1.00
tpcds_q11/datafusion:vortex-file-compressed 164739493 166396135 0.99
tpcds_q12/datafusion:vortex-file-compressed 21759788 23827074 0.91
tpcds_q13/datafusion:vortex-file-compressed 61275233 60951188 1.01
tpcds_q14/datafusion:vortex-file-compressed 203447712 200738151 1.01
tpcds_q15/datafusion:vortex-file-compressed 34812271 33926145 1.03
tpcds_q16/datafusion:vortex-file-compressed 28780888 27478842 1.05
tpcds_q17/datafusion:vortex-file-compressed 67924990 66547513 1.02
tpcds_q18/datafusion:vortex-file-compressed 76821135 79328118 0.97
tpcds_q19/datafusion:vortex-file-compressed 32197173 31455536 1.02
tpcds_q20/datafusion:vortex-file-compressed 25125687 25585624 0.98
tpcds_q21/datafusion:vortex-file-compressed 140019847 134427998 1.04
tpcds_q22/datafusion:vortex-file-compressed 58517779 56009137 1.04
tpcds_q23/datafusion:vortex-file-compressed 148769223 149492697 1.00
tpcds_q24/datafusion:vortex-file-compressed 111783073 112315837 1.00
tpcds_q25/datafusion:vortex-file-compressed 68059876 67815279 1.00
tpcds_q26/datafusion:vortex-file-compressed 35765751 36046168 0.99
tpcds_q27/datafusion:vortex-file-compressed 121756623 119254785 1.02
tpcds_q28/datafusion:vortex-file-compressed 49921968 48243242 1.03
tpcds_q29/datafusion:vortex-file-compressed 66702153 69691915 0.96
tpcds_q30/datafusion:vortex-file-compressed 30277557 29955969 1.01
tpcds_q31/datafusion:vortex-file-compressed 97076423 98144600 0.99
tpcds_q32/datafusion:vortex-file-compressed 21346957 21219983 1.01
tpcds_q33/datafusion:vortex-file-compressed 40064134 39997615 1.00
tpcds_q34/datafusion:vortex-file-compressed 33835111 33840718 1.00
tpcds_q35/datafusion:vortex-file-compressed 57003806 56793921 1.00
tpcds_q36/datafusion:vortex-file-compressed 76627112 75344952 1.02
tpcds_q37/datafusion:vortex-file-compressed 33518163 34288066 0.98
tpcds_q38/datafusion:vortex-file-compressed 52110237 54564435 0.96
tpcds_q39/datafusion:vortex-file-compressed 146766714 148424414 0.99
tpcds_q40/datafusion:vortex-file-compressed 53692110 52866877 1.02
tpcds_q41/datafusion:vortex-file-compressed 18087189 17766548 1.02
tpcds_q42/datafusion:vortex-file-compressed 18858013 19612799 0.96
tpcds_q43/datafusion:vortex-file-compressed 33435673 32812297 1.02
tpcds_q44/datafusion:vortex-file-compressed 45726060 45761356 1.00
tpcds_q45/datafusion:vortex-file-compressed 34345744 33816902 1.02
tpcds_q46/datafusion:vortex-file-compressed 49172481 50458479 0.97
tpcds_q47/datafusion:vortex-file-compressed 205267591 205700219 1.00
tpcds_q48/datafusion:vortex-file-compressed 47583412 48691764 0.98
tpcds_q49/datafusion:vortex-file-compressed 70112207 70377374 1.00
tpcds_q50/datafusion:vortex-file-compressed 48296604 45690144 1.06
tpcds_q51/datafusion:vortex-file-compressed 89374643 90159761 0.99
tpcds_q52/datafusion:vortex-file-compressed 18610656 18256900 1.02
tpcds_q53/datafusion:vortex-file-compressed 25391451 26425012 0.96
tpcds_q54/datafusion:vortex-file-compressed 46218429 45641504 1.01
tpcds_q55/datafusion:vortex-file-compressed 18657722 19009876 0.98
tpcds_q56/datafusion:vortex-file-compressed 41174757 41697143 0.99
tpcds_q57/datafusion:vortex-file-compressed 123923074 126368100 0.98
tpcds_q58/datafusion:vortex-file-compressed 70106397 70281377 1.00
tpcds_q59/datafusion:vortex-file-compressed 73132185 73377509 1.00
tpcds_q60/datafusion:vortex-file-compressed 40289682 42141691 0.96
tpcds_q61/datafusion:vortex-file-compressed 50965935 53195424 0.96
tpcds_q62/datafusion:vortex-file-compressed 30568983 31729385 0.96
tpcds_q63/datafusion:vortex-file-compressed 27018786 26191897 1.03
tpcds_q64/datafusion:vortex-file-compressed 479797725 476152404 1.01
tpcds_q65/datafusion:vortex-file-compressed 50419800 48760838 1.03
tpcds_q66/datafusion:vortex-file-compressed 96118680 90069418 1.07
tpcds_q67/datafusion:vortex-file-compressed 118555124 119095346 1.00
tpcds_q68/datafusion:vortex-file-compressed 46813301 47773808 0.98
tpcds_q69/datafusion:vortex-file-compressed 46152624 43520866 1.06
tpcds_q70/datafusion:vortex-file-compressed 120170070 111527154 1.08
tpcds_q71/datafusion:vortex-file-compressed 32044908 33070490 0.97
tpcds_q72/datafusion:vortex-file-compressed 2566169980 2614094137 0.98
tpcds_q73/datafusion:vortex-file-compressed 35433663 36397162 0.97
tpcds_q74/datafusion:vortex-file-compressed 116384972 117006449 0.99
tpcds_q75/datafusion:vortex-file-compressed 121516938 120800888 1.01
tpcds_q76/datafusion:vortex-file-compressed 35383211 34589065 1.02
tpcds_q77/datafusion:vortex-file-compressed 50115769 51057984 0.98
tpcds_q78/datafusion:vortex-file-compressed 124791360 126153548 0.99
tpcds_q79/datafusion:vortex-file-compressed 39342888 40675755 0.97
tpcds_q80/datafusion:vortex-file-compressed 116339063 117170821 0.99
tpcds_q81/datafusion:vortex-file-compressed 36651210 35743106 1.03
tpcds_q82/datafusion:vortex-file-compressed 35377087 34933383 1.01
tpcds_q83/datafusion:vortex-file-compressed 48534421 51517247 0.94
tpcds_q84/datafusion:vortex-file-compressed 15426698 14623023 1.05
tpcds_q85/datafusion:vortex-file-compressed 99584085 100447469 0.99
tpcds_q86/datafusion:vortex-file-compressed 18760689 18334030 1.02
tpcds_q87/datafusion:vortex-file-compressed 54469068 54983616 0.99
tpcds_q88/datafusion:vortex-file-compressed 82088596 83864718 0.98
tpcds_q89/datafusion:vortex-file-compressed 36777690 36232167 1.02
tpcds_q90/datafusion:vortex-file-compressed 17868237 18637607 0.96
tpcds_q91/datafusion:vortex-file-compressed 26516003 25339716 1.05
tpcds_q92/datafusion:vortex-file-compressed 18793540 19070228 0.99
tpcds_q93/datafusion:vortex-file-compressed 34193571 35141723 0.97
tpcds_q94/datafusion:vortex-file-compressed 24706112 24702171 1.00
tpcds_q95/datafusion:vortex-file-compressed 60249392 60206398 1.00
tpcds_q96/datafusion:vortex-file-compressed 18412162 18423935 1.00
tpcds_q97/datafusion:vortex-file-compressed 31542358 31888635 0.99
tpcds_q98/datafusion:vortex-file-compressed 33764548 33944556 0.99
tpcds_q99/datafusion:vortex-file-compressed 47255926 46566588 1.01
datafusion / vortex-compact (1.000x ➖, 0↑ 0↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 36828026 35790665 1.03
tpcds_q02/datafusion:vortex-compact 57182188 57746671 0.99
tpcds_q03/datafusion:vortex-compact 25356713 25139124 1.01
tpcds_q04/datafusion:vortex-compact 325030277 329196328 0.99
tpcds_q05/datafusion:vortex-compact 63741317 67879849 0.94
tpcds_q06/datafusion:vortex-compact 56980898 57857653 0.98
tpcds_q07/datafusion:vortex-compact 65386608 65241941 1.00
tpcds_q08/datafusion:vortex-compact 45369923 45308950 1.00
tpcds_q09/datafusion:vortex-compact 102745070 104336976 0.98
tpcds_q10/datafusion:vortex-compact 61345276 61983449 0.99
tpcds_q11/datafusion:vortex-compact 185882822 186831344 0.99
tpcds_q12/datafusion:vortex-compact 25317033 25453416 0.99
tpcds_q13/datafusion:vortex-compact 128393749 132669787 0.97
tpcds_q14/datafusion:vortex-compact 252362465 253395952 1.00
tpcds_q15/datafusion:vortex-compact 37427681 39065809 0.96
tpcds_q16/datafusion:vortex-compact 38575913 39157101 0.99
tpcds_q17/datafusion:vortex-compact 93724312 92458471 1.01
tpcds_q18/datafusion:vortex-compact 92448957 92704408 1.00
tpcds_q19/datafusion:vortex-compact 42677772 41635471 1.03
tpcds_q20/datafusion:vortex-compact 29376984 30029844 0.98
tpcds_q21/datafusion:vortex-compact 141763950 137014023 1.03
tpcds_q22/datafusion:vortex-compact 65117511 63761093 1.02
tpcds_q23/datafusion:vortex-compact 182227800 184096070 0.99
tpcds_q24/datafusion:vortex-compact 139646032 136192520 1.03
tpcds_q25/datafusion:vortex-compact 97242532 93381193 1.04
tpcds_q26/datafusion:vortex-compact 46781678 46088926 1.02
tpcds_q27/datafusion:vortex-compact 154698803 154348079 1.00
tpcds_q28/datafusion:vortex-compact 97940891 98982691 0.99
tpcds_q29/datafusion:vortex-compact 93542127 93721962 1.00
tpcds_q30/datafusion:vortex-compact 38577256 36585990 1.05
tpcds_q31/datafusion:vortex-compact 123739760 123356769 1.00
tpcds_q32/datafusion:vortex-compact 26948597 26369932 1.02
tpcds_q33/datafusion:vortex-compact 52180799 52205666 1.00
tpcds_q34/datafusion:vortex-compact 48182994 48991538 0.98
tpcds_q35/datafusion:vortex-compact 68698334 68909452 1.00
tpcds_q36/datafusion:vortex-compact 94338108 97821353 0.96
tpcds_q37/datafusion:vortex-compact 46260187 46129207 1.00
tpcds_q38/datafusion:vortex-compact 67077377 64507412 1.04
tpcds_q39/datafusion:vortex-compact 154589264 152413116 1.01
tpcds_q40/datafusion:vortex-compact 58229022 58466965 1.00
tpcds_q41/datafusion:vortex-compact 19375463 19658426 0.99
tpcds_q42/datafusion:vortex-compact 24956676 24020413 1.04
tpcds_q43/datafusion:vortex-compact 38847502 38992491 1.00
tpcds_q44/datafusion:vortex-compact 77466695 77421828 1.00
tpcds_q45/datafusion:vortex-compact 37358496 37594105 0.99
tpcds_q46/datafusion:vortex-compact 67982040 69021488 0.98
tpcds_q47/datafusion:vortex-compact 228037115 225252308 1.01
tpcds_q48/datafusion:vortex-compact 97492056 100759572 0.97
tpcds_q49/datafusion:vortex-compact 98001915 97550272 1.00
tpcds_q50/datafusion:vortex-compact 65125002 61836307 1.05
tpcds_q51/datafusion:vortex-compact 96598744 98119514 0.98
tpcds_q52/datafusion:vortex-compact 24141743 25123896 0.96
tpcds_q53/datafusion:vortex-compact 34435478 33262842 1.04
tpcds_q54/datafusion:vortex-compact 56649878 57312276 0.99
tpcds_q55/datafusion:vortex-compact 24420631 23312690 1.05
tpcds_q56/datafusion:vortex-compact 54569576 53381650 1.02
tpcds_q57/datafusion:vortex-compact 142641472 139859424 1.02
tpcds_q58/datafusion:vortex-compact 76291350 75683734 1.01
tpcds_q59/datafusion:vortex-compact 86828574 85116938 1.02
tpcds_q60/datafusion:vortex-compact 55017766 54366082 1.01
tpcds_q61/datafusion:vortex-compact 70761986 70864905 1.00
tpcds_q62/datafusion:vortex-compact 33242352 31979429 1.04
tpcds_q63/datafusion:vortex-compact 35550995 34439215 1.03
tpcds_q64/datafusion:vortex-compact 539380342 536544312 1.01
tpcds_q65/datafusion:vortex-compact 64960059 65971693 0.98
tpcds_q66/datafusion:vortex-compact 95328910 96955180 0.98
tpcds_q67/datafusion:vortex-compact 123778408 128169357 0.97
tpcds_q68/datafusion:vortex-compact 68919392 68235978 1.01
tpcds_q69/datafusion:vortex-compact 59752136 60068553 0.99
tpcds_q70/datafusion:vortex-compact 124612160 122770025 1.02
tpcds_q71/datafusion:vortex-compact 45881949 45291892 1.01
tpcds_q72/datafusion:vortex-compact 2567672661 2601800138 0.99
tpcds_q73/datafusion:vortex-compact 49025189 48882997 1.00
tpcds_q74/datafusion:vortex-compact 131285728 134155066 0.98
tpcds_q75/datafusion:vortex-compact 162316043 161917388 1.00
tpcds_q76/datafusion:vortex-compact 51366376 50368992 1.02
tpcds_q77/datafusion:vortex-compact 65850993 68327422 0.96
tpcds_q78/datafusion:vortex-compact 147310487 147928126 1.00
tpcds_q79/datafusion:vortex-compact 56200459 57449283 0.98
tpcds_q80/datafusion:vortex-compact 129894776 128842644 1.01
tpcds_q81/datafusion:vortex-compact 42115534 41919159 1.00
tpcds_q82/datafusion:vortex-compact 48135870 48327261 1.00
tpcds_q83/datafusion:vortex-compact 57007381 57976886 0.98
tpcds_q84/datafusion:vortex-compact 18022223 18779425 0.96
tpcds_q85/datafusion:vortex-compact 125612794 126611172 0.99
tpcds_q86/datafusion:vortex-compact 19087917 19571180 0.98
tpcds_q87/datafusion:vortex-compact 65520151 64146277 1.02
tpcds_q88/datafusion:vortex-compact 134062279 134209968 1.00
tpcds_q89/datafusion:vortex-compact 44355093 43367324 1.02
tpcds_q90/datafusion:vortex-compact 24291516 24536737 0.99
tpcds_q91/datafusion:vortex-compact 39774979 42166894 0.94
tpcds_q92/datafusion:vortex-compact 20547697 20592835 1.00
tpcds_q93/datafusion:vortex-compact 47567520 46895118 1.01
tpcds_q94/datafusion:vortex-compact 30920171 30610841 1.01
tpcds_q95/datafusion:vortex-compact 72108305 71408407 1.01
tpcds_q96/datafusion:vortex-compact 25890544 25479581 1.02
tpcds_q97/datafusion:vortex-compact 40750358 40331802 1.01
tpcds_q98/datafusion:vortex-compact 37258463 38083817 0.98
tpcds_q99/datafusion:vortex-compact 48389079 48398043 1.00
datafusion / parquet (0.990x ➖, 1↑ 1↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 35541778 36940966 0.96
tpcds_q02/datafusion:parquet 45291078 46371040 0.98
tpcds_q03/datafusion:parquet 15218063 14768441 1.03
tpcds_q04/datafusion:parquet 312488520 327361766 0.95
tpcds_q05/datafusion:parquet 49901072 53594022 0.93
tpcds_q06/datafusion:parquet 64643874 63662709 1.02
tpcds_q07/datafusion:parquet 94056387 87120767 1.08
tpcds_q08/datafusion:parquet 🚨 35457361 31634678 1.12
tpcds_q09/datafusion:parquet 60111673 57667396 1.04
tpcds_q10/datafusion:parquet 82617156 81104338 1.02
tpcds_q11/datafusion:parquet 177324854 177421759 1.00
tpcds_q12/datafusion:parquet 22357760 22598288 0.99
tpcds_q13/datafusion:parquet 86209147 87843264 0.98
tpcds_q14/datafusion:parquet 190922776 205491663 0.93
tpcds_q15/datafusion:parquet 25068698 26337614 0.95
tpcds_q16/datafusion:parquet 27665208 29383055 0.94
tpcds_q17/datafusion:parquet 70245500 71197676 0.99
tpcds_q18/datafusion:parquet 130069866 130694054 1.00
tpcds_q19/datafusion:parquet 28365813 27612186 1.03
tpcds_q20/datafusion:parquet 21331029 21299324 1.00
tpcds_q21/datafusion:parquet 22219761 22449448 0.99
tpcds_q22/datafusion:parquet 🚀 129170004 150734018 0.86
tpcds_q23/datafusion:parquet 165298333 165452865 1.00
tpcds_q24/datafusion:parquet 104036112 105981758 0.98
tpcds_q25/datafusion:parquet 72746118 72274582 1.01
tpcds_q26/datafusion:parquet 76184494 77861353 0.98
tpcds_q27/datafusion:parquet 164025188 163972976 1.00
tpcds_q28/datafusion:parquet 48008663 49409287 0.97
tpcds_q29/datafusion:parquet 71986241 72879389 0.99
tpcds_q30/datafusion:parquet 44760493 44234004 1.01
tpcds_q31/datafusion:parquet 76177291 75928875 1.00
tpcds_q32/datafusion:parquet 23317097 22324543 1.04
tpcds_q33/datafusion:parquet 34855081 35298733 0.99
tpcds_q34/datafusion:parquet 27119191 26869102 1.01
tpcds_q35/datafusion:parquet 84298982 85396121 0.99
tpcds_q36/datafusion:parquet 64879887 66413985 0.98
tpcds_q37/datafusion:parquet 23026721 23304515 0.99
tpcds_q38/datafusion:parquet 51061909 50881156 1.00
tpcds_q39/datafusion:parquet 83057842 84656111 0.98
tpcds_q40/datafusion:parquet 27728746 29593996 0.94
tpcds_q41/datafusion:parquet 15521556 15756838 0.99
tpcds_q42/datafusion:parquet 13908080 13942360 1.00
tpcds_q43/datafusion:parquet 18849821 20230561 0.93
tpcds_q44/datafusion:parquet 41343331 40787771 1.01
tpcds_q45/datafusion:parquet 32179348 33376617 0.96
tpcds_q46/datafusion:parquet 39184167 38052275 1.03
tpcds_q47/datafusion:parquet 135834750 135621502 1.00
tpcds_q48/datafusion:parquet 81015825 81196214 1.00
tpcds_q49/datafusion:parquet 65844916 67349650 0.98
tpcds_q50/datafusion:parquet 47791597 49675801 0.96
tpcds_q51/datafusion:parquet 90449469 89520355 1.01
tpcds_q52/datafusion:parquet 14188162 14311773 0.99
tpcds_q53/datafusion:parquet 21594266 22486095 0.96
tpcds_q54/datafusion:parquet 42391255 43067549 0.98
tpcds_q55/datafusion:parquet 13966869 14408144 0.97
tpcds_q56/datafusion:parquet 35157999 35598260 0.99
tpcds_q57/datafusion:parquet 106372466 113884848 0.93
tpcds_q58/datafusion:parquet 56715615 57949378 0.98
tpcds_q59/datafusion:parquet 57652170 58000752 0.99
tpcds_q60/datafusion:parquet 36041618 36343617 0.99
tpcds_q61/datafusion:parquet 49389686 49867600 0.99
tpcds_q62/datafusion:parquet 27847230 28923435 0.96
tpcds_q63/datafusion:parquet 21246977 22408023 0.95
tpcds_q64/datafusion:parquet 548905216 548474214 1.00
tpcds_q65/datafusion:parquet 43915960 45930974 0.96
tpcds_q66/datafusion:parquet 77175654 81961628 0.94
tpcds_q67/datafusion:parquet 151565031 154358420 0.98
tpcds_q68/datafusion:parquet 39794117 40468835 0.98
tpcds_q69/datafusion:parquet 79331158 78060338 1.02
tpcds_q70/datafusion:parquet 96988302 95376209 1.02
tpcds_q71/datafusion:parquet 26813081 26420356 1.01
tpcds_q72/datafusion:parquet 635116893 630015283 1.01
tpcds_q73/datafusion:parquet 27689726 26082281 1.06
tpcds_q74/datafusion:parquet 105814838 105886848 1.00
tpcds_q75/datafusion:parquet 116720875 115391179 1.01
tpcds_q76/datafusion:parquet 35022251 35338823 0.99
tpcds_q77/datafusion:parquet 49709575 51014626 0.97
tpcds_q78/datafusion:parquet 125724207 122555254 1.03
tpcds_q79/datafusion:parquet 32061327 31065252 1.03
tpcds_q80/datafusion:parquet 94843403 94012704 1.01
tpcds_q81/datafusion:parquet 38834370 40549243 0.96
tpcds_q82/datafusion:parquet 22844820 24448157 0.93
tpcds_q83/datafusion:parquet 46054304 48003227 0.96
tpcds_q84/datafusion:parquet 47567440 47863361 0.99
tpcds_q85/datafusion:parquet 172448645 171410180 1.01
tpcds_q86/datafusion:parquet 17466960 17620202 0.99
tpcds_q87/datafusion:parquet 50312584 50320213 1.00
tpcds_q88/datafusion:parquet 69730884 70666776 0.99
tpcds_q89/datafusion:parquet 24829146 23837403 1.04
tpcds_q90/datafusion:parquet 18815505 19615020 0.96
tpcds_q91/datafusion:parquet 69286556 72322070 0.96
tpcds_q92/datafusion:parquet 21897548 21249464 1.03
tpcds_q93/datafusion:parquet 34357893 35970766 0.96
tpcds_q94/datafusion:parquet 26090303 25431780 1.03
tpcds_q95/datafusion:parquet 67954176 67973259 1.00
tpcds_q96/datafusion:parquet 14620788 14782347 0.99
tpcds_q97/datafusion:parquet 35056226 32975914 1.06
tpcds_q98/datafusion:parquet 26198746 25402324 1.03
tpcds_q99/datafusion:parquet 28412921 30092043 0.94
duckdb / vortex-file-compressed (1.138x ❌, 18↑ 38↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚀 18651692 26534076 0.70
tpcds_q02/duckdb:vortex-file-compressed 🚨 90304534 80460220 1.12
tpcds_q03/duckdb:vortex-file-compressed 23260178 24903465 0.93
tpcds_q04/duckdb:vortex-file-compressed 🚀 87627603 108702302 0.81
tpcds_q05/duckdb:vortex-file-compressed 104226515 102000641 1.02
tpcds_q06/duckdb:vortex-file-compressed 35004560 36119989 0.97
tpcds_q07/duckdb:vortex-file-compressed 🚨 29514389 24604183 1.20
tpcds_q08/duckdb:vortex-file-compressed 🚨 36210297 23980497 1.51
tpcds_q09/duckdb:vortex-file-compressed 🚀 15788290 39497974 0.40
tpcds_q10/duckdb:vortex-file-compressed 39924784 37712357 1.06
tpcds_q11/duckdb:vortex-file-compressed 🚀 47245875 64356270 0.73
tpcds_q12/duckdb:vortex-file-compressed 14088564 14075360 1.00
tpcds_q13/duckdb:vortex-file-compressed 🚨 55196566 33330634 1.66
tpcds_q14/duckdb:vortex-file-compressed 🚨 241474669 198678709 1.22
tpcds_q15/duckdb:vortex-file-compressed 🚀 26881486 41821356 0.64
tpcds_q16/duckdb:vortex-file-compressed 🚨 36925109 30096550 1.23
tpcds_q17/duckdb:vortex-file-compressed 🚨 43261197 38571868 1.12
tpcds_q18/duckdb:vortex-file-compressed 49578925 46314787 1.07
tpcds_q19/duckdb:vortex-file-compressed 🚨 112015130 32957359 3.40
tpcds_q20/duckdb:vortex-file-compressed 15956155 15793010 1.01
tpcds_q21/duckdb:vortex-file-compressed 19227610 20562289 0.94
tpcds_q22/duckdb:vortex-file-compressed 110653920 111585651 0.99
tpcds_q23/duckdb:vortex-file-compressed 🚨 170493264 129346815 1.32
tpcds_q24/duckdb:vortex-file-compressed 🚨 71537982 59392557 1.20
tpcds_q25/duckdb:vortex-file-compressed 🚨 44019595 37619919 1.17
tpcds_q26/duckdb:vortex-file-compressed 🚀 27705990 44005854 0.63
tpcds_q27/duckdb:vortex-file-compressed 🚨 117781498 89550277 1.32
tpcds_q28/duckdb:vortex-file-compressed 🚀 14289751 34926366 0.41
tpcds_q29/duckdb:vortex-file-compressed 🚨 52778481 38305687 1.38
tpcds_q30/duckdb:vortex-file-compressed 28013862 28612813 0.98
tpcds_q31/duckdb:vortex-file-compressed 28046138 27307981 1.03
tpcds_q32/duckdb:vortex-file-compressed 16334630 16791320 0.97
tpcds_q33/duckdb:vortex-file-compressed 🚨 124925949 68436081 1.83
tpcds_q34/duckdb:vortex-file-compressed 🚨 22242021 19128751 1.16
tpcds_q35/duckdb:vortex-file-compressed 🚀 51042733 62083806 0.82
tpcds_q36/duckdb:vortex-file-compressed 28319986 26814925 1.06
tpcds_q37/duckdb:vortex-file-compressed 🚀 14395168 21835906 0.66
tpcds_q38/duckdb:vortex-file-compressed 🚨 42221071 37636256 1.12
tpcds_q39/duckdb:vortex-file-compressed 44449060 44715197 0.99
tpcds_q40/duckdb:vortex-file-compressed 🚀 21940941 25203723 0.87
tpcds_q41/duckdb:vortex-file-compressed 🚀 9209881 13095968 0.70
tpcds_q42/duckdb:vortex-file-compressed 12613573 11821187 1.07
tpcds_q43/duckdb:vortex-file-compressed 18554539 19884855 0.93
tpcds_q44/duckdb:vortex-file-compressed 22014684 22212568 0.99
tpcds_q45/duckdb:vortex-file-compressed 28129173 27199411 1.03
tpcds_q46/duckdb:vortex-file-compressed 🚀 38750062 49026886 0.79
tpcds_q47/duckdb:vortex-file-compressed 51932156 49334110 1.05
tpcds_q48/duckdb:vortex-file-compressed 🚨 49530515 31809049 1.56
tpcds_q49/duckdb:vortex-file-compressed 🚨 33978263 28839515 1.18
tpcds_q50/duckdb:vortex-file-compressed 🚨 43741490 36538032 1.20
tpcds_q51/duckdb:vortex-file-compressed 92425342 96856460 0.95
tpcds_q52/duckdb:vortex-file-compressed 12839394 12655417 1.01
tpcds_q53/duckdb:vortex-file-compressed 🚨 22908479 17390171 1.32
tpcds_q54/duckdb:vortex-file-compressed 52874201 50506805 1.05
tpcds_q55/duckdb:vortex-file-compressed 🚨 12953222 11359246 1.14
tpcds_q56/duckdb:vortex-file-compressed 🚨 96486779 68363299 1.41
tpcds_q57/duckdb:vortex-file-compressed 🚨 54342780 45049671 1.21
tpcds_q58/duckdb:vortex-file-compressed 30580051 31870395 0.96
tpcds_q59/duckdb:vortex-file-compressed 60187211 60924906 0.99
tpcds_q60/duckdb:vortex-file-compressed 🚨 95320336 69629984 1.37
tpcds_q61/duckdb:vortex-file-compressed 37698669 38062923 0.99
tpcds_q62/duckdb:vortex-file-compressed 🚨 23236455 17685693 1.31
tpcds_q63/duckdb:vortex-file-compressed 🚨 22837263 17464551 1.31
tpcds_q64/duckdb:vortex-file-compressed 🚨 129953517 80837711 1.61
tpcds_q65/duckdb:vortex-file-compressed 22176257 22926593 0.97
tpcds_q66/duckdb:vortex-file-compressed 58294540 53746205 1.08
tpcds_q67/duckdb:vortex-file-compressed 146665275 145368566 1.01
tpcds_q68/duckdb:vortex-file-compressed 38714423 41376025 0.94
tpcds_q69/duckdb:vortex-file-compressed 42049440 39522034 1.06
tpcds_q70/duckdb:vortex-file-compressed 🚨 39023461 25178036 1.55
tpcds_q71/duckdb:vortex-file-compressed 🚨 23233389 20453403 1.14
tpcds_q72/duckdb:vortex-file-compressed 163188025 178749178 0.91
tpcds_q73/duckdb:vortex-file-compressed 20833454 19402438 1.07
tpcds_q74/duckdb:vortex-file-compressed 🚀 39959909 49610510 0.81
tpcds_q75/duckdb:vortex-file-compressed 🚀 49072115 57864473 0.85
tpcds_q76/duckdb:vortex-file-compressed 🚀 52121509 67293455 0.77
tpcds_q77/duckdb:vortex-file-compressed 72685800 66747613 1.09
tpcds_q78/duckdb:vortex-file-compressed 80135902 78408268 1.02
tpcds_q79/duckdb:vortex-file-compressed 🚀 35875867 44752235 0.80
tpcds_q80/duckdb:vortex-file-compressed 100004808 92887832 1.08
tpcds_q81/duckdb:vortex-file-compressed 33454317 32663242 1.02
tpcds_q82/duckdb:vortex-file-compressed 🚀 17530558 22342854 0.78
tpcds_q83/duckdb:vortex-file-compressed 29355477 27329914 1.07
tpcds_q84/duckdb:vortex-file-compressed 🚨 24099077 16534535 1.46
tpcds_q85/duckdb:vortex-file-compressed 🚨 64931612061 45674713 1421.61
tpcds_q86/duckdb:vortex-file-compressed 18738374 18452576 1.02
tpcds_q87/duckdb:vortex-file-compressed 45745812 41672596 1.10
tpcds_q88/duckdb:vortex-file-compressed 32842830 35091673 0.94
tpcds_q89/duckdb:vortex-file-compressed 🚨 23121731 17624088 1.31
tpcds_q90/duckdb:vortex-file-compressed 🚀 11907589 14937779 0.80
tpcds_q91/duckdb:vortex-file-compressed 🚨 30059617 27233414 1.10
tpcds_q92/duckdb:vortex-file-compressed 🚨 19761896 14085647 1.40
tpcds_q93/duckdb:vortex-file-compressed 28259754 30204007 0.94
tpcds_q94/duckdb:vortex-file-compressed 🚨 46414574 22525646 2.06
tpcds_q95/duckdb:vortex-file-compressed 🚨 244460520 152877223 1.60
tpcds_q96/duckdb:vortex-file-compressed 🚨 15306310 12146240 1.26
tpcds_q97/duckdb:vortex-file-compressed 42991321 40167116 1.07
tpcds_q98/duckdb:vortex-file-compressed 19642886 18205439 1.08
tpcds_q99/duckdb:vortex-file-compressed 🚨 40279176 33463050 1.20
duckdb / vortex-compact (1.193x ❌, 15↑ 54↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 25471949 34668645 0.73
tpcds_q02/duckdb:vortex-compact 🚨 149063780 124281905 1.20
tpcds_q03/duckdb:vortex-compact 49129004 50141371 0.98
tpcds_q04/duckdb:vortex-compact 🚀 103312199 123061196 0.84
tpcds_q05/duckdb:vortex-compact 151761563 160564769 0.95
tpcds_q06/duckdb:vortex-compact 37479568 36086083 1.04
tpcds_q07/duckdb:vortex-compact 🚨 48162365 37095676 1.30
tpcds_q08/duckdb:vortex-compact 🚨 59816348 27608497 2.17
tpcds_q09/duckdb:vortex-compact 🚀 28475706 109621921 0.26
tpcds_q10/duckdb:vortex-compact 🚨 54505580 46285969 1.18
tpcds_q11/duckdb:vortex-compact 🚀 60938389 71441338 0.85
tpcds_q12/duckdb:vortex-compact 🚨 23439992 18909690 1.24
tpcds_q13/duckdb:vortex-compact 🚨 79476012 48958435 1.62
tpcds_q14/duckdb:vortex-compact 🚨 335753942 260715820 1.29
tpcds_q15/duckdb:vortex-compact 🚀 32674477 44908538 0.73
tpcds_q16/duckdb:vortex-compact 🚨 43422065 37115462 1.17
tpcds_q17/duckdb:vortex-compact 53372006 48827096 1.09
tpcds_q18/duckdb:vortex-compact 67029267 67621378 0.99
tpcds_q19/duckdb:vortex-compact 🚨 133643588 38278704 3.49
tpcds_q20/duckdb:vortex-compact 🚨 22477954 19847706 1.13
tpcds_q21/duckdb:vortex-compact 🚀 23591147 28664030 0.82
tpcds_q22/duckdb:vortex-compact 113429885 119114559 0.95
tpcds_q23/duckdb:vortex-compact 🚨 226863265 168542582 1.35
tpcds_q24/duckdb:vortex-compact 🚨 88653208 69471644 1.28
tpcds_q25/duckdb:vortex-compact 🚨 57482616 46226034 1.24
tpcds_q26/duckdb:vortex-compact 🚀 41837939 54816319 0.76
tpcds_q27/duckdb:vortex-compact 🚨 192810552 128592017 1.50
tpcds_q28/duckdb:vortex-compact 🚀 22379810 106686172 0.21
tpcds_q29/duckdb:vortex-compact 🚨 62631954 48261927 1.30
tpcds_q30/duckdb:vortex-compact 🚨 37607418 33636111 1.12
tpcds_q31/duckdb:vortex-compact 🚨 41530606 30859147 1.35
tpcds_q32/duckdb:vortex-compact 🚨 25491051 23165760 1.10
tpcds_q33/duckdb:vortex-compact 🚨 188854541 130103842 1.45
tpcds_q34/duckdb:vortex-compact 🚨 25422415 21500668 1.18
tpcds_q35/duckdb:vortex-compact 61463355 66194636 0.93
tpcds_q36/duckdb:vortex-compact 🚨 38111080 32888996 1.16
tpcds_q37/duckdb:vortex-compact 🚀 22895772 31370870 0.73
tpcds_q38/duckdb:vortex-compact 🚨 45407247 40520927 1.12
tpcds_q39/duckdb:vortex-compact 🚀 46672887 53198402 0.88
tpcds_q40/duckdb:vortex-compact 30797347 30873276 1.00
tpcds_q41/duckdb:vortex-compact 🚀 11606730 15905782 0.73
tpcds_q42/duckdb:vortex-compact 🚨 19666272 13913449 1.41
tpcds_q43/duckdb:vortex-compact 🚨 26297958 22678747 1.16
tpcds_q44/duckdb:vortex-compact 27837040 28773454 0.97
tpcds_q45/duckdb:vortex-compact 🚨 40002061 33101650 1.21
tpcds_q46/duckdb:vortex-compact 57742604 55448715 1.04
tpcds_q47/duckdb:vortex-compact 🚨 65312659 53496248 1.22
tpcds_q48/duckdb:vortex-compact 🚨 70749050 40730449 1.74
tpcds_q49/duckdb:vortex-compact 🚨 57807238 48536258 1.19
tpcds_q50/duckdb:vortex-compact 🚨 47099780 35877763 1.31
tpcds_q51/duckdb:vortex-compact 100534245 103913890 0.97
tpcds_q52/duckdb:vortex-compact 🚨 19933157 14946613 1.33
tpcds_q53/duckdb:vortex-compact 🚨 31963520 21002000 1.52
tpcds_q54/duckdb:vortex-compact 92935689 85898172 1.08
tpcds_q55/duckdb:vortex-compact 🚨 19969377 15061390 1.33
tpcds_q56/duckdb:vortex-compact 🚨 157128978 131717161 1.19
tpcds_q57/duckdb:vortex-compact 52603494 48523017 1.08
tpcds_q58/duckdb:vortex-compact 42111112 42655639 0.99
tpcds_q59/duckdb:vortex-compact 78086878 77581877 1.01
tpcds_q60/duckdb:vortex-compact 🚨 148059121 133513168 1.11
tpcds_q61/duckdb:vortex-compact 🚨 57548303 46094142 1.25
tpcds_q62/duckdb:vortex-compact 🚨 34709230 22079354 1.57
tpcds_q63/duckdb:vortex-compact 🚨 32372542 21634606 1.50
tpcds_q64/duckdb:vortex-compact 🚨 160208362 96158293 1.67
tpcds_q65/duckdb:vortex-compact 🚨 31062258 28210593 1.10
tpcds_q66/duckdb:vortex-compact 🚨 112817740 95965040 1.18
tpcds_q67/duckdb:vortex-compact 157154250 152188602 1.03
tpcds_q68/duckdb:vortex-compact 54755433 51405676 1.07
tpcds_q69/duckdb:vortex-compact 🚨 56864778 45045153 1.26
tpcds_q70/duckdb:vortex-compact 🚨 50650701 28421828 1.78
tpcds_q71/duckdb:vortex-compact 🚨 33114945 26404044 1.25
tpcds_q72/duckdb:vortex-compact 178590329 198087609 0.90
tpcds_q73/duckdb:vortex-compact 23199165 21802729 1.06
tpcds_q74/duckdb:vortex-compact 🚀 48711899 55401863 0.88
tpcds_q75/duckdb:vortex-compact 64208506 68187182 0.94
tpcds_q76/duckdb:vortex-compact 129070814 127387328 1.01
tpcds_q77/duckdb:vortex-compact 127129633 128488996 0.99
tpcds_q78/duckdb:vortex-compact 🚨 94472454 84027067 1.12
tpcds_q79/duckdb:vortex-compact 67552387 66999083 1.01
tpcds_q80/duckdb:vortex-compact 152696790 154845625 0.99
tpcds_q81/duckdb:vortex-compact 43168353 40734105 1.06
tpcds_q82/duckdb:vortex-compact 🚀 26970002 32156878 0.84
tpcds_q83/duckdb:vortex-compact 🚨 50050995 44825348 1.12
tpcds_q84/duckdb:vortex-compact 🚨 31933249 21859555 1.46
tpcds_q85/duckdb:vortex-compact 🚨 64162291562 62331117 1029.38
tpcds_q86/duckdb:vortex-compact 24516058 22566019 1.09
tpcds_q87/duckdb:vortex-compact 45286024 43701570 1.04
tpcds_q88/duckdb:vortex-compact 🚀 29588019 33655973 0.88
tpcds_q89/duckdb:vortex-compact 🚨 33071206 21981565 1.50
tpcds_q90/duckdb:vortex-compact 🚀 11575372 15681276 0.74
tpcds_q91/duckdb:vortex-compact 44598694 44951830 0.99
tpcds_q92/duckdb:vortex-compact 🚨 45151799 21896096 2.06
tpcds_q93/duckdb:vortex-compact 36069450 35079159 1.03
tpcds_q94/duckdb:vortex-compact 🚨 55652753 29316364 1.90
tpcds_q95/duckdb:vortex-compact 🚨 254059283 155856040 1.63
tpcds_q96/duckdb:vortex-compact 🚨 13134544 11017655 1.19
tpcds_q97/duckdb:vortex-compact 39403687 41616494 0.95
tpcds_q98/duckdb:vortex-compact 🚨 28311040 22159460 1.28
tpcds_q99/duckdb:vortex-compact 🚨 48846619 38403000 1.27
duckdb / parquet (0.997x ➖, 1↑ 2↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 44259296 44443495 1.00
tpcds_q02/duckdb:parquet 59357709 59439130 1.00
tpcds_q03/duckdb:parquet 11877393 11784867 1.01
tpcds_q04/duckdb:parquet 126167167 124818666 1.01
tpcds_q05/duckdb:parquet 73604577 69263237 1.06
tpcds_q06/duckdb:parquet 28196751 31032866 0.91
tpcds_q07/duckdb:parquet 24135015 23033863 1.05
tpcds_q08/duckdb:parquet 27420397 27883501 0.98
tpcds_q09/duckdb:parquet 39970916 39745674 1.01
tpcds_q10/duckdb:parquet 34191861 34810085 0.98
tpcds_q11/duckdb:parquet 86500054 88429067 0.98
tpcds_q12/duckdb:parquet 14121380 14852110 0.95
tpcds_q13/duckdb:parquet 35377228 33474567 1.06
tpcds_q14/duckdb:parquet 164855927 161613354 1.02
tpcds_q15/duckdb:parquet 29183159 29819143 0.98
tpcds_q16/duckdb:parquet 21242704 22004624 0.97
tpcds_q17/duckdb:parquet 36562571 38647720 0.95
tpcds_q18/duckdb:parquet 46418081 45130216 1.03
tpcds_q19/duckdb:parquet 28874348 28649846 1.01
tpcds_q20/duckdb:parquet 14823126 15034854 0.99
tpcds_q21/duckdb:parquet 🚨 12151870 11016608 1.10
tpcds_q22/duckdb:parquet 68801887 67105983 1.03
tpcds_q23/duckdb:parquet 114204433 115564557 0.99
tpcds_q24/duckdb:parquet 45665012 44905505 1.02
tpcds_q25/duckdb:parquet 32180426 33391220 0.96
tpcds_q26/duckdb:parquet 35307467 37508341 0.94
tpcds_q27/duckdb:parquet 87837161 88449724 0.99
tpcds_q28/duckdb:parquet 36787103 36305189 1.01
tpcds_q29/duckdb:parquet 33798325 35538412 0.95
tpcds_q30/duckdb:parquet 40128199 41653214 0.96
tpcds_q31/duckdb:parquet 22731612 22341879 1.02
tpcds_q32/duckdb:parquet 11511369 12508903 0.92
tpcds_q33/duckdb:parquet 71423582 70034726 1.02
tpcds_q34/duckdb:parquet 20636355 20576808 1.00
tpcds_q35/duckdb:parquet 58098944 59756875 0.97
tpcds_q36/duckdb:parquet 20382425 20454297 1.00
tpcds_q37/duckdb:parquet 12752010 13276790 0.96
tpcds_q38/duckdb:parquet 32691522 33371843 0.98
tpcds_q39/duckdb:parquet 32312818 32000761 1.01
tpcds_q40/duckdb:parquet 17955769 17660386 1.02
tpcds_q41/duckdb:parquet 7375307 7291415 1.01
tpcds_q42/duckdb:parquet 10146072 10257411 0.99
tpcds_q43/duckdb:parquet 15864369 15617819 1.02
tpcds_q44/duckdb:parquet 20926311 21136077 0.99
tpcds_q45/duckdb:parquet 27439832 26061170 1.05
tpcds_q46/duckdb:parquet 44820109 46279193 0.97
tpcds_q47/duckdb:parquet 45925446 46234027 0.99
tpcds_q48/duckdb:parquet 30072644 30192729 1.00
tpcds_q49/duckdb:parquet 23603917 24006701 0.98
tpcds_q50/duckdb:parquet 24852544 24699966 1.01
tpcds_q51/duckdb:parquet 94319786 95700645 0.99
tpcds_q52/duckdb:parquet 10482930 11043155 0.95
tpcds_q53/duckdb:parquet 15948996 15978414 1.00
tpcds_q54/duckdb:parquet 41702269 38170893 1.09
tpcds_q55/duckdb:parquet 10725252 10590293 1.01
tpcds_q56/duckdb:parquet 68576999 70798013 0.97
tpcds_q57/duckdb:parquet 34399024 35137901 0.98
tpcds_q58/duckdb:parquet 21086768 21979184 0.96
tpcds_q59/duckdb:parquet 37003157 36712642 1.01
tpcds_q60/duckdb:parquet 70963932 72235914 0.98
tpcds_q61/duckdb:parquet 30777484 31048006 0.99
tpcds_q62/duckdb:parquet 11288818 11392146 0.99
tpcds_q63/duckdb:parquet 15102760 15326473 0.99
tpcds_q64/duckdb:parquet 73726591 74144606 0.99
tpcds_q65/duckdb:parquet 20068714 19788347 1.01
tpcds_q66/duckdb:parquet 53419266 55579741 0.96
tpcds_q67/duckdb:parquet 134339061 130452042 1.03
tpcds_q68/duckdb:parquet 37112754 37479718 0.99
tpcds_q69/duckdb:parquet 36743670 36689032 1.00
tpcds_q70/duckdb:parquet 19279715 19661953 0.98
tpcds_q71/duckdb:parquet 17947816 19076603 0.94
tpcds_q72/duckdb:parquet 161023194 165801814 0.97
tpcds_q73/duckdb:parquet 18328593 18097728 1.01
tpcds_q74/duckdb:parquet 49275422 49482865 1.00
tpcds_q75/duckdb:parquet 54164846 52981086 1.02
tpcds_q76/duckdb:parquet 70485282 71456766 0.99
tpcds_q77/duckdb:parquet 59406597 59108997 1.01
tpcds_q78/duckdb:parquet 74702667 74284507 1.01
tpcds_q79/duckdb:parquet 27308181 27284168 1.00
tpcds_q80/duckdb:parquet 81585254 86024240 0.95
tpcds_q81/duckdb:parquet 46706964 46818591 1.00
tpcds_q82/duckdb:parquet 15510078 14805705 1.05
tpcds_q83/duckdb:parquet 15794487 16499798 0.96
tpcds_q84/duckdb:parquet 19032007 19517808 0.98
tpcds_q85/duckdb:parquet 39120822 37985199 1.03
tpcds_q86/duckdb:parquet 12285690 11765141 1.04
tpcds_q87/duckdb:parquet 36340401 36297357 1.00
tpcds_q88/duckdb:parquet 28523603 28424205 1.00
tpcds_q89/duckdb:parquet 17240066 17178574 1.00
tpcds_q90/duckdb:parquet 🚀 7163264 8013818 0.89
tpcds_q91/duckdb:parquet 23719756 23618562 1.00
tpcds_q92/duckdb:parquet 11090733 11598220 0.96
tpcds_q93/duckdb:parquet 30271403 29147041 1.04
tpcds_q94/duckdb:parquet 16206711 16009923 1.01
tpcds_q95/duckdb:parquet 🚨 150421600 130706559 1.15
tpcds_q96/duckdb:parquet 9134246 9085033 1.01
tpcds_q97/duckdb:parquet 33853580 34325340 0.99
tpcds_q98/duckdb:parquet 18313976 17202324 1.06
tpcds_q99/duckdb:parquet 19573647 19301696 1.01
duckdb / duckdb (0.994x ➖, 0↑ 1↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20145410 19616686 1.03
tpcds_q02/duckdb:duckdb 17698413 19560656 0.90
tpcds_q03/duckdb:duckdb 7937376 8358552 0.95
tpcds_q04/duckdb:duckdb 159113703 159622983 1.00
tpcds_q05/duckdb:duckdb 18622746 17681225 1.05
tpcds_q06/duckdb:duckdb 21756285 21438569 1.01
tpcds_q07/duckdb:duckdb 37037769 37856950 0.98
tpcds_q08/duckdb:duckdb 118967640 122485345 0.97
tpcds_q09/duckdb:duckdb 19403807 19842125 0.98
tpcds_q10/duckdb:duckdb 23149585 22697325 1.02
tpcds_q11/duckdb:duckdb 132419509 140374096 0.94
tpcds_q12/duckdb:duckdb 11096386 11401590 0.97
tpcds_q13/duckdb:duckdb 23469344 23613580 0.99
tpcds_q14/duckdb:duckdb 90976138 92303551 0.99
tpcds_q15/duckdb:duckdb 23483831 22741188 1.03
tpcds_q16/duckdb:duckdb 16462666 17806591 0.92
tpcds_q17/duckdb:duckdb 20503880 21723746 0.94
tpcds_q18/duckdb:duckdb 43846501 43379561 1.01
tpcds_q19/duckdb:duckdb 15933582 16972878 0.94
tpcds_q20/duckdb:duckdb 11533149 12128303 0.95
tpcds_q21/duckdb:duckdb 6214924 6677593 0.93
tpcds_q22/duckdb:duckdb 61140882 64151565 0.95
tpcds_q23/duckdb:duckdb 73608917 76015850 0.97
tpcds_q24/duckdb:duckdb 23106166 24131481 0.96
tpcds_q25/duckdb:duckdb 16591571 16350479 1.01
tpcds_q26/duckdb:duckdb 🚨 26040802 22980966 1.13
tpcds_q27/duckdb:duckdb 36251596 39031593 0.93
tpcds_q28/duckdb:duckdb 21084627 21584246 0.98
tpcds_q29/duckdb:duckdb 19683796 20202873 0.97
tpcds_q30/duckdb:duckdb 27211436 29487717 0.92
tpcds_q31/duckdb:duckdb 18933766 19666469 0.96
tpcds_q32/duckdb:duckdb 7005490 6877356 1.02
tpcds_q33/duckdb:duckdb 12364362 12331708 1.00
tpcds_q34/duckdb:duckdb 14562559 14470464 1.01
tpcds_q35/duckdb:duckdb 33706362 30856398 1.09
tpcds_q36/duckdb:duckdb 66056159 67902835 0.97
tpcds_q37/duckdb:duckdb 7015153 7273589 0.96
tpcds_q38/duckdb:duckdb 30557317 29637237 1.03
tpcds_q39/duckdb:duckdb 24191166 25794641 0.94
tpcds_q40/duckdb:duckdb 13258815 13635419 0.97
tpcds_q41/duckdb:duckdb 7829977 8292101 0.94
tpcds_q42/duckdb:duckdb 6103978 6013808 1.01
tpcds_q43/duckdb:duckdb 11010659 11276182 0.98
tpcds_q44/duckdb:duckdb 13380760 13687955 0.98
tpcds_q45/duckdb:duckdb 16361454 17027549 0.96
tpcds_q46/duckdb:duckdb 34571806 35045098 0.99
tpcds_q47/duckdb:duckdb 40244789 40567402 0.99
tpcds_q48/duckdb:duckdb 21185775 21266987 1.00
tpcds_q49/duckdb:duckdb 16327986 16277480 1.00
tpcds_q50/duckdb:duckdb 13456210 13745163 0.98
tpcds_q51/duckdb:duckdb 91673091 89767115 1.02
tpcds_q52/duckdb:duckdb 7279645 7720637 0.94
tpcds_q53/duckdb:duckdb 11701634 11685234 1.00
tpcds_q54/duckdb:duckdb 16191171 17068759 0.95
tpcds_q55/duckdb:duckdb 6751756 6674673 1.01
tpcds_q56/duckdb:duckdb 13165210 13065453 1.01
tpcds_q57/duckdb:duckdb 30504819 30894084 0.99
tpcds_q58/duckdb:duckdb 12250860 11672678 1.05
tpcds_q59/duckdb:duckdb 33895500 34071913 0.99
tpcds_q60/duckdb:duckdb 15321546 14448230 1.06
tpcds_q61/duckdb:duckdb 13976327 13931782 1.00
tpcds_q62/duckdb:duckdb 8998928 8880730 1.01
tpcds_q63/duckdb:duckdb 11007510 10897795 1.01
tpcds_q64/duckdb:duckdb 53066200 53456864 0.99
tpcds_q65/duckdb:duckdb 34300206 31946911 1.07
tpcds_q66/duckdb:duckdb 24312237 23686472 1.03
tpcds_q67/duckdb:duckdb 125648423 125907932 1.00
tpcds_q68/duckdb:duckdb 24250774 24286094 1.00
tpcds_q69/duckdb:duckdb 22958950 24457852 0.94
tpcds_q70/duckdb:duckdb 15210376 14728587 1.03
tpcds_q71/duckdb:duckdb 12524021 11518629 1.09
tpcds_q72/duckdb:duckdb 42385976 41843015 1.01
tpcds_q73/duckdb:duckdb 10785646 10280273 1.05
tpcds_q74/duckdb:duckdb 95645835 97001053 0.99
tpcds_q75/duckdb:duckdb 42077573 41130236 1.02
tpcds_q76/duckdb:duckdb 12201003 11392165 1.07
tpcds_q77/duckdb:duckdb 11902281 11746211 1.01
tpcds_q78/duckdb:duckdb 61459188 64003344 0.96
tpcds_q79/duckdb:duckdb 16980925 17233973 0.99
tpcds_q80/duckdb:duckdb 27913369 28658406 0.97
tpcds_q81/duckdb:duckdb 37018142 36024792 1.03
tpcds_q82/duckdb:duckdb 8182163 8676588 0.94
tpcds_q83/duckdb:duckdb 9205890 9185304 1.00
tpcds_q84/duckdb:duckdb 13662854 13170575 1.04
tpcds_q85/duckdb:duckdb 23611657 23488672 1.01
tpcds_q86/duckdb:duckdb 10370195 10830590 0.96
tpcds_q87/duckdb:duckdb 33002655 32415140 1.02
tpcds_q88/duckdb:duckdb 23662957 23887362 0.99
tpcds_q89/duckdb:duckdb 13938381 12932643 1.08
tpcds_q90/duckdb:duckdb 5234449 5421748 0.97
tpcds_q91/duckdb:duckdb 13008564 12300931 1.06
tpcds_q92/duckdb:duckdb 8717805 9521429 0.92
tpcds_q93/duckdb:duckdb 22218190 21190157 1.05
tpcds_q94/duckdb:duckdb 12019070 12755850 0.94
tpcds_q95/duckdb:duckdb 128804169 123531122 1.04
tpcds_q96/duckdb:duckdb 4446787 4522543 0.98
tpcds_q97/duckdb:duckdb 30503573 29172624 1.05
tpcds_q98/duckdb:duckdb 13415664 13072864 1.03
tpcds_q99/duckdb:duckdb 15926739 15913797 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.9% -2.1% +5.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +8.6% -2.1% +11.0% +10.6% 🚨 regression
1 duckdb:duckdb +2.7% -2.1% +4.9% +14.2% ➖ noise
1 duckdb:vortex-compact -26.5% -2.1% -24.9% +19.1% ✅ faster
1 duckdb:vortex-file-compressed -29.7% -2.1% -28.2% +10.7% ✅ faster
2 datafusion:vortex-compact -1.0% -1.2% +0.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +2.4% -1.2% +3.7% +13.6% ➖ noise
2 duckdb:duckdb -9.5% -1.2% -8.4% +12.7% ➖ noise
2 duckdb:vortex-compact +19.9% -1.2% +21.4% +10.0% 🚨 regression
2 duckdb:vortex-file-compressed +12.2% -1.2% +13.6% +10.9% 🚨 regression
3 datafusion:vortex-compact +0.9% +1.9% -1.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.0% +1.9% +1.1% +10.5% ➖ noise
3 duckdb:duckdb -5.0% +1.9% -6.8% +16.9% ➖ noise
3 duckdb:vortex-compact -2.0% +1.9% -3.9% +13.4% ➖ noise
3 duckdb:vortex-file-compressed -6.6% +1.9% -8.3% +13.4% ➖ noise
4 datafusion:vortex-compact -1.3% -1.8% +0.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.1% -1.8% +1.9% +10.0% ➖ noise
4 duckdb:duckdb -0.3% -1.8% +1.5% +10.0% ➖ noise
4 duckdb:vortex-compact -16.0% -1.8% -14.5% +16.0% ✅ faster
4 duckdb:vortex-file-compressed -19.4% -1.8% -17.9% +10.0% ✅ faster
5 datafusion:vortex-compact -6.1% -0.5% -5.6% +12.4% ➖ noise
5 datafusion:vortex-file-compressed -0.5% -0.5% +0.0% +10.0% ➖ noise
5 duckdb:duckdb +5.3% -0.5% +5.9% +15.8% ➖ noise
5 duckdb:vortex-compact -5.5% -0.5% -5.0% +12.5% ➖ noise
5 duckdb:vortex-file-compressed +2.2% -0.5% +2.7% +13.2% ➖ noise
6 datafusion:vortex-compact -1.5% -3.9% +2.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.0% -3.9% +3.1% +10.0% ➖ noise
6 duckdb:duckdb +1.5% -3.9% +5.7% +14.6% ➖ noise
6 duckdb:vortex-compact +3.9% -3.9% +8.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.1% -3.9% +0.9% +10.0% ➖ noise
7 datafusion:vortex-compact +0.2% +6.4% -5.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +8.4% +6.4% +1.9% +10.0% ➖ noise
7 duckdb:duckdb -2.2% +6.4% -8.0% +18.1% ➖ noise
7 duckdb:vortex-compact +29.8% +6.4% +22.1% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +20.0% +6.4% +12.8% +10.0% 🚨 regression
8 datafusion:vortex-compact +0.1% +5.0% -4.6% +15.1% ➖ noise
8 datafusion:vortex-file-compressed -0.4% +5.0% -5.1% +10.5% ➖ noise
8 duckdb:duckdb -2.9% +5.0% -7.5% +10.0% ➖ noise
8 duckdb:vortex-compact +116.7% +5.0% +106.4% +11.5% 🚨 regression
8 duckdb:vortex-file-compressed +51.0% +5.0% +43.8% +10.0% 🚨 regression
9 datafusion:vortex-compact -1.5% +2.4% -3.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.0% +2.4% -1.4% +10.0% ➖ noise
9 duckdb:duckdb -2.2% +2.4% -4.5% +10.0% ➖ noise
9 duckdb:vortex-compact -74.0% +2.4% -74.6% +10.0% ✅ faster
9 duckdb:vortex-file-compressed -60.0% +2.4% -61.0% +10.0% ✅ faster
10 datafusion:vortex-compact -1.0% +0.0% -1.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.3% +0.0% +0.3% +10.0% ➖ noise
10 duckdb:duckdb +2.0% +0.0% +2.0% +10.0% ➖ noise
10 duckdb:vortex-compact +17.8% +0.0% +17.7% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +5.9% +0.0% +5.8% +10.0% ➖ noise
11 datafusion:vortex-compact -0.5% -1.1% +0.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.0% -1.1% +0.1% +10.0% ➖ noise
11 duckdb:duckdb -5.7% -1.1% -4.6% +10.0% ➖ noise
11 duckdb:vortex-compact -14.7% -1.1% -13.7% +10.7% ✅ faster
11 duckdb:vortex-file-compressed -26.6% -1.1% -25.8% +10.0% ✅ faster
12 datafusion:vortex-compact -0.5% -3.0% +2.6% +14.2% ➖ noise
12 datafusion:vortex-file-compressed -8.7% -3.0% -5.8% +11.0% ➖ noise
12 duckdb:duckdb -2.7% -3.0% +0.3% +10.9% ➖ noise
12 duckdb:vortex-compact +24.0% -3.0% +27.8% +15.4% 🚨 regression
12 duckdb:vortex-file-compressed +0.1% -3.0% +3.2% +13.3% ➖ noise
13 datafusion:vortex-compact -3.2% +1.8% -5.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.5% +1.8% -1.3% +10.0% ➖ noise
13 duckdb:duckdb -0.6% +1.8% -2.4% +10.0% ➖ noise
13 duckdb:vortex-compact +62.3% +1.8% +59.4% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +65.6% +1.8% +62.6% +10.0% 🚨 regression
14 datafusion:vortex-compact -0.4% -2.6% +2.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.3% -2.6% +4.1% +10.0% ➖ noise
14 duckdb:duckdb -1.4% -2.6% +1.2% +10.0% ➖ noise
14 duckdb:vortex-compact +28.8% -2.6% +32.3% +10.9% 🚨 regression
14 duckdb:vortex-file-compressed +21.5% -2.6% +24.8% +10.4% 🚨 regression
15 datafusion:vortex-compact -4.2% -3.5% -0.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.6% -3.5% +6.3% +10.0% ➖ noise
15 duckdb:duckdb +3.3% -3.5% +7.0% +11.3% ➖ noise
15 duckdb:vortex-compact -27.2% -3.5% -24.6% +15.0% ✅ faster
15 duckdb:vortex-file-compressed -35.7% -3.5% -33.4% +17.6% ✅ faster
16 datafusion:vortex-compact -1.5% -4.7% +3.3% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +4.7% -4.7% +9.9% +10.0% ➖ noise
16 duckdb:duckdb -7.5% -4.7% -3.0% +11.9% ➖ noise
16 duckdb:vortex-compact +17.0% -4.7% +22.7% +10.0% 🚨 regression
16 duckdb:vortex-file-compressed +22.7% -4.7% +28.7% +11.8% 🚨 regression
17 datafusion:vortex-compact +1.4% -3.4% +4.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.1% -3.4% +5.6% +10.0% ➖ noise
17 duckdb:duckdb -5.6% -3.4% -2.3% +10.0% ➖ noise
17 duckdb:vortex-compact +9.3% -3.4% +13.1% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +12.2% -3.4% +16.1% +13.8% 🚨 regression
18 datafusion:vortex-compact -0.3% +1.2% -1.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.2% +1.2% -4.3% +10.0% ➖ noise
18 duckdb:duckdb +1.1% +1.2% -0.1% +10.0% ➖ noise
18 duckdb:vortex-compact -0.9% +1.2% -2.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +7.0% +1.2% +5.8% +10.0% ➖ noise
19 datafusion:vortex-compact +2.5% +1.8% +0.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +2.4% +1.8% +0.6% +10.0% ➖ noise
19 duckdb:duckdb -6.1% +1.8% -7.7% +12.9% ➖ noise
19 duckdb:vortex-compact +249.1% +1.8% +243.1% +10.0% 🚨 regression
19 duckdb:vortex-file-compressed +239.9% +1.8% +234.0% +11.0% 🚨 regression
20 datafusion:vortex-compact -2.2% -0.6% -1.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.8% -0.6% -1.2% +10.0% ➖ noise
20 duckdb:duckdb -4.9% -0.6% -4.3% +14.1% ➖ noise
20 duckdb:vortex-compact +13.3% -0.6% +14.0% +10.9% 🚨 regression
20 duckdb:vortex-file-compressed +1.0% -0.6% +1.7% +28.3% ➖ noise
21 datafusion:vortex-compact +3.5% +4.5% -1.0% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +4.2% +4.5% -0.3% +10.0% ➖ noise
21 duckdb:duckdb -6.9% +4.5% -10.9% +16.6% ➖ noise
21 duckdb:vortex-compact -17.7% +4.5% -21.2% +16.5% ✅ faster
21 duckdb:vortex-file-compressed -6.5% +4.5% -10.5% +11.6% ✅ faster
22 datafusion:vortex-compact +2.1% -6.3% +9.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +4.5% -6.3% +11.5% +10.0% 🚨 regression
22 duckdb:duckdb -4.7% -6.3% +1.7% +12.3% ➖ noise
22 duckdb:vortex-compact -4.8% -6.3% +1.6% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.8% -6.3% +5.8% +10.0% ➖ noise
23 datafusion:vortex-compact -1.0% -0.6% -0.4% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -0.5% -0.6% +0.2% +10.0% ➖ noise
23 duckdb:duckdb -3.2% -0.6% -2.5% +14.4% ➖ noise
23 duckdb:vortex-compact +34.6% -0.6% +35.5% +10.0% 🚨 regression
23 duckdb:vortex-file-compressed +31.8% -0.6% +32.7% +12.2% 🚨 regression
24 datafusion:vortex-compact +2.5% -0.1% +2.6% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -0.5% -0.1% -0.4% +10.0% ➖ noise
24 duckdb:duckdb -4.2% -0.1% -4.2% +10.0% ➖ noise
24 duckdb:vortex-compact +27.6% -0.1% +27.7% +10.0% 🚨 regression
24 duckdb:vortex-file-compressed +20.4% -0.1% +20.6% +10.0% 🚨 regression
25 datafusion:vortex-compact +4.1% -1.5% +5.7% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +0.4% -1.5% +1.9% +10.0% ➖ noise
25 duckdb:duckdb +1.5% -1.5% +3.0% +10.0% ➖ noise
25 duckdb:vortex-compact +24.4% -1.5% +26.3% +10.0% 🚨 regression
25 duckdb:vortex-file-compressed +17.0% -1.5% +18.8% +10.0% 🚨 regression
26 datafusion:vortex-compact +1.5% -4.0% +5.8% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -0.8% -4.0% +3.4% +10.0% ➖ noise
26 duckdb:duckdb +13.3% -4.0% +18.1% +14.8% 🚨 regression
26 duckdb:vortex-compact -23.7% -4.0% -20.5% +12.4% ✅ faster
26 duckdb:vortex-file-compressed -37.0% -4.0% -34.4% +12.4% ✅ faster
27 datafusion:vortex-compact +0.2% -0.3% +0.6% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +2.1% -0.3% +2.4% +10.0% ➖ noise
27 duckdb:duckdb -7.1% -0.3% -6.8% +17.5% ➖ noise
27 duckdb:vortex-compact +49.9% -0.3% +50.4% +10.0% 🚨 regression
27 duckdb:vortex-file-compressed +31.5% -0.3% +32.0% +10.0% 🚨 regression
28 datafusion:vortex-compact -1.1% -0.8% -0.3% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +3.5% -0.8% +4.3% +10.0% ➖ noise
28 duckdb:duckdb -2.3% -0.8% -1.6% +10.0% ➖ noise
28 duckdb:vortex-compact -79.0% -0.8% -78.9% +10.0% ✅ faster
28 duckdb:vortex-file-compressed -59.1% -0.8% -58.8% +14.1% ✅ faster
29 datafusion:vortex-compact -0.2% -3.1% +3.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -4.3% -3.1% -1.3% +10.0% ➖ noise
29 duckdb:duckdb -2.6% -3.1% +0.5% +11.1% ➖ noise
29 duckdb:vortex-compact +29.8% -3.1% +33.9% +10.5% 🚨 regression
29 duckdb:vortex-file-compressed +37.8% -3.1% +42.2% +16.2% 🚨 regression
30 datafusion:vortex-compact +5.4% -1.3% +6.8% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +1.1% -1.3% +2.4% +10.0% ➖ noise
30 duckdb:duckdb -7.7% -1.3% -6.5% +10.1% ➖ noise
30 duckdb:vortex-compact +11.8% -1.3% +13.2% +10.0% 🚨 regression
30 duckdb:vortex-file-compressed -2.1% -1.3% -0.8% +15.2% ➖ noise
31 datafusion:vortex-compact +0.3% +1.0% -0.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -1.1% +1.0% -2.1% +10.0% ➖ noise
31 duckdb:duckdb -3.7% +1.0% -4.7% +11.3% ➖ noise
31 duckdb:vortex-compact +34.6% +1.0% +33.2% +10.0% 🚨 regression
31 duckdb:vortex-file-compressed +2.7% +1.0% +1.7% +10.0% ➖ noise
32 datafusion:vortex-compact +2.2% -2.0% +4.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +0.6% -2.0% +2.6% +10.1% ➖ noise
32 duckdb:duckdb +1.9% -2.0% +3.9% +15.5% ➖ noise
32 duckdb:vortex-compact +10.0% -2.0% +12.2% +10.0% 🚨 regression
32 duckdb:vortex-file-compressed -2.7% -2.0% -0.8% +10.0% ➖ noise
33 datafusion:vortex-compact -0.0% +0.4% -0.4% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.2% +0.4% -0.2% +10.0% ➖ noise
33 duckdb:duckdb +0.3% +0.4% -0.1% +10.4% ➖ noise
33 duckdb:vortex-compact +45.2% +0.4% +44.7% +10.0% 🚨 regression
33 duckdb:vortex-file-compressed +82.5% +0.4% +81.9% +10.0% 🚨 regression
34 datafusion:vortex-compact -1.7% +0.6% -2.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -0.0% +0.6% -0.6% +10.0% ➖ noise
34 duckdb:duckdb +0.6% +0.6% +0.0% +11.8% ➖ noise
34 duckdb:vortex-compact +18.2% +0.6% +17.5% +12.2% 🚨 regression
34 duckdb:vortex-file-compressed +16.3% +0.6% +15.6% +10.0% 🚨 regression
35 datafusion:vortex-compact -0.3% -2.0% +1.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.4% -2.0% +2.5% +10.0% ➖ noise
35 duckdb:duckdb +9.2% -2.0% +11.5% +16.8% ➖ noise
35 duckdb:vortex-compact -7.1% -2.0% -5.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -17.8% -2.0% -16.1% +10.0% ✅ faster
36 datafusion:vortex-compact -3.6% -1.3% -2.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.7% -1.3% +3.1% +10.0% ➖ noise
36 duckdb:duckdb -2.7% -1.3% -1.4% +11.2% ➖ noise
36 duckdb:vortex-compact +15.9% -1.3% +17.4% +13.8% 🚨 regression
36 duckdb:vortex-file-compressed +5.6% -1.3% +7.0% +10.0% ➖ noise
37 datafusion:vortex-compact +0.3% -2.6% +2.9% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -2.2% -2.6% +0.3% +10.3% ➖ noise
37 duckdb:duckdb -3.6% -2.6% -1.0% +16.4% ➖ noise
37 duckdb:vortex-compact -27.0% -2.6% -25.1% +11.2% ✅ faster
37 duckdb:vortex-file-compressed -34.1% -2.6% -32.3% +10.8% ✅ faster
38 datafusion:vortex-compact +4.0% -0.8% +4.9% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -4.5% -0.8% -3.7% +10.0% ➖ noise
38 duckdb:duckdb +3.1% -0.8% +4.0% +21.2% ➖ noise
38 duckdb:vortex-compact +12.1% -0.8% +13.0% +19.8% ➖ noise
38 duckdb:vortex-file-compressed +12.2% -0.8% +13.1% +11.4% 🚨 regression
39 datafusion:vortex-compact +1.4% -0.5% +1.9% +16.8% ➖ noise
39 datafusion:vortex-file-compressed -1.1% -0.5% -0.7% +12.4% ➖ noise
39 duckdb:duckdb -6.2% -0.5% -5.8% +22.4% ➖ noise
39 duckdb:vortex-compact -12.3% -0.5% -11.9% +13.8% ➖ noise
39 duckdb:vortex-file-compressed -0.6% -0.5% -0.1% +15.6% ➖ noise
40 datafusion:vortex-compact -0.4% -2.4% +2.0% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +1.6% -2.4% +4.1% +10.1% ➖ noise
40 duckdb:duckdb -2.8% -2.4% -0.4% +21.1% ➖ noise
40 duckdb:vortex-compact -0.2% -2.4% +2.2% +10.5% ➖ noise
40 duckdb:vortex-file-compressed -12.9% -2.4% -10.8% +11.3% ✅ faster
41 datafusion:vortex-compact -1.4% -0.2% -1.3% +15.9% ➖ noise
41 datafusion:vortex-file-compressed +1.8% -0.2% +2.0% +15.6% ➖ noise
41 duckdb:duckdb -5.6% -0.2% -5.4% +10.0% ➖ noise
41 duckdb:vortex-compact -27.0% -0.2% -26.9% +10.0% ✅ faster
41 duckdb:vortex-file-compressed -29.7% -0.2% -29.5% +10.0% ✅ faster
42 datafusion:vortex-compact +3.9% -0.7% +4.6% +11.5% ➖ noise
42 datafusion:vortex-file-compressed -3.8% -0.7% -3.2% +10.0% ➖ noise
42 duckdb:duckdb +1.5% -0.7% +2.2% +13.5% ➖ noise
42 duckdb:vortex-compact +41.3% -0.7% +42.3% +17.4% 🚨 regression
42 duckdb:vortex-file-compressed +6.7% -0.7% +7.4% +14.0% ➖ noise
43 datafusion:vortex-compact -0.4% -2.7% +2.4% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +1.9% -2.7% +4.7% +10.0% ➖ noise
43 duckdb:duckdb -2.4% -2.7% +0.4% +10.0% ➖ noise
43 duckdb:vortex-compact +16.0% -2.7% +19.2% +12.2% 🚨 regression
43 duckdb:vortex-file-compressed -6.7% -2.7% -4.1% +10.0% ➖ noise
44 datafusion:vortex-compact +0.1% +0.2% -0.1% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -0.1% +0.2% -0.3% +10.0% ➖ noise
44 duckdb:duckdb -2.2% +0.2% -2.4% +10.9% ➖ noise
44 duckdb:vortex-compact -3.3% +0.2% -3.4% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -0.9% +0.2% -1.1% +13.0% ➖ noise
45 datafusion:vortex-compact -0.6% +0.8% -1.4% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +1.6% +0.8% +0.8% +10.0% ➖ noise
45 duckdb:duckdb -3.9% +0.8% -4.6% +10.0% ➖ noise
45 duckdb:vortex-compact +20.8% +0.8% +19.9% +11.6% 🚨 regression
45 duckdb:vortex-file-compressed +3.4% +0.8% +2.6% +14.7% ➖ noise
46 datafusion:vortex-compact -1.5% -0.1% -1.4% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -2.5% -0.1% -2.4% +10.0% ➖ noise
46 duckdb:duckdb -1.4% -0.1% -1.2% +10.0% ➖ noise
46 duckdb:vortex-compact +4.1% -0.1% +4.3% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -21.0% -0.1% -20.9% +10.0% ✅ faster
47 datafusion:vortex-compact +1.2% -0.3% +1.5% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -0.2% -0.3% +0.0% +10.0% ➖ noise
47 duckdb:duckdb -0.8% -0.3% -0.5% +10.0% ➖ noise
47 duckdb:vortex-compact +22.1% -0.3% +22.4% +10.0% 🚨 regression
47 duckdb:vortex-file-compressed +5.3% -0.3% +5.5% +11.5% ➖ noise
48 datafusion:vortex-compact -3.2% -0.3% -2.9% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -2.3% -0.3% -2.0% +10.0% ➖ noise
48 duckdb:duckdb -0.4% -0.3% -0.1% +10.0% ➖ noise
48 duckdb:vortex-compact +73.7% -0.3% +74.2% +10.0% 🚨 regression
48 duckdb:vortex-file-compressed +55.7% -0.3% +56.2% +10.0% 🚨 regression
49 datafusion:vortex-compact +0.5% -2.0% +2.5% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -0.4% -2.0% +1.6% +10.0% ➖ noise
49 duckdb:duckdb +0.3% -2.0% +2.3% +15.0% ➖ noise
49 duckdb:vortex-compact +19.1% -2.0% +21.5% +10.0% 🚨 regression
49 duckdb:vortex-file-compressed +17.8% -2.0% +20.2% +21.6% ➖ noise
50 datafusion:vortex-compact +5.3% -1.6% +7.0% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +5.7% -1.6% +7.4% +10.0% ➖ noise
50 duckdb:duckdb -2.1% -1.6% -0.5% +12.4% ➖ noise
50 duckdb:vortex-compact +31.3% -1.6% +33.4% +10.0% 🚨 regression
50 duckdb:vortex-file-compressed +19.7% -1.6% +21.7% +10.0% 🚨 regression
51 datafusion:vortex-compact -1.5% -0.2% -1.3% +11.7% ➖ noise
51 datafusion:vortex-file-compressed -0.9% -0.2% -0.7% +11.7% ➖ noise
51 duckdb:duckdb +2.1% -0.2% +2.3% +17.4% ➖ noise
51 duckdb:vortex-compact -3.3% -0.2% -3.0% +12.3% ➖ noise
51 duckdb:vortex-file-compressed -4.6% -0.2% -4.4% +20.8% ➖ noise
52 datafusion:vortex-compact -3.9% -3.0% -0.9% +12.9% ➖ noise
52 datafusion:vortex-file-compressed +1.9% -3.0% +5.1% +13.1% ➖ noise
52 duckdb:duckdb -5.7% -3.0% -2.8% +19.1% ➖ noise
52 duckdb:vortex-compact +33.4% -3.0% +37.5% +18.1% 🚨 regression
52 duckdb:vortex-file-compressed +1.5% -3.0% +4.6% +16.2% ➖ noise
53 datafusion:vortex-compact +3.5% -2.1% +5.7% +10.1% ➖ noise
53 datafusion:vortex-file-compressed -3.9% -2.1% -1.9% +10.5% ➖ noise
53 duckdb:duckdb +0.1% -2.1% +2.3% +12.4% ➖ noise
53 duckdb:vortex-compact +52.2% -2.1% +55.4% +10.0% 🚨 regression
53 duckdb:vortex-file-compressed +31.7% -2.1% +34.5% +10.0% 🚨 regression
54 datafusion:vortex-compact -1.2% +3.7% -4.7% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +1.3% +3.7% -2.3% +10.0% ➖ noise
54 duckdb:duckdb -5.1% +3.7% -8.5% +29.0% ➖ noise
54 duckdb:vortex-compact +8.2% +3.7% +4.3% +10.7% ➖ noise
54 duckdb:vortex-file-compressed +4.7% +3.7% +1.0% +10.0% ➖ noise
55 datafusion:vortex-compact +4.8% -0.9% +5.7% +10.4% ➖ noise
55 datafusion:vortex-file-compressed -1.9% -0.9% -0.9% +10.4% ➖ noise
55 duckdb:duckdb +1.2% -0.9% +2.1% +13.9% ➖ noise
55 duckdb:vortex-compact +32.6% -0.9% +33.8% +10.5% 🚨 regression
55 duckdb:vortex-file-compressed +14.0% -0.9% +15.1% +14.7% 🚨 regression
56 datafusion:vortex-compact +2.2% -2.2% +4.5% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -1.3% -2.2% +1.0% +10.0% ➖ noise
56 duckdb:duckdb +0.8% -2.2% +3.0% +11.8% ➖ noise
56 duckdb:vortex-compact +19.3% -2.2% +22.0% +10.0% 🚨 regression
56 duckdb:vortex-file-compressed +41.1% -2.2% +44.3% +10.0% 🚨 regression
57 datafusion:vortex-compact +2.0% -4.4% +6.7% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -1.9% -4.4% +2.6% +10.0% ➖ noise
57 duckdb:duckdb -1.3% -4.4% +3.3% +10.0% ➖ noise
57 duckdb:vortex-compact +8.4% -4.4% +13.4% +10.5% 🚨 regression
57 duckdb:vortex-file-compressed +20.6% -4.4% +26.1% +22.8% 🚨 regression
58 datafusion:vortex-compact +0.8% -3.1% +4.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -0.2% -3.1% +2.9% +10.0% ➖ noise
58 duckdb:duckdb +5.0% -3.1% +8.3% +20.1% ➖ noise
58 duckdb:vortex-compact -1.3% -3.1% +1.9% +11.6% ➖ noise
58 duckdb:vortex-file-compressed -4.0% -3.1% -1.0% +12.2% ➖ noise
59 datafusion:vortex-compact +2.0% +0.1% +1.9% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -0.3% +0.1% -0.4% +10.0% ➖ noise
59 duckdb:duckdb -0.5% +0.1% -0.6% +10.0% ➖ noise
59 duckdb:vortex-compact +0.7% +0.1% +0.6% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -1.2% +0.1% -1.3% +10.0% ➖ noise
60 datafusion:vortex-compact +1.2% -1.3% +2.5% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -4.4% -1.3% -3.1% +10.0% ➖ noise
60 duckdb:duckdb +6.0% -1.3% +7.4% +10.0% ➖ noise
60 duckdb:vortex-compact +10.9% -1.3% +12.4% +10.0% 🚨 regression
60 duckdb:vortex-file-compressed +36.9% -1.3% +38.7% +10.0% 🚨 regression
61 datafusion:vortex-compact -0.1% -0.9% +0.8% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -4.2% -0.9% -3.3% +10.0% ➖ noise
61 duckdb:duckdb +0.3% -0.9% +1.2% +10.0% ➖ noise
61 duckdb:vortex-compact +24.8% -0.9% +26.0% +10.0% 🚨 regression
61 duckdb:vortex-file-compressed -1.0% -0.9% -0.0% +10.0% ➖ noise
62 datafusion:vortex-compact +3.9% -2.3% +6.4% +13.6% ➖ noise
62 datafusion:vortex-file-compressed -3.7% -2.3% -1.4% +17.5% ➖ noise
62 duckdb:duckdb +1.3% -2.3% +3.7% +21.2% ➖ noise
62 duckdb:vortex-compact +57.2% -2.3% +60.9% +20.9% 🚨 regression
62 duckdb:vortex-file-compressed +31.4% -2.3% +34.5% +25.1% 🚨 regression
63 datafusion:vortex-compact +3.2% -3.3% +6.8% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +3.2% -3.3% +6.7% +12.6% ➖ noise
63 duckdb:duckdb +1.0% -3.3% +4.5% +10.0% ➖ noise
63 duckdb:vortex-compact +49.6% -3.3% +54.8% +25.0% 🚨 regression
63 duckdb:vortex-file-compressed +30.8% -3.3% +35.3% +11.8% 🚨 regression
64 datafusion:vortex-compact +0.5% -0.2% +0.8% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +0.8% -0.2% +1.0% +10.0% ➖ noise
64 duckdb:duckdb -0.7% -0.2% -0.5% +10.0% ➖ noise
64 duckdb:vortex-compact +66.6% -0.2% +67.0% +10.0% 🚨 regression
64 duckdb:vortex-file-compressed +60.8% -0.2% +61.2% +10.0% 🚨 regression
65 datafusion:vortex-compact -1.5% -1.5% -0.0% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +3.4% -1.5% +5.0% +10.3% ➖ noise
65 duckdb:duckdb +7.4% -1.5% +9.0% +15.6% ➖ noise
65 duckdb:vortex-compact +10.1% -1.5% +11.8% +10.2% 🚨 regression
65 duckdb:vortex-file-compressed -3.3% -1.5% -1.8% +12.5% ➖ noise
66 datafusion:vortex-compact -1.7% -4.9% +3.4% +10.0% ➖ noise
66 datafusion:vortex-file-compressed +6.7% -4.9% +12.2% +11.6% 🚨 regression
66 duckdb:duckdb +2.6% -4.9% +7.9% +12.7% ➖ noise
66 duckdb:vortex-compact +17.6% -4.9% +23.6% +15.5% 🚨 regression
66 duckdb:vortex-file-compressed +8.5% -4.9% +14.0% +19.7% ➖ noise
67 datafusion:vortex-compact -3.4% +0.6% -4.0% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -0.5% +0.6% -1.0% +10.0% ➖ noise
67 duckdb:duckdb -0.2% +0.6% -0.8% +10.0% ➖ noise
67 duckdb:vortex-compact +3.3% +0.6% +2.7% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +0.9% +0.6% +0.3% +10.0% ➖ noise
68 datafusion:vortex-compact +1.0% -1.3% +2.4% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -2.0% -1.3% -0.7% +10.0% ➖ noise
68 duckdb:duckdb -0.1% -1.3% +1.2% +10.0% ➖ noise
68 duckdb:vortex-compact +6.5% -1.3% +7.9% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -6.4% -1.3% -5.2% +10.0% ➖ noise
69 datafusion:vortex-compact -0.5% +0.9% -1.4% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +6.0% +0.9% +5.1% +10.0% ➖ noise
69 duckdb:duckdb -6.1% +0.9% -7.0% +10.0% ➖ noise
69 duckdb:vortex-compact +26.2% +0.9% +25.1% +10.0% 🚨 regression
69 duckdb:vortex-file-compressed +6.4% +0.9% +5.5% +13.9% ➖ noise
70 datafusion:vortex-compact +1.5% -0.1% +1.6% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +7.7% -0.1% +7.9% +10.5% ➖ noise
70 duckdb:duckdb +3.3% -0.1% +3.4% +13.1% ➖ noise
70 duckdb:vortex-compact +78.2% -0.1% +78.5% +10.0% 🚨 regression
70 duckdb:vortex-file-compressed +55.0% -0.1% +55.2% +23.6% 🚨 regression
71 datafusion:vortex-compact +1.3% -2.3% +3.7% +15.7% ➖ noise
71 datafusion:vortex-file-compressed -3.1% -2.3% -0.8% +16.5% ➖ noise
71 duckdb:duckdb +8.7% -2.3% +11.3% +19.5% ➖ noise
71 duckdb:vortex-compact +25.4% -2.3% +28.3% +18.9% 🚨 regression
71 duckdb:vortex-file-compressed +13.6% -2.3% +16.2% +17.0% ➖ noise
72 datafusion:vortex-compact -1.3% -1.1% -0.3% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -1.8% -1.1% -0.8% +10.0% ➖ noise
72 duckdb:duckdb +1.3% -1.1% +2.4% +12.2% ➖ noise
72 duckdb:vortex-compact -9.8% -1.1% -8.9% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -8.7% -1.1% -7.7% +10.0% ➖ noise
73 datafusion:vortex-compact +0.3% +3.7% -3.3% +19.3% ➖ noise
73 datafusion:vortex-file-compressed -2.6% +3.7% -6.1% +13.9% ➖ noise
73 duckdb:duckdb +4.9% +3.7% +1.2% +10.0% ➖ noise
73 duckdb:vortex-compact +6.4% +3.7% +2.6% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +7.4% +3.7% +3.6% +10.6% ➖ noise
74 datafusion:vortex-compact -2.1% -0.2% -1.9% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -0.5% -0.2% -0.3% +10.0% ➖ noise
74 duckdb:duckdb -1.4% -0.2% -1.2% +10.0% ➖ noise
74 duckdb:vortex-compact -12.1% -0.2% -11.9% +10.1% ✅ faster
74 duckdb:vortex-file-compressed -19.5% -0.2% -19.3% +10.0% ✅ faster
75 datafusion:vortex-compact +0.2% +1.7% -1.4% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +0.6% +1.7% -1.1% +10.0% ➖ noise
75 duckdb:duckdb +2.3% +1.7% +0.6% +10.0% ➖ noise
75 duckdb:vortex-compact -5.8% +1.7% -7.4% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -15.2% +1.7% -16.6% +11.1% ✅ faster
76 datafusion:vortex-compact +2.0% -1.1% +3.1% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +2.3% -1.1% +3.5% +10.0% ➖ noise
76 duckdb:duckdb +7.1% -1.1% +8.3% +16.8% ➖ noise
76 duckdb:vortex-compact +1.3% -1.1% +2.5% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -22.5% -1.1% -21.7% +18.2% ✅ faster
77 datafusion:vortex-compact -3.6% -1.0% -2.6% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -1.8% -1.0% -0.8% +10.0% ➖ noise
77 duckdb:duckdb +1.3% -1.0% +2.4% +10.0% ➖ noise
77 duckdb:vortex-compact -1.1% -1.0% -0.0% +10.2% ➖ noise
77 duckdb:vortex-file-compressed +8.9% -1.0% +10.0% +10.0% 🚨 regression
78 datafusion:vortex-compact -0.4% +1.6% -2.0% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -1.1% +1.6% -2.6% +10.0% ➖ noise
78 duckdb:duckdb -4.0% +1.6% -5.5% +10.3% ➖ noise
78 duckdb:vortex-compact +12.4% +1.6% +10.7% +10.0% 🚨 regression
78 duckdb:vortex-file-compressed +2.2% +1.6% +0.6% +10.0% ➖ noise
79 datafusion:vortex-compact -2.2% +1.6% -3.7% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -3.3% +1.6% -4.8% +10.0% ➖ noise
79 duckdb:duckdb -1.5% +1.6% -3.1% +11.0% ➖ noise
79 duckdb:vortex-compact +0.8% +1.6% -0.8% +12.9% ➖ noise
79 duckdb:vortex-file-compressed -19.8% +1.6% -21.1% +12.4% ✅ faster
80 datafusion:vortex-compact +0.8% -2.2% +3.1% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -0.7% -2.2% +1.5% +10.0% ➖ noise
80 duckdb:duckdb -2.6% -2.2% -0.4% +11.4% ➖ noise
80 duckdb:vortex-compact -1.4% -2.2% +0.8% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +7.7% -2.2% +10.1% +10.0% 🚨 regression
81 datafusion:vortex-compact +0.5% -2.3% +2.8% +10.1% ➖ noise
81 datafusion:vortex-file-compressed +2.5% -2.3% +4.9% +10.0% ➖ noise
81 duckdb:duckdb +2.8% -2.3% +5.1% +10.0% ➖ noise
81 duckdb:vortex-compact +6.0% -2.3% +8.4% +10.1% ➖ noise
81 duckdb:vortex-file-compressed +2.4% -2.3% +4.8% +10.0% ➖ noise
82 datafusion:vortex-compact -0.4% -1.1% +0.7% +11.5% ➖ noise
82 datafusion:vortex-file-compressed +1.3% -1.1% +2.4% +10.0% ➖ noise
82 duckdb:duckdb -5.7% -1.1% -4.7% +14.0% ➖ noise
82 duckdb:vortex-compact -16.1% -1.1% -15.2% +10.2% ✅ faster
82 duckdb:vortex-file-compressed -21.5% -1.1% -20.7% +14.2% ✅ faster
83 datafusion:vortex-compact -1.7% -4.2% +2.6% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -5.8% -4.2% -1.7% +10.0% ➖ noise
83 duckdb:duckdb +0.2% -4.2% +4.6% +10.7% ➖ noise
83 duckdb:vortex-compact +11.7% -4.2% +16.5% +10.0% 🚨 regression
83 duckdb:vortex-file-compressed +7.4% -4.2% +12.1% +12.1% 🚨 regression
84 datafusion:vortex-compact -4.0% -1.6% -2.5% +10.0% ➖ noise
84 datafusion:vortex-file-compressed +5.5% -1.6% +7.2% +10.0% ➖ noise
84 duckdb:duckdb +3.7% -1.6% +5.4% +10.8% ➖ noise
84 duckdb:vortex-compact +46.1% -1.6% +48.4% +10.0% 🚨 regression
84 duckdb:vortex-file-compressed +45.7% -1.6% +48.1% +12.6% 🚨 regression
85 datafusion:vortex-compact -0.8% +1.8% -2.5% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -0.9% +1.8% -2.6% +10.0% ➖ noise
85 duckdb:duckdb +0.5% +1.8% -1.2% +10.0% ➖ noise
85 duckdb:vortex-compact +102837.8% +1.8% +101026.9% +10.0% 🚨 regression
85 duckdb:vortex-file-compressed +142061.0% +1.8% +139560.0% +13.6% 🚨 regression
86 datafusion:vortex-compact -2.5% +1.7% -4.1% +10.6% ➖ noise
86 datafusion:vortex-file-compressed +2.3% +1.7% +0.6% +13.1% ➖ noise
86 duckdb:duckdb -4.3% +1.7% -5.9% +17.5% ➖ noise
86 duckdb:vortex-compact +8.6% +1.7% +6.8% +25.2% ➖ noise
86 duckdb:vortex-file-compressed +1.5% +1.7% -0.2% +15.4% ➖ noise
87 datafusion:vortex-compact +2.1% +0.1% +2.1% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -0.9% +0.1% -1.0% +10.0% ➖ noise
87 duckdb:duckdb +1.8% +0.1% +1.8% +17.0% ➖ noise
87 duckdb:vortex-compact +3.6% +0.1% +3.6% +10.0% ➖ noise
87 duckdb:vortex-file-compressed +9.8% +0.1% +9.7% +12.8% ➖ noise
88 datafusion:vortex-compact -0.1% -0.5% +0.4% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -2.1% -0.5% -1.6% +10.0% ➖ noise
88 duckdb:duckdb -0.9% -0.5% -0.5% +10.7% ➖ noise
88 duckdb:vortex-compact -12.1% -0.5% -11.7% +10.0% ✅ faster
88 duckdb:vortex-file-compressed -6.4% -0.5% -5.9% +10.0% ➖ noise
89 datafusion:vortex-compact +2.3% +2.2% +0.0% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +1.5% +2.2% -0.7% +10.0% ➖ noise
89 duckdb:duckdb +7.8% +2.2% +5.4% +10.6% ➖ noise
89 duckdb:vortex-compact +50.4% +2.2% +47.2% +11.5% 🚨 regression
89 duckdb:vortex-file-compressed +31.2% +2.2% +28.3% +10.6% 🚨 regression
90 datafusion:vortex-compact -1.0% -7.4% +6.9% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -4.1% -7.4% +3.5% +10.0% ➖ noise
90 duckdb:duckdb -3.5% -7.4% +4.3% +10.0% ➖ noise
90 duckdb:vortex-compact -26.2% -7.4% -20.3% +10.4% ✅ faster
90 duckdb:vortex-file-compressed -20.3% -7.4% -13.9% +11.2% ✅ faster
91 datafusion:vortex-compact -5.7% -1.9% -3.8% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +4.6% -1.9% +6.7% +10.0% ➖ noise
91 duckdb:duckdb +5.8% -1.9% +7.8% +15.0% ➖ noise
91 duckdb:vortex-compact -0.8% -1.9% +1.1% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +10.4% -1.9% +12.5% +12.1% 🚨 regression
92 datafusion:vortex-compact -0.2% -0.7% +0.5% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -1.5% -0.7% -0.7% +10.0% ➖ noise
92 duckdb:duckdb -8.4% -0.7% -7.8% +13.8% ➖ noise
92 duckdb:vortex-compact +106.2% -0.7% +107.7% +22.9% 🚨 regression
92 duckdb:vortex-file-compressed +40.3% -0.7% +41.3% +14.9% 🚨 regression
93 datafusion:vortex-compact +1.4% -0.4% +1.8% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -2.7% -0.4% -2.3% +10.0% ➖ noise
93 duckdb:duckdb +4.9% -0.4% +5.3% +15.4% ➖ noise
93 duckdb:vortex-compact +2.8% -0.4% +3.2% +11.4% ➖ noise
93 duckdb:vortex-file-compressed -6.4% -0.4% -6.1% +14.1% ➖ noise
94 datafusion:vortex-compact +1.0% +1.9% -0.9% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +0.0% +1.9% -1.9% +10.0% ➖ noise
94 duckdb:duckdb -5.8% +1.9% -7.5% +10.4% ➖ noise
94 duckdb:vortex-compact +89.8% +1.9% +86.3% +11.4% 🚨 regression
94 duckdb:vortex-file-compressed +106.1% +1.9% +102.2% +10.0% 🚨 regression
95 datafusion:vortex-compact +1.0% +7.3% -5.9% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +0.1% +7.3% -6.7% +10.0% ➖ noise
95 duckdb:duckdb +4.3% +7.3% -2.8% +17.5% ➖ noise
95 duckdb:vortex-compact +63.0% +7.3% +52.0% +13.6% 🚨 regression
95 duckdb:vortex-file-compressed +59.9% +7.3% +49.1% +13.4% 🚨 regression
96 datafusion:vortex-compact +1.6% -0.3% +1.9% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -0.1% -0.3% +0.2% +10.0% ➖ noise
96 duckdb:duckdb -1.7% -0.3% -1.4% +18.2% ➖ noise
96 duckdb:vortex-compact +19.2% -0.3% +19.5% +13.9% 🚨 regression
96 duckdb:vortex-file-compressed +26.0% -0.3% +26.4% +11.0% 🚨 regression
97 datafusion:vortex-compact +1.0% +2.4% -1.3% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -1.1% +2.4% -3.4% +10.0% ➖ noise
97 duckdb:duckdb +4.6% +2.4% +2.1% +12.0% ➖ noise
97 duckdb:vortex-compact -5.3% +2.4% -7.5% +14.2% ➖ noise
97 duckdb:vortex-file-compressed +7.0% +2.4% +4.5% +14.2% ➖ noise
98 datafusion:vortex-compact -2.2% +4.8% -6.6% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -0.5% +4.8% -5.1% +11.5% ➖ noise
98 duckdb:duckdb +2.6% +4.8% -2.1% +14.1% ➖ noise
98 duckdb:vortex-compact +27.8% +4.8% +21.9% +10.8% 🚨 regression
98 duckdb:vortex-file-compressed +7.9% +4.8% +3.0% +13.4% ➖ noise
99 datafusion:vortex-compact -0.0% -2.1% +2.2% +11.9% ➖ noise
99 datafusion:vortex-file-compressed +1.5% -2.1% +3.7% +11.2% ➖ noise
99 duckdb:duckdb +0.1% -2.1% +2.3% +20.7% ➖ noise
99 duckdb:vortex-compact +27.2% -2.1% +30.0% +23.6% 🚨 regression
99 duckdb:vortex-file-compressed +20.4% -2.1% +23.0% +14.3% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 7, 2026

Benchmarks: Compression

Vortex (geomean): 1.008x ➖
Parquet (geomean): 1.021x ➖


unknown / unknown (1.029x ➖, 1↑ 12↓)
name PR a714ea6 (ns) base 6c7eb33 (ns) ratio (PR/base)
compress time/Arade 1237484365 1192465228 1.04
compress time/Bimbo 7355025877 7213034440 1.02
compress time/CMSprovider 3095277315 3047520263 1.02
compress time/Euro2016 471105825 440225989 1.07
compress time/Food 407467328 381713620 1.07
compress time/HashTags 836593959 830086957 1.01
compress time/TPC-H l_comment canonical 1357674081 1308362595 1.04
compress time/TPC-H l_comment chunked 1383324779 1312023091 1.05
compress time/taxi 741061618 712620318 1.04
compress time/wide table cols=100 chunks=1 rows=1000 🚨 13185723 10991248 1.20
compress time/wide table cols=100 chunks=50 rows=1000 🚨 13946425 12559926 1.11
compress time/wide table cols=1000 chunks=1 rows=1000 133340623 124328334 1.07
compress time/wide table cols=1000 chunks=50 rows=1000 135751851 126055475 1.08
compress time/wide table cols=10000 chunks=1 rows=1000 1298525498 1277710001 1.02
compress time/wide table cols=10000 chunks=50 rows=1000 1316371654 1247999567 1.05
decompress time/Arade 33834178 31530794 1.07
decompress time/Bimbo 127075773 117005399 1.09
decompress time/CMSprovider 93230195 85397745 1.09
decompress time/Euro2016 🚨 22534630 20286832 1.11
decompress time/Food 10095452 9593607 1.05
decompress time/HashTags 87329567 84561874 1.03
decompress time/TPC-H l_comment canonical 44493514 42985766 1.04
decompress time/TPC-H l_comment chunked 45294069 41296460 1.10
decompress time/taxi 23870335 22142872 1.08
decompress time/wide table cols=100 chunks=1 rows=1000 2787747 2789494 1.00
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 2959559 2572462 1.15
decompress time/wide table cols=1000 chunks=1 rows=1000 24124387 23162472 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 23891956 23555625 1.01
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 263418167 236134308 1.12
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 264426026 234125953 1.13
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3204609485 3073940944 1.04
parquet_rs-zstd compress time/Bimbo 18086843941 17965777996 1.01
parquet_rs-zstd compress time/CMSprovider 8437136835 7865866143 1.07
parquet_rs-zstd compress time/Euro2016 1420621000 1355849804 1.05
parquet_rs-zstd compress time/Food 965954906 961002878 1.01
parquet_rs-zstd compress time/HashTags 2701905484 2490632946 1.08
parquet_rs-zstd compress time/TPC-H l_comment canonical 3247108907 3120980671 1.04
parquet_rs-zstd compress time/TPC-H l_comment chunked 3239188684 3124989708 1.04
parquet_rs-zstd compress time/taxi 1587123351 1564279731 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 8191339 6886670 1.19
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 8243558 6923912 1.19
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 92710669 89329012 1.04
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 93773980 87735584 1.07
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 906090322 914590375 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 910389436 933732154 0.98
parquet_rs-zstd decompress time/Arade 670523357 651035904 1.03
parquet_rs-zstd decompress time/Bimbo 1848649895 1767363062 1.05
parquet_rs-zstd decompress time/CMSprovider 2058418184 1953840587 1.05
parquet_rs-zstd decompress time/Euro2016 399218216 390226316 1.02
parquet_rs-zstd decompress time/Food 231280680 222759124 1.04
parquet_rs-zstd decompress time/HashTags 🚨 718592778 637684306 1.13
parquet_rs-zstd decompress time/TPC-H l_comment canonical 589681334 573953716 1.03
parquet_rs-zstd decompress time/TPC-H l_comment chunked 594057223 575696978 1.03
parquet_rs-zstd decompress time/taxi 258387244 249784627 1.03
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3070068 2671661 1.15
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2923676 2768292 1.06
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34100096 33026245 1.03
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 34281090 32139629 1.07
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 375288872 379302110 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 375256517 374291778 1.00
vortex-file-compressed size/Arade 143589172 143589172 1.00
vortex-file-compressed size/Bimbo 510398836 510398836 1.00
vortex-file-compressed size/CMSprovider 448301188 448301188 1.00
vortex-file-compressed size/Euro2016 164458044 164458044 1.00
vortex-file-compressed size/Food 44206912 44206912 1.00
vortex-file-compressed size/HashTags 195860188 195860188 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179476760 179476760 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179476760 179476760 1.00
vortex-file-compressed size/taxi 51036356 51036356 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317616 88317616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317616 88317616 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.95
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio compress time/Food 0 0 1.06
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.93
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 1.02
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.93
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.08
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.04
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.04
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.04
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.09
vortex:parquet-zstd ratio decompress time/Food 0 0 1.01
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.92
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.06
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 🚀 0 1 0.87
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.13
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 7, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do not merge Pull requests that are not intended to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants