Skip to content

Push mask through scalar functions#7363

Draft
gatesn wants to merge 1 commit intodevelopfrom
ngates/mask-scalar-fn
Draft

Push mask through scalar functions#7363
gatesn wants to merge 1 commit intodevelopfrom
ngates/mask-scalar-fn

Conversation

@gatesn
Copy link
Copy Markdown
Contributor

@gatesn gatesn commented Apr 9, 2026

Per the null-sensitive property

Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn added changelog/performance A performance improvement action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 9, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 9, 2026
@gatesn gatesn requested a review from joseph-isaacs April 9, 2026 14:12
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 56a16a8 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.986x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -1.1%


datafusion / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50033874 49448704 1.01
tpch_q02/datafusion:vortex-file-compressed 32172865 33333570 0.97
tpch_q03/datafusion:vortex-file-compressed 26160972 26670597 0.98
tpch_q04/datafusion:vortex-file-compressed 17078233 18429366 0.93
tpch_q05/datafusion:vortex-file-compressed 51708899 53619596 0.96
tpch_q06/datafusion:vortex-file-compressed 10050945 9624595 1.04
tpch_q07/datafusion:vortex-file-compressed 62656625 63572635 0.99
tpch_q08/datafusion:vortex-file-compressed 45755344 44568466 1.03
tpch_q09/datafusion:vortex-file-compressed 53640305 55160909 0.97
tpch_q10/datafusion:vortex-file-compressed 43294270 43951328 0.99
tpch_q11/datafusion:vortex-file-compressed 17924647 17938609 1.00
tpch_q12/datafusion:vortex-file-compressed 21703790 22318152 0.97
tpch_q13/datafusion:vortex-file-compressed 28567615 26959662 1.06
tpch_q14/datafusion:vortex-file-compressed 15398617 15411941 1.00
tpch_q15/datafusion:vortex-file-compressed 23771852 23582442 1.01
tpch_q16/datafusion:vortex-file-compressed 23661438 24914722 0.95
tpch_q17/datafusion:vortex-file-compressed 66134702 62903659 1.05
tpch_q18/datafusion:vortex-file-compressed 76108220 78369828 0.97
tpch_q19/datafusion:vortex-file-compressed 22136656 24041448 0.92
tpch_q20/datafusion:vortex-file-compressed 32328119 32792628 0.99
tpch_q21/datafusion:vortex-file-compressed 72993189 74717243 0.98
tpch_q22/datafusion:vortex-file-compressed 16466479 16724007 0.98
datafusion / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 56736205 58409870 0.97
tpch_q02/datafusion:vortex-compact 35907045 37455492 0.96
tpch_q03/datafusion:vortex-compact 31021342 30756364 1.01
tpch_q04/datafusion:vortex-compact 22827225 23089868 0.99
tpch_q05/datafusion:vortex-compact 57668661 55751818 1.03
tpch_q06/datafusion:vortex-compact 13393200 13262890 1.01
tpch_q07/datafusion:vortex-compact 68112951 69379725 0.98
tpch_q08/datafusion:vortex-compact 48703033 49289088 0.99
tpch_q09/datafusion:vortex-compact 60779592 61158978 0.99
tpch_q10/datafusion:vortex-compact 51676621 52953662 0.98
tpch_q11/datafusion:vortex-compact 19409471 19180173 1.01
tpch_q12/datafusion:vortex-compact 32973170 32600802 1.01
tpch_q13/datafusion:vortex-compact 38113005 35841405 1.06
tpch_q14/datafusion:vortex-compact 20465479 20577522 0.99
tpch_q15/datafusion:vortex-compact 32479114 33618394 0.97
tpch_q16/datafusion:vortex-compact 29069336 29442093 0.99
tpch_q17/datafusion:vortex-compact 68091898 69749150 0.98
tpch_q18/datafusion:vortex-compact 84100111 84998583 0.99
tpch_q19/datafusion:vortex-compact 31483783 32870757 0.96
tpch_q20/datafusion:vortex-compact 37117053 37635686 0.99
tpch_q21/datafusion:vortex-compact 85344255 87745766 0.97
tpch_q22/datafusion:vortex-compact 18256976 18597032 0.98
datafusion / parquet (0.992x ➖, 3↑ 2↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 132974947 93526477 1.42
tpch_q02/datafusion:parquet 68335091 69717421 0.98
tpch_q03/datafusion:parquet 🚀 69485133 81699874 0.85
tpch_q04/datafusion:parquet 47215652 48746317 0.97
tpch_q05/datafusion:parquet 105367502 103909353 1.01
tpch_q06/datafusion:parquet 🚀 33418475 45122896 0.74
tpch_q07/datafusion:parquet 115287964 110184588 1.05
tpch_q08/datafusion:parquet 102422202 100223902 1.02
tpch_q09/datafusion:parquet 128132960 135221999 0.95
tpch_q10/datafusion:parquet 118962994 118794841 1.00
tpch_q11/datafusion:parquet 47396364 48075973 0.99
tpch_q12/datafusion:parquet 🚨 95600116 80744655 1.18
tpch_q13/datafusion:parquet 201589076 207809208 0.97
tpch_q14/datafusion:parquet 44677672 49572821 0.90
tpch_q15/datafusion:parquet 🚀 63582938 71539168 0.89
tpch_q16/datafusion:parquet 49574403 49607610 1.00
tpch_q17/datafusion:parquet 148672168 139036789 1.07
tpch_q18/datafusion:parquet 163049989 173752558 0.94
tpch_q19/datafusion:parquet 92687318 93580327 0.99
tpch_q20/datafusion:parquet 77786181 77487720 1.00
tpch_q21/datafusion:parquet 151504994 144615120 1.05
tpch_q22/datafusion:parquet 34608093 34199340 1.01
datafusion / arrow (0.988x ➖, 1↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 52692140 56012613 0.94
tpch_q02/datafusion:arrow 21861436 22054258 0.99
tpch_q03/datafusion:arrow 32265231 32767360 0.98
tpch_q04/datafusion:arrow 26782200 27266653 0.98
tpch_q05/datafusion:arrow 74801567 81820858 0.91
tpch_q06/datafusion:arrow 19345131 21011776 0.92
tpch_q07/datafusion:arrow 108192021 113378071 0.95
tpch_q08/datafusion:arrow 43259379 44382542 0.97
tpch_q09/datafusion:arrow 69576047 68441484 1.02
tpch_q10/datafusion:arrow 53682617 50611399 1.06
tpch_q11/datafusion:arrow 12142626 11247754 1.08
tpch_q12/datafusion:arrow 🚨 61289174 54414922 1.13
tpch_q13/datafusion:arrow 49733951 47826382 1.04
tpch_q14/datafusion:arrow 22222784 22697139 0.98
tpch_q15/datafusion:arrow 43609771 43173102 1.01
tpch_q16/datafusion:arrow 20717549 20821422 1.00
tpch_q17/datafusion:arrow 68675015 70522221 0.97
tpch_q18/datafusion:arrow 141967406 143728740 0.99
tpch_q19/datafusion:arrow 🚀 37943272 44180975 0.86
tpch_q20/datafusion:arrow 39217490 41408645 0.95
tpch_q21/datafusion:arrow 153112190 152014899 1.01
tpch_q22/datafusion:arrow 20027431 19340913 1.04
duckdb / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32658091 33370955 0.98
tpch_q02/duckdb:vortex-file-compressed 27469304 27059520 1.02
tpch_q03/duckdb:vortex-file-compressed 29258412 28210371 1.04
tpch_q04/duckdb:vortex-file-compressed 27736694 29418526 0.94
tpch_q05/duckdb:vortex-file-compressed 34321096 33951525 1.01
tpch_q06/duckdb:vortex-file-compressed 10842658 11067102 0.98
tpch_q07/duckdb:vortex-file-compressed 37263891 37530719 0.99
tpch_q08/duckdb:vortex-file-compressed 39194974 39540746 0.99
tpch_q09/duckdb:vortex-file-compressed 80149454 85317243 0.94
tpch_q10/duckdb:vortex-file-compressed 36293010 35591186 1.02
tpch_q11/duckdb:vortex-file-compressed 15198290 16504340 0.92
tpch_q12/duckdb:vortex-file-compressed 22341856 21892755 1.02
tpch_q13/duckdb:vortex-file-compressed 36599595 39005916 0.94
tpch_q14/duckdb:vortex-file-compressed 21382343 22211603 0.96
tpch_q15/duckdb:vortex-file-compressed 15983200 16123237 0.99
tpch_q16/duckdb:vortex-file-compressed 29208473 29467837 0.99
tpch_q17/duckdb:vortex-file-compressed 24693984 25152814 0.98
tpch_q18/duckdb:vortex-file-compressed 47733462 45199147 1.06
tpch_q19/duckdb:vortex-file-compressed 31576099 31663963 1.00
tpch_q20/duckdb:vortex-file-compressed 35035062 34801536 1.01
tpch_q21/duckdb:vortex-file-compressed 99734435 102256418 0.98
tpch_q22/duckdb:vortex-file-compressed 18039324 18621686 0.97
duckdb / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39028606 38835031 1.00
tpch_q02/duckdb:vortex-compact 37443752 37149924 1.01
tpch_q03/duckdb:vortex-compact 31516610 32791965 0.96
tpch_q04/duckdb:vortex-compact 33883627 35317555 0.96
tpch_q05/duckdb:vortex-compact 36983145 36410727 1.02
tpch_q06/duckdb:vortex-compact 13964290 14835943 0.94
tpch_q07/duckdb:vortex-compact 42085687 42835614 0.98
tpch_q08/duckdb:vortex-compact 45341464 45687856 0.99
tpch_q09/duckdb:vortex-compact 84395422 91141173 0.93
tpch_q10/duckdb:vortex-compact 40266072 40572951 0.99
tpch_q11/duckdb:vortex-compact 20331120 21622805 0.94
tpch_q12/duckdb:vortex-compact 36049509 35091869 1.03
tpch_q13/duckdb:vortex-compact 44123231 44254190 1.00
tpch_q14/duckdb:vortex-compact 29775666 30668923 0.97
tpch_q15/duckdb:vortex-compact 18886965 19896591 0.95
tpch_q16/duckdb:vortex-compact 36777012 37727822 0.97
tpch_q17/duckdb:vortex-compact 29878599 30268095 0.99
tpch_q18/duckdb:vortex-compact 49591494 50608186 0.98
tpch_q19/duckdb:vortex-compact 36325642 35968321 1.01
tpch_q20/duckdb:vortex-compact 43348817 43607384 0.99
tpch_q21/duckdb:vortex-compact 110158423 112278653 0.98
tpch_q22/duckdb:vortex-compact 20545754 20991189 0.98
duckdb / parquet (1.001x ➖, 3↑ 2↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 108663813 83911522 1.29
tpch_q02/duckdb:parquet 38256076 39627892 0.97
tpch_q03/duckdb:parquet 69521231 69591500 1.00
tpch_q04/duckdb:parquet 47438938 46941818 1.01
tpch_q05/duckdb:parquet 67314339 67701216 0.99
tpch_q06/duckdb:parquet 20332694 20320252 1.00
tpch_q07/duckdb:parquet 76268758 69958800 1.09
tpch_q08/duckdb:parquet 81135436 81796513 0.99
tpch_q09/duckdb:parquet 🚀 133681525 153480159 0.87
tpch_q10/duckdb:parquet 137453009 127155841 1.08
tpch_q11/duckdb:parquet 23067330 22634479 1.02
tpch_q12/duckdb:parquet 44206223 45889369 0.96
tpch_q13/duckdb:parquet 260591336 264351404 0.99
tpch_q14/duckdb:parquet 🚀 48732188 58286232 0.84
tpch_q15/duckdb:parquet 31900569 31420390 1.02
tpch_q16/duckdb:parquet 54391419 54474759 1.00
tpch_q17/duckdb:parquet 60675871 58370166 1.04
tpch_q18/duckdb:parquet 119783410 125852819 0.95
tpch_q19/duckdb:parquet 🚀 67699085 85276223 0.79
tpch_q20/duckdb:parquet 🚨 80152881 62402080 1.28
tpch_q21/duckdb:parquet 173928741 178478994 0.97
tpch_q22/duckdb:parquet 52175177 52701240 0.99
duckdb / duckdb (0.992x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15974798 15964793 1.00
tpch_q02/duckdb:duckdb 12093945 11790183 1.03
tpch_q03/duckdb:duckdb 18807011 19308266 0.97
tpch_q04/duckdb:duckdb 19299057 18312801 1.05
tpch_q05/duckdb:duckdb 19625787 19852583 0.99
tpch_q06/duckdb:duckdb 5313395 5209716 1.02
tpch_q07/duckdb:duckdb 22291164 22506300 0.99
tpch_q08/duckdb:duckdb 20618324 20604955 1.00
tpch_q09/duckdb:duckdb 50716484 54752343 0.93
tpch_q10/duckdb:duckdb 42952325 42446489 1.01
tpch_q11/duckdb:duckdb 5647254 5770205 0.98
tpch_q12/duckdb:duckdb 13206113 13669715 0.97
tpch_q13/duckdb:duckdb 38112058 36155292 1.05
tpch_q14/duckdb:duckdb 15854296 16812229 0.94
tpch_q15/duckdb:duckdb 11801440 11787078 1.00
tpch_q16/duckdb:duckdb 22316576 22858176 0.98
tpch_q17/duckdb:duckdb 13505259 13530262 1.00
tpch_q18/duckdb:duckdb 37404484 38522356 0.97
tpch_q19/duckdb:duckdb 25655331 26414282 0.97
tpch_q20/duckdb:duckdb 21889836 22547001 0.97
tpch_q21/duckdb:duckdb 56402193 56041622 1.01
tpch_q22/duckdb:duckdb 24024845 23813925 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -5.9% +35.7% -30.7% +32.6% ✅ faster
1 datafusion:vortex-compact -2.9% +35.7% -28.4% +29.2% ✅ faster
1 datafusion:vortex-file-compressed +1.2% +35.7% -25.4% +30.8% ✅ faster
1 duckdb:duckdb +0.1% +35.7% -26.3% +29.8% ✅ faster
1 duckdb:vortex-compact +0.5% +35.7% -25.9% +28.9% ✅ faster
1 duckdb:vortex-file-compressed -2.1% +35.7% -27.9% +29.7% ✅ faster
2 datafusion:arrow -0.9% -2.7% +1.9% +28.8% ➖ noise
2 datafusion:vortex-compact -4.1% -2.7% -1.4% +28.8% ➖ noise
2 datafusion:vortex-file-compressed -3.5% -2.7% -0.8% +28.8% ➖ noise
2 duckdb:duckdb +2.6% -2.7% +5.4% +28.8% ➖ noise
2 duckdb:vortex-compact +0.8% -2.7% +3.6% +28.8% ➖ noise
2 duckdb:vortex-file-compressed +1.5% -2.7% +4.4% +28.8% ➖ noise
3 datafusion:arrow -1.5% -7.8% +6.8% +28.8% ➖ noise
3 datafusion:vortex-compact +0.9% -7.8% +9.4% +28.8% ➖ noise
3 datafusion:vortex-file-compressed -1.9% -7.8% +6.4% +28.8% ➖ noise
3 duckdb:duckdb -2.6% -7.8% +5.7% +28.8% ➖ noise
3 duckdb:vortex-compact -3.9% -7.8% +4.3% +28.8% ➖ noise
3 duckdb:vortex-file-compressed +3.7% -7.8% +12.5% +28.8% ➖ noise
4 datafusion:arrow -1.8% -1.1% -0.7% +28.8% ➖ noise
4 datafusion:vortex-compact -1.1% -1.1% -0.1% +28.8% ➖ noise
4 datafusion:vortex-file-compressed -7.3% -1.1% -6.3% +28.8% ➖ noise
4 duckdb:duckdb +5.4% -1.1% +6.5% +28.8% ➖ noise
4 duckdb:vortex-compact -4.1% -1.1% -3.0% +28.8% ➖ noise
4 duckdb:vortex-file-compressed -5.7% -1.1% -4.7% +28.8% ➖ noise
5 datafusion:arrow -8.6% +0.4% -9.0% +28.8% ➖ noise
5 datafusion:vortex-compact +3.4% +0.4% +3.0% +28.8% ➖ noise
5 datafusion:vortex-file-compressed -3.6% +0.4% -4.0% +28.8% ➖ noise
5 duckdb:duckdb -1.1% +0.4% -1.5% +28.8% ➖ noise
5 duckdb:vortex-compact +1.6% +0.4% +1.2% +28.8% ➖ noise
5 duckdb:vortex-file-compressed +1.1% +0.4% +0.7% +28.8% ➖ noise
6 datafusion:arrow -7.9% -13.9% +7.0% +28.8% ➖ noise
6 datafusion:vortex-compact +1.0% -13.9% +17.3% +28.8% ➖ noise
6 datafusion:vortex-file-compressed +4.4% -13.9% +21.3% +28.8% ➖ noise
6 duckdb:duckdb +2.0% -13.9% +18.5% +28.8% ➖ noise
6 duckdb:vortex-compact -5.9% -13.9% +9.3% +28.8% ➖ noise
6 duckdb:vortex-file-compressed -2.0% -13.9% +13.8% +28.8% ➖ noise
7 datafusion:arrow -4.6% +6.8% -10.7% +28.8% ➖ noise
7 datafusion:vortex-compact -1.8% +6.8% -8.1% +28.8% ➖ noise
7 datafusion:vortex-file-compressed -1.4% +6.8% -7.7% +28.8% ➖ noise
7 duckdb:duckdb -1.0% +6.8% -7.3% +28.8% ➖ noise
7 duckdb:vortex-compact -1.8% +6.8% -8.0% +28.8% ➖ noise
7 duckdb:vortex-file-compressed -0.7% +6.8% -7.0% +28.8% ➖ noise
8 datafusion:arrow -2.5% +0.7% -3.2% +28.8% ➖ noise
8 datafusion:vortex-compact -1.2% +0.7% -1.9% +28.8% ➖ noise
8 datafusion:vortex-file-compressed +2.7% +0.7% +2.0% +28.8% ➖ noise
8 duckdb:duckdb +0.1% +0.7% -0.6% +28.8% ➖ noise
8 duckdb:vortex-compact -0.8% +0.7% -1.4% +28.8% ➖ noise
8 duckdb:vortex-file-compressed -0.9% +0.7% -1.5% +28.8% ➖ noise
9 datafusion:arrow +1.7% -9.2% +11.9% +28.8% ➖ noise
9 datafusion:vortex-compact -0.6% -9.2% +9.4% +28.8% ➖ noise
9 datafusion:vortex-file-compressed -2.8% -9.2% +7.0% +28.8% ➖ noise
9 duckdb:duckdb -7.4% -9.2% +2.0% +28.8% ➖ noise
9 duckdb:vortex-compact -7.4% -9.2% +1.9% +28.8% ➖ noise
9 duckdb:vortex-file-compressed -6.1% -9.2% +3.4% +28.8% ➖ noise
10 datafusion:arrow +6.1% +4.0% +1.9% +28.8% ➖ noise
10 datafusion:vortex-compact -2.4% +4.0% -6.2% +28.8% ➖ noise
10 datafusion:vortex-file-compressed -1.5% +4.0% -5.3% +28.8% ➖ noise
10 duckdb:duckdb +1.2% +4.0% -2.7% +28.8% ➖ noise
10 duckdb:vortex-compact -0.8% +4.0% -4.6% +28.8% ➖ noise
10 duckdb:vortex-file-compressed +2.0% +4.0% -2.0% +28.8% ➖ noise
11 datafusion:arrow +8.0% +0.2% +7.7% +30.7% ➖ noise
11 datafusion:vortex-compact +1.2% +0.2% +1.0% +28.8% ➖ noise
11 datafusion:vortex-file-compressed -0.1% +0.2% -0.3% +28.8% ➖ noise
11 duckdb:duckdb -2.1% +0.2% -2.4% +28.8% ➖ noise
11 duckdb:vortex-compact -6.0% +0.2% -6.2% +28.8% ➖ noise
11 duckdb:vortex-file-compressed -7.9% +0.2% -8.1% +28.8% ➖ noise
12 datafusion:arrow +12.6% +6.8% +5.5% +28.8% ➖ noise
12 datafusion:vortex-compact +1.1% +6.8% -5.3% +28.8% ➖ noise
12 datafusion:vortex-file-compressed -2.8% +6.8% -8.9% +28.8% ➖ noise
12 duckdb:duckdb -3.4% +6.8% -9.5% +28.8% ➖ noise
12 duckdb:vortex-compact +2.7% +6.8% -3.8% +28.8% ➖ noise
12 duckdb:vortex-file-compressed +2.1% +6.8% -4.4% +28.8% ➖ noise
13 datafusion:arrow +4.0% -2.2% +6.3% +28.8% ➖ noise
13 datafusion:vortex-compact +6.3% -2.2% +8.7% +28.8% ➖ noise
13 datafusion:vortex-file-compressed +6.0% -2.2% +8.4% +28.8% ➖ noise
13 duckdb:duckdb +5.4% -2.2% +7.8% +28.8% ➖ noise
13 duckdb:vortex-compact -0.3% -2.2% +2.0% +28.8% ➖ noise
13 duckdb:vortex-file-compressed -6.2% -2.2% -4.0% +28.8% ➖ noise
14 datafusion:arrow -2.1% -13.2% +12.8% +28.8% ➖ noise
14 datafusion:vortex-compact -0.5% -13.2% +14.6% +28.8% ➖ noise
14 datafusion:vortex-file-compressed -0.1% -13.2% +15.1% +28.8% ➖ noise
14 duckdb:duckdb -5.7% -13.2% +8.6% +28.8% ➖ noise
14 duckdb:vortex-compact -2.9% -13.2% +11.8% +28.8% ➖ noise
14 duckdb:vortex-file-compressed -3.7% -13.2% +10.9% +28.8% ➖ noise
15 datafusion:arrow +1.0% -5.0% +6.3% +28.8% ➖ noise
15 datafusion:vortex-compact -3.4% -5.0% +1.7% +28.8% ➖ noise
15 datafusion:vortex-file-compressed +0.8% -5.0% +6.1% +28.8% ➖ noise
15 duckdb:duckdb +0.1% -5.0% +5.4% +28.8% ➖ noise
15 duckdb:vortex-compact -5.1% -5.0% -0.1% +28.8% ➖ noise
15 duckdb:vortex-file-compressed -0.9% -5.0% +4.4% +28.8% ➖ noise
16 datafusion:arrow -0.5% -0.1% -0.4% +28.8% ➖ noise
16 datafusion:vortex-compact -1.3% -0.1% -1.2% +28.8% ➖ noise
16 datafusion:vortex-file-compressed -5.0% -0.1% -4.9% +28.8% ➖ noise
16 duckdb:duckdb -2.4% -0.1% -2.3% +28.8% ➖ noise
16 duckdb:vortex-compact -2.5% -0.1% -2.4% +28.8% ➖ noise
16 duckdb:vortex-file-compressed -0.9% -0.1% -0.8% +28.8% ➖ noise
17 datafusion:arrow -2.6% +5.4% -7.6% +28.8% ➖ noise
17 datafusion:vortex-compact -2.4% +5.4% -7.4% +28.8% ➖ noise
17 datafusion:vortex-file-compressed +5.1% +5.4% -0.3% +28.8% ➖ noise
17 duckdb:duckdb -0.2% +5.4% -5.3% +28.8% ➖ noise
17 duckdb:vortex-compact -1.3% +5.4% -6.4% +28.8% ➖ noise
17 duckdb:vortex-file-compressed -1.8% +5.4% -6.9% +28.8% ➖ noise
18 datafusion:arrow -1.2% -5.5% +4.5% +28.8% ➖ noise
18 datafusion:vortex-compact -1.1% -5.5% +4.7% +28.8% ➖ noise
18 datafusion:vortex-file-compressed -2.9% -5.5% +2.8% +28.8% ➖ noise
18 duckdb:duckdb -2.9% -5.5% +2.7% +28.8% ➖ noise
18 duckdb:vortex-compact -2.0% -5.5% +3.7% +28.8% ➖ noise
18 duckdb:vortex-file-compressed +5.6% -5.5% +11.7% +28.8% ➖ noise
19 datafusion:arrow -14.1% -11.3% -3.1% +28.8% ➖ noise
19 datafusion:vortex-compact -4.2% -11.3% +8.0% +28.8% ➖ noise
19 datafusion:vortex-file-compressed -7.9% -11.3% +3.8% +28.8% ➖ noise
19 duckdb:duckdb -2.9% -11.3% +9.5% +28.8% ➖ noise
19 duckdb:vortex-compact +1.0% -11.3% +13.9% +28.8% ➖ noise
19 duckdb:vortex-file-compressed -0.3% -11.3% +12.5% +28.8% ➖ noise
20 datafusion:arrow -5.3% +13.6% -16.6% +28.8% ➖ noise
20 datafusion:vortex-compact -1.4% +13.6% -13.1% +28.8% ➖ noise
20 datafusion:vortex-file-compressed -1.4% +13.6% -13.2% +28.8% ➖ noise
20 duckdb:duckdb -2.9% +13.6% -14.5% +28.8% ➖ noise
20 duckdb:vortex-compact -0.6% +13.6% -12.5% +28.8% ➖ noise
20 duckdb:vortex-file-compressed +0.7% +13.6% -11.3% +28.8% ➖ noise
21 datafusion:arrow +0.7% +1.0% -0.3% +28.8% ➖ noise
21 datafusion:vortex-compact -2.7% +1.0% -3.7% +28.8% ➖ noise
21 datafusion:vortex-file-compressed -2.3% +1.0% -3.3% +28.8% ➖ noise
21 duckdb:duckdb +0.6% +1.0% -0.4% +28.8% ➖ noise
21 duckdb:vortex-compact -1.9% +1.0% -2.9% +28.8% ➖ noise
21 duckdb:vortex-file-compressed -2.5% +1.0% -3.5% +28.8% ➖ noise
22 datafusion:arrow +3.5% +0.1% +3.5% +28.8% ➖ noise
22 datafusion:vortex-compact -1.8% +0.1% -1.9% +28.8% ➖ noise
22 datafusion:vortex-file-compressed -1.5% +0.1% -1.6% +28.8% ➖ noise
22 duckdb:duckdb +0.9% +0.1% +0.8% +28.8% ➖ noise
22 duckdb:vortex-compact -2.1% +0.1% -2.2% +28.8% ➖ noise
22 duckdb:vortex-file-compressed -3.1% +0.1% -3.2% +28.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.052x ➖


datafusion / vortex-file-compressed (1.052x ➖, 0↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 126693931 122774004 1.03
polarsignals_q01/datafusion:vortex-file-compressed 367826047 361067618 1.02
polarsignals_q02/datafusion:vortex-file-compressed 22847915 21938282 1.04
polarsignals_q03/datafusion:vortex-file-compressed 380202007 365133119 1.04
polarsignals_q04/datafusion:vortex-file-compressed 12070851 10989675 1.10
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17439799 15318914 1.14
polarsignals_q06/datafusion:vortex-file-compressed 19720656 17999925 1.10
polarsignals_q07/datafusion:vortex-file-compressed 14648067 13569367 1.08
polarsignals_q08/datafusion:vortex-file-compressed 462929741 460792289 1.00
polarsignals_q09/datafusion:vortex-file-compressed 10744042 10928195 0.98

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.7%
Vortex (geomean): 1.118x ❌
Parquet (geomean): 1.089x ➖
Shifts: Parquet (control) +8.9% · Median polish +9.7%


datafusion / vortex-file-compressed (1.129x ❌, 0↑ 6↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6338984 4596066 1.38
fineweb_q01/datafusion:vortex-file-compressed 🚨 28932763 25726704 1.12
fineweb_q02/datafusion:vortex-file-compressed 30786210 29227551 1.05
fineweb_q03/datafusion:vortex-file-compressed 🚨 94324741 75709399 1.25
fineweb_q04/datafusion:vortex-file-compressed 🚨 279813095 251580187 1.11
fineweb_q05/datafusion:vortex-file-compressed 233345184 227011388 1.03
fineweb_q06/datafusion:vortex-file-compressed 🚨 75275449 67246551 1.12
fineweb_q07/datafusion:vortex-file-compressed 🚨 76448198 67839684 1.13
fineweb_q08/datafusion:vortex-file-compressed 24678147 24365033 1.01
datafusion / vortex-compact (1.100x ❌, 0↑ 3↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6558792 4855332 1.35
fineweb_q01/datafusion:vortex-compact 165470768 161048996 1.03
fineweb_q02/datafusion:vortex-compact 172972129 164272374 1.05
fineweb_q03/datafusion:vortex-compact 1547431544 1442211907 1.07
fineweb_q04/datafusion:vortex-compact 1722266643 1579401128 1.09
fineweb_q05/datafusion:vortex-compact 🚨 1383583372 1256531945 1.10
fineweb_q06/datafusion:vortex-compact 🚨 762497072 688980822 1.11
fineweb_q07/datafusion:vortex-compact 777782157 730617128 1.06
fineweb_q08/datafusion:vortex-compact 21666092 20316920 1.07
datafusion / parquet (1.098x ➖, 0↑ 5↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 7188209 6494699 1.11
fineweb_q01/datafusion:parquet 279340176 269183357 1.04
fineweb_q02/datafusion:parquet 290027762 268128903 1.08
fineweb_q03/datafusion:parquet 🚨 315010184 265468866 1.19
fineweb_q04/datafusion:parquet 🚨 313047669 276926559 1.13
fineweb_q05/datafusion:parquet 🚨 300382717 272350490 1.10
fineweb_q06/datafusion:parquet 291197361 278321018 1.05
fineweb_q07/datafusion:parquet 288141585 266461901 1.08
fineweb_q08/datafusion:parquet 🚨 292326144 262037561 1.12
duckdb / vortex-file-compressed (1.112x ❌, 0↑ 4↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3607190 2959066 1.22
fineweb_q01/duckdb:vortex-file-compressed 27666243 25215574 1.10
fineweb_q02/duckdb:vortex-file-compressed 28028547 26183498 1.07
fineweb_q03/duckdb:vortex-file-compressed 🚨 179445809 144800105 1.24
fineweb_q04/duckdb:vortex-file-compressed 234638973 236382303 0.99
fineweb_q05/duckdb:vortex-file-compressed 227084805 214200437 1.06
fineweb_q06/duckdb:vortex-file-compressed 🚨 72438390 64053721 1.13
fineweb_q07/duckdb:vortex-file-compressed 74510396 72081206 1.03
fineweb_q08/duckdb:vortex-file-compressed 🚨 28725554 24175637 1.19
duckdb / vortex-compact (1.132x ❌, 0↑ 7↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4734898 3868465 1.22
fineweb_q01/duckdb:vortex-compact 🚨 117763211 95008226 1.24
fineweb_q02/duckdb:vortex-compact 🚨 132271770 118992280 1.11
fineweb_q03/duckdb:vortex-compact 🚨 981931059 856800550 1.15
fineweb_q04/duckdb:vortex-compact 🚨 1007932621 896966918 1.12
fineweb_q05/duckdb:vortex-compact 🚨 913152357 814077143 1.12
fineweb_q06/duckdb:vortex-compact 493664827 469179524 1.05
fineweb_q07/duckdb:vortex-compact 500344874 478265633 1.05
fineweb_q08/duckdb:vortex-compact 🚨 23066637 20279546 1.14
duckdb / parquet (1.080x ➖, 0↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 39774784 34591348 1.15
fineweb_q01/duckdb:parquet 99788894 91798375 1.09
fineweb_q02/duckdb:parquet 101483383 94841528 1.07
fineweb_q03/duckdb:parquet 323659123 307485847 1.05
fineweb_q04/duckdb:parquet 468244655 439402057 1.07
fineweb_q05/duckdb:parquet 425536509 408744697 1.04
fineweb_q06/duckdb:parquet 213980004 198184492 1.08
fineweb_q07/duckdb:parquet 225762583 209570466 1.08
fineweb_q08/duckdb:parquet 61878931 56452857 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +35.1% +12.8% +19.7% +48.6% ➖ noise
0 datafusion:vortex-file-compressed +37.9% +12.8% +22.3% +75.9% ➖ noise
0 duckdb:vortex-compact +22.4% +12.8% +8.5% +36.1% ➖ noise
0 duckdb:vortex-file-compressed +21.9% +12.8% +8.1% +52.7% ➖ noise
1 datafusion:vortex-compact +2.7% +6.2% -3.3% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +12.5% +6.2% +5.9% +20.4% ➖ noise
1 duckdb:vortex-compact +24.0% +6.2% +16.7% +10.1% 🚨 regression
1 duckdb:vortex-file-compressed +9.7% +6.2% +3.3% +43.2% ➖ noise
2 datafusion:vortex-compact +5.3% +7.6% -2.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +5.3% +7.6% -2.1% +19.3% ➖ noise
2 duckdb:vortex-compact +11.2% +7.6% +3.3% +13.2% ➖ noise
2 duckdb:vortex-file-compressed +7.0% +7.6% -0.5% +10.0% ➖ noise
3 datafusion:vortex-compact +7.3% +11.8% -4.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +24.6% +11.8% +11.5% +27.8% ➖ noise
3 duckdb:vortex-compact +14.6% +11.8% +2.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +23.9% +11.8% +10.9% +28.7% ➖ noise
4 datafusion:vortex-compact +9.0% +9.8% -0.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +11.2% +9.8% +1.3% +10.0% ➖ noise
4 duckdb:vortex-compact +12.4% +9.8% +2.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.7% +9.8% -9.6% +10.0% ✅ faster
5 datafusion:vortex-compact +10.1% +7.2% +2.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.8% +7.2% -4.1% +10.0% ➖ noise
5 duckdb:vortex-compact +12.2% +7.2% +4.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +6.0% +7.2% -1.1% +10.0% ➖ noise
6 datafusion:vortex-compact +10.7% +6.3% +4.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +11.9% +6.3% +5.3% +12.4% ➖ noise
6 duckdb:vortex-compact +5.2% +6.3% -1.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +13.1% +6.3% +6.4% +16.3% ➖ noise
7 datafusion:vortex-compact +6.5% +7.9% -1.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +12.7% +7.9% +4.4% +16.4% ➖ noise
7 duckdb:vortex-compact +4.6% +7.9% -3.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.4% +7.9% -4.2% +12.3% ➖ noise
8 datafusion:vortex-compact +6.6% +10.6% -3.6% +28.4% ➖ noise
8 datafusion:vortex-file-compressed +1.3% +10.6% -8.4% +19.6% ➖ noise
8 duckdb:vortex-compact +13.7% +10.6% +2.9% +25.7% ➖ noise
8 duckdb:vortex-file-compressed +18.8% +10.6% +7.5% +16.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish +0.2%


datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 29156190 29238549 1.00
tpcds_q02/datafusion:vortex-file-compressed 51685321 53119467 0.97
tpcds_q03/datafusion:vortex-file-compressed 19807789 19909291 0.99
tpcds_q04/datafusion:vortex-file-compressed 287575127 290051858 0.99
tpcds_q05/datafusion:vortex-file-compressed 52585295 54157819 0.97
tpcds_q06/datafusion:vortex-file-compressed 50585786 49096503 1.03
tpcds_q07/datafusion:vortex-file-compressed 48083201 49789821 0.97
tpcds_q08/datafusion:vortex-file-compressed 35840128 35957820 1.00
tpcds_q09/datafusion:vortex-file-compressed 49294029 49257835 1.00
tpcds_q10/datafusion:vortex-file-compressed 44378402 43631927 1.02
tpcds_q11/datafusion:vortex-file-compressed 162371652 163085778 1.00
tpcds_q12/datafusion:vortex-file-compressed 23299762 23057044 1.01
tpcds_q13/datafusion:vortex-file-compressed 51144232 50631090 1.01
tpcds_q14/datafusion:vortex-file-compressed 195969524 202112727 0.97
tpcds_q15/datafusion:vortex-file-compressed 34019167 33937057 1.00
tpcds_q16/datafusion:vortex-file-compressed 28082257 27459373 1.02
tpcds_q17/datafusion:vortex-file-compressed 66750787 66447044 1.00
tpcds_q18/datafusion:vortex-file-compressed 77231358 77117282 1.00
tpcds_q19/datafusion:vortex-file-compressed 30612647 30217577 1.01
tpcds_q20/datafusion:vortex-file-compressed 25442624 25362521 1.00
tpcds_q21/datafusion:vortex-file-compressed 136697802 135239710 1.01
tpcds_q22/datafusion:vortex-file-compressed 56678018 55983705 1.01
tpcds_q23/datafusion:vortex-file-compressed 145107571 143062035 1.01
tpcds_q24/datafusion:vortex-file-compressed 111129886 110014559 1.01
tpcds_q25/datafusion:vortex-file-compressed 66021951 67233154 0.98
tpcds_q26/datafusion:vortex-file-compressed 35664475 35477517 1.01
tpcds_q27/datafusion:vortex-file-compressed 114887453 116925564 0.98
tpcds_q28/datafusion:vortex-file-compressed 43919254 42995322 1.02
tpcds_q29/datafusion:vortex-file-compressed 66470050 65625501 1.01
tpcds_q30/datafusion:vortex-file-compressed 30881092 29892190 1.03
tpcds_q31/datafusion:vortex-file-compressed 93203635 90964239 1.02
tpcds_q32/datafusion:vortex-file-compressed 21074894 20423440 1.03
tpcds_q33/datafusion:vortex-file-compressed 37828790 38179912 0.99
tpcds_q34/datafusion:vortex-file-compressed 30969889 30890446 1.00
tpcds_q35/datafusion:vortex-file-compressed 54484391 52384490 1.04
tpcds_q36/datafusion:vortex-file-compressed 73397958 74984039 0.98
tpcds_q37/datafusion:vortex-file-compressed 33375515 33860313 0.99
tpcds_q38/datafusion:vortex-file-compressed 53278550 51047837 1.04
tpcds_q39/datafusion:vortex-file-compressed 141841743 146447125 0.97
tpcds_q40/datafusion:vortex-file-compressed 50626638 51901993 0.98
tpcds_q41/datafusion:vortex-file-compressed 17884788 16813666 1.06
tpcds_q42/datafusion:vortex-file-compressed 18054655 17785587 1.02
tpcds_q43/datafusion:vortex-file-compressed 31475561 31887772 0.99
tpcds_q44/datafusion:vortex-file-compressed 41193637 42008652 0.98
tpcds_q45/datafusion:vortex-file-compressed 33714331 33336305 1.01
tpcds_q46/datafusion:vortex-file-compressed 45847189 46610993 0.98
tpcds_q47/datafusion:vortex-file-compressed 206849740 204198178 1.01
tpcds_q48/datafusion:vortex-file-compressed 40622867 42664972 0.95
tpcds_q49/datafusion:vortex-file-compressed 66733899 65925798 1.01
tpcds_q50/datafusion:vortex-file-compressed 44910968 44852759 1.00
tpcds_q51/datafusion:vortex-file-compressed 87373227 86669361 1.01
tpcds_q52/datafusion:vortex-file-compressed 19140920 19303960 0.99
tpcds_q53/datafusion:vortex-file-compressed 24680994 25487038 0.97
tpcds_q54/datafusion:vortex-file-compressed 41914079 42740917 0.98
tpcds_q55/datafusion:vortex-file-compressed 18314956 18207072 1.01
tpcds_q56/datafusion:vortex-file-compressed 40310367 39169837 1.03
tpcds_q57/datafusion:vortex-file-compressed 126117998 123684497 1.02
tpcds_q58/datafusion:vortex-file-compressed 68796965 69966069 0.98
tpcds_q59/datafusion:vortex-file-compressed 71562548 71566704 1.00
tpcds_q60/datafusion:vortex-file-compressed 40618349 39994439 1.02
tpcds_q61/datafusion:vortex-file-compressed 49946495 49154854 1.02
tpcds_q62/datafusion:vortex-file-compressed 30185718 31674361 0.95
tpcds_q63/datafusion:vortex-file-compressed 24661859 25156273 0.98
tpcds_q64/datafusion:vortex-file-compressed 462053255 466182707 0.99
tpcds_q65/datafusion:vortex-file-compressed 49357314 48227758 1.02
tpcds_q66/datafusion:vortex-file-compressed 90644498 92959071 0.98
tpcds_q67/datafusion:vortex-file-compressed 117709254 114693556 1.03
tpcds_q68/datafusion:vortex-file-compressed 45246677 45857137 0.99
tpcds_q69/datafusion:vortex-file-compressed 43014238 41672782 1.03
tpcds_q70/datafusion:vortex-file-compressed 109162420 116630035 0.94
tpcds_q71/datafusion:vortex-file-compressed 30377393 30133998 1.01
tpcds_q72/datafusion:vortex-file-compressed 2576308614 2550908439 1.01
tpcds_q73/datafusion:vortex-file-compressed 34228760 32592713 1.05
tpcds_q74/datafusion:vortex-file-compressed 115831226 115200437 1.01
tpcds_q75/datafusion:vortex-file-compressed 117868505 118175483 1.00
tpcds_q76/datafusion:vortex-file-compressed 31932202 33652086 0.95
tpcds_q77/datafusion:vortex-file-compressed 49656669 49727458 1.00
tpcds_q78/datafusion:vortex-file-compressed 122126778 122789995 0.99
tpcds_q79/datafusion:vortex-file-compressed 36376662 38022139 0.96
tpcds_q80/datafusion:vortex-file-compressed 113958557 112830290 1.01
tpcds_q81/datafusion:vortex-file-compressed 36450829 36153688 1.01
tpcds_q82/datafusion:vortex-file-compressed 34554407 34847643 0.99
tpcds_q83/datafusion:vortex-file-compressed 49836113 49210532 1.01
tpcds_q84/datafusion:vortex-file-compressed 15484509 14828745 1.04
tpcds_q85/datafusion:vortex-file-compressed 99432648 100079488 0.99
tpcds_q86/datafusion:vortex-file-compressed 18431710 18634682 0.99
tpcds_q87/datafusion:vortex-file-compressed 51218345 52810612 0.97
tpcds_q88/datafusion:vortex-file-compressed 72245336 74016319 0.98
tpcds_q89/datafusion:vortex-file-compressed 35276531 36063764 0.98
tpcds_q90/datafusion:vortex-file-compressed 17522646 17772246 0.99
tpcds_q91/datafusion:vortex-file-compressed 25768122 24742650 1.04
tpcds_q92/datafusion:vortex-file-compressed 18013236 17720825 1.02
tpcds_q93/datafusion:vortex-file-compressed 32704089 33516895 0.98
tpcds_q94/datafusion:vortex-file-compressed 24765297 24585660 1.01
tpcds_q95/datafusion:vortex-file-compressed 59873894 59551195 1.01
tpcds_q96/datafusion:vortex-file-compressed 15510830 15798715 0.98
tpcds_q97/datafusion:vortex-file-compressed 29394613 29159240 1.01
tpcds_q98/datafusion:vortex-file-compressed 30633939 32041651 0.96
tpcds_q99/datafusion:vortex-file-compressed 44054627 42973204 1.03
datafusion / vortex-compact (1.002x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 35939250 35310601 1.02
tpcds_q02/datafusion:vortex-compact 59114548 59739154 0.99
tpcds_q03/datafusion:vortex-compact 25967253 25809986 1.01
tpcds_q04/datafusion:vortex-compact 331992747 327922194 1.01
tpcds_q05/datafusion:vortex-compact 66131043 65734554 1.01
tpcds_q06/datafusion:vortex-compact 59741842 57370142 1.04
tpcds_q07/datafusion:vortex-compact 67018656 66504206 1.01
tpcds_q08/datafusion:vortex-compact 44223131 44209093 1.00
tpcds_q09/datafusion:vortex-compact 71375989 69413338 1.03
tpcds_q10/datafusion:vortex-compact 65084198 62847433 1.04
tpcds_q11/datafusion:vortex-compact 190554719 189333735 1.01
tpcds_q12/datafusion:vortex-compact 26858861 26664461 1.01
tpcds_q13/datafusion:vortex-compact 110174546 119451043 0.92
tpcds_q14/datafusion:vortex-compact 253306170 251845158 1.01
tpcds_q15/datafusion:vortex-compact 38989385 37915267 1.03
tpcds_q16/datafusion:vortex-compact 39028881 38571503 1.01
tpcds_q17/datafusion:vortex-compact 92691076 92496417 1.00
tpcds_q18/datafusion:vortex-compact 89754859 87397087 1.03
tpcds_q19/datafusion:vortex-compact 44689315 43721799 1.02
tpcds_q20/datafusion:vortex-compact 29513637 29124174 1.01
tpcds_q21/datafusion:vortex-compact 138895022 141699565 0.98
tpcds_q22/datafusion:vortex-compact 65517041 65176375 1.01
tpcds_q23/datafusion:vortex-compact 184820164 179970029 1.03
tpcds_q24/datafusion:vortex-compact 142352401 140263139 1.01
tpcds_q25/datafusion:vortex-compact 96953998 94325500 1.03
tpcds_q26/datafusion:vortex-compact 45082988 47595924 0.95
tpcds_q27/datafusion:vortex-compact 161073524 158736978 1.01
tpcds_q28/datafusion:vortex-compact 83148373 84216898 0.99
tpcds_q29/datafusion:vortex-compact 92222383 93087012 0.99
tpcds_q30/datafusion:vortex-compact 34189779 33364052 1.02
tpcds_q31/datafusion:vortex-compact 130899787 128917231 1.02
tpcds_q32/datafusion:vortex-compact 27176089 26971379 1.01
tpcds_q33/datafusion:vortex-compact 53868194 54726177 0.98
tpcds_q34/datafusion:vortex-compact 51388570 50286908 1.02
tpcds_q35/datafusion:vortex-compact 68459275 66493673 1.03
tpcds_q36/datafusion:vortex-compact 98295226 97777961 1.01
tpcds_q37/datafusion:vortex-compact 46294348 46372840 1.00
tpcds_q38/datafusion:vortex-compact 67053847 67060714 1.00
tpcds_q39/datafusion:vortex-compact 151548373 144759573 1.05
tpcds_q40/datafusion:vortex-compact 58471947 57972400 1.01
tpcds_q41/datafusion:vortex-compact 19625941 19212994 1.02
tpcds_q42/datafusion:vortex-compact 23995890 23929636 1.00
tpcds_q43/datafusion:vortex-compact 39882610 38869701 1.03
tpcds_q44/datafusion:vortex-compact 72029397 72602727 0.99
tpcds_q45/datafusion:vortex-compact 38527976 39622428 0.97
tpcds_q46/datafusion:vortex-compact 70077002 71645497 0.98
tpcds_q47/datafusion:vortex-compact 229528346 226475240 1.01
tpcds_q48/datafusion:vortex-compact 80279857 85675956 0.94
tpcds_q49/datafusion:vortex-compact 89795871 90382369 0.99
tpcds_q50/datafusion:vortex-compact 63989826 65179869 0.98
tpcds_q51/datafusion:vortex-compact 98474710 99005436 0.99
tpcds_q52/datafusion:vortex-compact 24449172 23762157 1.03
tpcds_q53/datafusion:vortex-compact 35848947 35844199 1.00
tpcds_q54/datafusion:vortex-compact 60999782 60003803 1.02
tpcds_q55/datafusion:vortex-compact 24620214 24772779 0.99
tpcds_q56/datafusion:vortex-compact 56644687 55969263 1.01
tpcds_q57/datafusion:vortex-compact 139417658 136098077 1.02
tpcds_q58/datafusion:vortex-compact 77308019 79636674 0.97
tpcds_q59/datafusion:vortex-compact 83233171 84534048 0.98
tpcds_q60/datafusion:vortex-compact 57204038 56200028 1.02
tpcds_q61/datafusion:vortex-compact 77421464 75384482 1.03
tpcds_q62/datafusion:vortex-compact 32769458 34512460 0.95
tpcds_q63/datafusion:vortex-compact 35110469 35539356 0.99
tpcds_q64/datafusion:vortex-compact 541222008 542301779 1.00
tpcds_q65/datafusion:vortex-compact 69648575 67700475 1.03
tpcds_q66/datafusion:vortex-compact 97307171 92620455 1.05
tpcds_q67/datafusion:vortex-compact 126838664 123396640 1.03
tpcds_q68/datafusion:vortex-compact 71530086 72823200 0.98
tpcds_q69/datafusion:vortex-compact 63094699 61122936 1.03
tpcds_q70/datafusion:vortex-compact 120984207 123738653 0.98
tpcds_q71/datafusion:vortex-compact 46153954 46819633 0.99
tpcds_q72/datafusion:vortex-compact 2587056833 2603188417 0.99
tpcds_q73/datafusion:vortex-compact 52615212 52594952 1.00
tpcds_q74/datafusion:vortex-compact 136693516 134076160 1.02
tpcds_q75/datafusion:vortex-compact 164384931 160239051 1.03
tpcds_q76/datafusion:vortex-compact 51365527 50741240 1.01
tpcds_q77/datafusion:vortex-compact 68719203 65461514 1.05
tpcds_q78/datafusion:vortex-compact 150595828 149059082 1.01
tpcds_q79/datafusion:vortex-compact 61677575 60489266 1.02
tpcds_q80/datafusion:vortex-compact 131410221 135342651 0.97
tpcds_q81/datafusion:vortex-compact 41638660 44463133 0.94
tpcds_q82/datafusion:vortex-compact 47933479 49975300 0.96
tpcds_q83/datafusion:vortex-compact 57248040 57590677 0.99
tpcds_q84/datafusion:vortex-compact 18927789 18300012 1.03
tpcds_q85/datafusion:vortex-compact 121215567 129383222 0.94
tpcds_q86/datafusion:vortex-compact 21731410 22532222 0.96
tpcds_q87/datafusion:vortex-compact 69166468 68915923 1.00
tpcds_q88/datafusion:vortex-compact 121141011 124234464 0.98
tpcds_q89/datafusion:vortex-compact 44890196 43614739 1.03
tpcds_q90/datafusion:vortex-compact 23609645 23595226 1.00
tpcds_q91/datafusion:vortex-compact 41098660 38873443 1.06
tpcds_q92/datafusion:vortex-compact 25870631 25056086 1.03
tpcds_q93/datafusion:vortex-compact 46121382 45374073 1.02
tpcds_q94/datafusion:vortex-compact 29911582 30922645 0.97
tpcds_q95/datafusion:vortex-compact 70426531 70406330 1.00
tpcds_q96/datafusion:vortex-compact 23839737 23745498 1.00
tpcds_q97/datafusion:vortex-compact 42228918 43284233 0.98
tpcds_q98/datafusion:vortex-compact 37183625 38084009 0.98
tpcds_q99/datafusion:vortex-compact 45023108 48103799 0.94
datafusion / parquet (0.992x ➖, 1↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 37581277 37771811 0.99
tpcds_q02/datafusion:parquet 46038933 47823607 0.96
tpcds_q03/datafusion:parquet 14724862 14654624 1.00
tpcds_q04/datafusion:parquet 312073337 316331684 0.99
tpcds_q05/datafusion:parquet 51882658 51539154 1.01
tpcds_q06/datafusion:parquet 63516540 65280832 0.97
tpcds_q07/datafusion:parquet 86211361 86993818 0.99
tpcds_q08/datafusion:parquet 32184268 31901999 1.01
tpcds_q09/datafusion:parquet 56878249 55687583 1.02
tpcds_q10/datafusion:parquet 81513202 83346813 0.98
tpcds_q11/datafusion:parquet 178604518 180967089 0.99
tpcds_q12/datafusion:parquet 21984812 23619126 0.93
tpcds_q13/datafusion:parquet 84949390 85767506 0.99
tpcds_q14/datafusion:parquet 190607450 200286657 0.95
tpcds_q15/datafusion:parquet 26483802 25241185 1.05
tpcds_q16/datafusion:parquet 27395353 28089595 0.98
tpcds_q17/datafusion:parquet 67828302 69605776 0.97
tpcds_q18/datafusion:parquet 129781819 130464336 0.99
tpcds_q19/datafusion:parquet 27627926 27130060 1.02
tpcds_q20/datafusion:parquet 20929931 21329683 0.98
tpcds_q21/datafusion:parquet 21627508 22678398 0.95
tpcds_q22/datafusion:parquet 150804156 155582750 0.97
tpcds_q23/datafusion:parquet 164547880 160264030 1.03
tpcds_q24/datafusion:parquet 104430241 104952806 1.00
tpcds_q25/datafusion:parquet 69710597 72404619 0.96
tpcds_q26/datafusion:parquet 76994935 75706299 1.02
tpcds_q27/datafusion:parquet 161614762 162632186 0.99
tpcds_q28/datafusion:parquet 47574987 48340129 0.98
tpcds_q29/datafusion:parquet 73310364 75004394 0.98
tpcds_q30/datafusion:parquet 43861118 44198660 0.99
tpcds_q31/datafusion:parquet 76241855 75737292 1.01
tpcds_q32/datafusion:parquet 22618094 22378030 1.01
tpcds_q33/datafusion:parquet 36738469 35649651 1.03
tpcds_q34/datafusion:parquet 27061873 27473540 0.99
tpcds_q35/datafusion:parquet 86117381 83503355 1.03
tpcds_q36/datafusion:parquet 64889704 63884592 1.02
tpcds_q37/datafusion:parquet 23887080 23148505 1.03
tpcds_q38/datafusion:parquet 50088669 50748816 0.99
tpcds_q39/datafusion:parquet 81987721 82236226 1.00
tpcds_q40/datafusion:parquet 27279267 29286770 0.93
tpcds_q41/datafusion:parquet 15539565 16744900 0.93
tpcds_q42/datafusion:parquet 13516014 13637008 0.99
tpcds_q43/datafusion:parquet 18790138 18898279 0.99
tpcds_q44/datafusion:parquet 41640296 41751961 1.00
tpcds_q45/datafusion:parquet 32590288 32349719 1.01
tpcds_q46/datafusion:parquet 38640356 39188299 0.99
tpcds_q47/datafusion:parquet 134852963 134320795 1.00
tpcds_q48/datafusion:parquet 78725248 77685424 1.01
tpcds_q49/datafusion:parquet 64196922 66431993 0.97
tpcds_q50/datafusion:parquet 48252283 48739776 0.99
tpcds_q51/datafusion:parquet 86318447 87838127 0.98
tpcds_q52/datafusion:parquet 13637141 14615718 0.93
tpcds_q53/datafusion:parquet 22235647 20788162 1.07
tpcds_q54/datafusion:parquet 43046034 43788589 0.98
tpcds_q55/datafusion:parquet 13711419 14724015 0.93
tpcds_q56/datafusion:parquet 36518103 35338180 1.03
tpcds_q57/datafusion:parquet 110712129 110928542 1.00
tpcds_q58/datafusion:parquet 56505051 56339080 1.00
tpcds_q59/datafusion:parquet 58702014 59012639 0.99
tpcds_q60/datafusion:parquet 34440878 35744506 0.96
tpcds_q61/datafusion:parquet 50182584 49998469 1.00
tpcds_q62/datafusion:parquet 🚀 25811371 29134050 0.89
tpcds_q63/datafusion:parquet 21585474 21343239 1.01
tpcds_q64/datafusion:parquet 551087346 549598930 1.00
tpcds_q65/datafusion:parquet 44431397 45748654 0.97
tpcds_q66/datafusion:parquet 77590816 74224597 1.05
tpcds_q67/datafusion:parquet 146463209 147422216 0.99
tpcds_q68/datafusion:parquet 39424238 40884601 0.96
tpcds_q69/datafusion:parquet 78577361 76850988 1.02
tpcds_q70/datafusion:parquet 94773831 94986364 1.00
tpcds_q71/datafusion:parquet 25670730 26588104 0.97
tpcds_q72/datafusion:parquet 638402155 634554496 1.01
tpcds_q73/datafusion:parquet 26914760 26246152 1.03
tpcds_q74/datafusion:parquet 102315217 102497331 1.00
tpcds_q75/datafusion:parquet 114628793 115929212 0.99
tpcds_q76/datafusion:parquet 34864148 34702082 1.00
tpcds_q77/datafusion:parquet 47640598 48308824 0.99
tpcds_q78/datafusion:parquet 119323385 120372038 0.99
tpcds_q79/datafusion:parquet 30963645 30662403 1.01
tpcds_q80/datafusion:parquet 93101631 92469478 1.01
tpcds_q81/datafusion:parquet 40108796 39949639 1.00
tpcds_q82/datafusion:parquet 22785568 22999409 0.99
tpcds_q83/datafusion:parquet 47857929 47618793 1.01
tpcds_q84/datafusion:parquet 46648940 47341362 0.99
tpcds_q85/datafusion:parquet 170675003 170200074 1.00
tpcds_q86/datafusion:parquet 16861502 17954634 0.94
tpcds_q87/datafusion:parquet 48766397 51131531 0.95
tpcds_q88/datafusion:parquet 68720227 69974281 0.98
tpcds_q89/datafusion:parquet 23725029 23943750 0.99
tpcds_q90/datafusion:parquet 18749645 18048877 1.04
tpcds_q91/datafusion:parquet 70892857 69036694 1.03
tpcds_q92/datafusion:parquet 22107183 21277066 1.04
tpcds_q93/datafusion:parquet 33954521 34621343 0.98
tpcds_q94/datafusion:parquet 24000459 24094764 1.00
tpcds_q95/datafusion:parquet 66352648 66929486 0.99
tpcds_q96/datafusion:parquet 15327586 14623153 1.05
tpcds_q97/datafusion:parquet 32898255 33850983 0.97
tpcds_q98/datafusion:parquet 25267442 25439866 0.99
tpcds_q99/datafusion:parquet 27956048 27814678 1.01
duckdb / vortex-file-compressed (1.000x ➖, 2↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25160856 25696456 0.98
tpcds_q02/duckdb:vortex-file-compressed 80450850 84721202 0.95
tpcds_q03/duckdb:vortex-file-compressed 25112351 23983449 1.05
tpcds_q04/duckdb:vortex-file-compressed 102346122 101997171 1.00
tpcds_q05/duckdb:vortex-file-compressed 93446719 90602263 1.03
tpcds_q06/duckdb:vortex-file-compressed 33872300 34618691 0.98
tpcds_q07/duckdb:vortex-file-compressed 22284077 22758344 0.98
tpcds_q08/duckdb:vortex-file-compressed 27262466 27242495 1.00
tpcds_q09/duckdb:vortex-file-compressed 33266233 33734152 0.99
tpcds_q10/duckdb:vortex-file-compressed 39906425 41243150 0.97
tpcds_q11/duckdb:vortex-file-compressed 58122334 61400430 0.95
tpcds_q12/duckdb:vortex-file-compressed 14398786 14161149 1.02
tpcds_q13/duckdb:vortex-file-compressed 42575746 42152255 1.01
tpcds_q14/duckdb:vortex-file-compressed 201439037 187870536 1.07
tpcds_q15/duckdb:vortex-file-compressed 40409015 41081461 0.98
tpcds_q16/duckdb:vortex-file-compressed 28728249 30569371 0.94
tpcds_q17/duckdb:vortex-file-compressed 35927959 36921677 0.97
tpcds_q18/duckdb:vortex-file-compressed 44773558 44622649 1.00
tpcds_q19/duckdb:vortex-file-compressed 31685766 31262718 1.01
tpcds_q20/duckdb:vortex-file-compressed 15464530 15526210 1.00
tpcds_q21/duckdb:vortex-file-compressed 19104580 19797491 0.97
tpcds_q22/duckdb:vortex-file-compressed 106981886 108949381 0.98
tpcds_q23/duckdb:vortex-file-compressed 147348154 149940494 0.98
tpcds_q24/duckdb:vortex-file-compressed 53879071 53243416 1.01
tpcds_q25/duckdb:vortex-file-compressed 35830308 36690413 0.98
tpcds_q26/duckdb:vortex-file-compressed 39394775 40064614 0.98
tpcds_q27/duckdb:vortex-file-compressed 84742188 86455274 0.98
tpcds_q28/duckdb:vortex-file-compressed 34068211 34336044 0.99
tpcds_q29/duckdb:vortex-file-compressed 35194142 35476603 0.99
tpcds_q30/duckdb:vortex-file-compressed 29636600 28993527 1.02
tpcds_q31/duckdb:vortex-file-compressed 27828387 28150779 0.99
tpcds_q32/duckdb:vortex-file-compressed 16458503 17228391 0.96
tpcds_q33/duckdb:vortex-file-compressed 65256346 65085743 1.00
tpcds_q34/duckdb:vortex-file-compressed 18934303 18181568 1.04
tpcds_q35/duckdb:vortex-file-compressed 67439276 71001220 0.95
tpcds_q36/duckdb:vortex-file-compressed 28200893 27995997 1.01
tpcds_q37/duckdb:vortex-file-compressed 21561060 21999337 0.98
tpcds_q38/duckdb:vortex-file-compressed 38910885 39392685 0.99
tpcds_q39/duckdb:vortex-file-compressed 44672300 43775013 1.02
tpcds_q40/duckdb:vortex-file-compressed 23241003 24563991 0.95
tpcds_q41/duckdb:vortex-file-compressed 12712282 12454161 1.02
tpcds_q42/duckdb:vortex-file-compressed 12148120 11908416 1.02
tpcds_q43/duckdb:vortex-file-compressed 31733568 31393409 1.01
tpcds_q44/duckdb:vortex-file-compressed 25023738 24638370 1.02
tpcds_q45/duckdb:vortex-file-compressed 27381029 27391807 1.00
tpcds_q46/duckdb:vortex-file-compressed 48219768 46139990 1.05
tpcds_q47/duckdb:vortex-file-compressed 50257907 49613494 1.01
tpcds_q48/duckdb:vortex-file-compressed 39278615 37649028 1.04
tpcds_q49/duckdb:vortex-file-compressed 🚨 30488013 27633618 1.10
tpcds_q50/duckdb:vortex-file-compressed 34021906 33272617 1.02
tpcds_q51/duckdb:vortex-file-compressed 100797100 98150662 1.03
tpcds_q52/duckdb:vortex-file-compressed 12547713 12171954 1.03
tpcds_q53/duckdb:vortex-file-compressed 16880458 16707200 1.01
tpcds_q54/duckdb:vortex-file-compressed 46903016 47739407 0.98
tpcds_q55/duckdb:vortex-file-compressed 11464642 11773386 0.97
tpcds_q56/duckdb:vortex-file-compressed 64661879 64928129 1.00
tpcds_q57/duckdb:vortex-file-compressed 46389515 44505811 1.04
tpcds_q58/duckdb:vortex-file-compressed 32057419 33970167 0.94
tpcds_q59/duckdb:vortex-file-compressed 82987023 80921400 1.03
tpcds_q60/duckdb:vortex-file-compressed 62875363 66441328 0.95
tpcds_q61/duckdb:vortex-file-compressed 35897564 36853389 0.97
tpcds_q62/duckdb:vortex-file-compressed 🚀 17201949 19276875 0.89
tpcds_q63/duckdb:vortex-file-compressed 17803973 17474121 1.02
tpcds_q64/duckdb:vortex-file-compressed 78906033 78071742 1.01
tpcds_q65/duckdb:vortex-file-compressed 24354862 23732668 1.03
tpcds_q66/duckdb:vortex-file-compressed 55205329 60252317 0.92
tpcds_q67/duckdb:vortex-file-compressed 143037415 145477195 0.98
tpcds_q68/duckdb:vortex-file-compressed 40002783 39703001 1.01
tpcds_q69/duckdb:vortex-file-compressed 44005104 41978811 1.05
tpcds_q70/duckdb:vortex-file-compressed 28420833 28355138 1.00
tpcds_q71/duckdb:vortex-file-compressed 21693379 21282735 1.02
tpcds_q72/duckdb:vortex-file-compressed 176551715 176835426 1.00
tpcds_q73/duckdb:vortex-file-compressed 19599786 20139571 0.97
tpcds_q74/duckdb:vortex-file-compressed 49381969 48163157 1.03
tpcds_q75/duckdb:vortex-file-compressed 61896321 60680050 1.02
tpcds_q76/duckdb:vortex-file-compressed 🚀 62202201 71633321 0.87
tpcds_q77/duckdb:vortex-file-compressed 62762698 65951874 0.95
tpcds_q78/duckdb:vortex-file-compressed 81619677 78628219 1.04
tpcds_q79/duckdb:vortex-file-compressed 36011665 36678372 0.98
tpcds_q80/duckdb:vortex-file-compressed 87989196 87457627 1.01
tpcds_q81/duckdb:vortex-file-compressed 33901851 33585543 1.01
tpcds_q82/duckdb:vortex-file-compressed 23564207 22573537 1.04
tpcds_q83/duckdb:vortex-file-compressed 26293516 26800332 0.98
tpcds_q84/duckdb:vortex-file-compressed 17626047 17536247 1.01
tpcds_q85/duckdb:vortex-file-compressed 47085043 45374581 1.04
tpcds_q86/duckdb:vortex-file-compressed 17398127 17414757 1.00
tpcds_q87/duckdb:vortex-file-compressed 44545100 41861092 1.06
tpcds_q88/duckdb:vortex-file-compressed 40974852 39629688 1.03
tpcds_q89/duckdb:vortex-file-compressed 18542687 18152298 1.02
tpcds_q90/duckdb:vortex-file-compressed 13350491 13551549 0.99
tpcds_q91/duckdb:vortex-file-compressed 28338403 27689532 1.02
tpcds_q92/duckdb:vortex-file-compressed 15617173 14357985 1.09
tpcds_q93/duckdb:vortex-file-compressed 29083314 29049861 1.00
tpcds_q94/duckdb:vortex-file-compressed 21232115 20880020 1.02
tpcds_q95/duckdb:vortex-file-compressed 151456827 149651078 1.01
tpcds_q96/duckdb:vortex-file-compressed 17611414 16619245 1.06
tpcds_q97/duckdb:vortex-file-compressed 40399836 37647423 1.07
tpcds_q98/duckdb:vortex-file-compressed 17500363 18532625 0.94
tpcds_q99/duckdb:vortex-file-compressed 31998179 32101431 1.00
duckdb / vortex-compact (1.002x ➖, 1↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 32188483 34116456 0.94
tpcds_q02/duckdb:vortex-compact 118690995 121474273 0.98
tpcds_q03/duckdb:vortex-compact 50388374 49552599 1.02
tpcds_q04/duckdb:vortex-compact 119204034 122170297 0.98
tpcds_q05/duckdb:vortex-compact 162613817 162083192 1.00
tpcds_q06/duckdb:vortex-compact 40670379 40559536 1.00
tpcds_q07/duckdb:vortex-compact 39464272 38622770 1.02
tpcds_q08/duckdb:vortex-compact 35554747 36488066 0.97
tpcds_q09/duckdb:vortex-compact 57459443 58059741 0.99
tpcds_q10/duckdb:vortex-compact 53707597 57065576 0.94
tpcds_q11/duckdb:vortex-compact 75378444 74705343 1.01
tpcds_q12/duckdb:vortex-compact 18952574 20111035 0.94
tpcds_q13/duckdb:vortex-compact 69181139 68434461 1.01
tpcds_q14/duckdb:vortex-compact 284324760 286389756 0.99
tpcds_q15/duckdb:vortex-compact 45702772 44816153 1.02
tpcds_q16/duckdb:vortex-compact 32956196 34962923 0.94
tpcds_q17/duckdb:vortex-compact 50721261 49366957 1.03
tpcds_q18/duckdb:vortex-compact 58985690 57717720 1.02
tpcds_q19/duckdb:vortex-compact 42997550 42343534 1.02
tpcds_q20/duckdb:vortex-compact 21264395 21258024 1.00
tpcds_q21/duckdb:vortex-compact 27354092 27332068 1.00
tpcds_q22/duckdb:vortex-compact 121599751 119275577 1.02
tpcds_q23/duckdb:vortex-compact 167764073 169489886 0.99
tpcds_q24/duckdb:vortex-compact 75159539 73399353 1.02
tpcds_q25/duckdb:vortex-compact 52871120 51713678 1.02
tpcds_q26/duckdb:vortex-compact 50640767 53132109 0.95
tpcds_q27/duckdb:vortex-compact 143306899 141316442 1.01
tpcds_q28/duckdb:vortex-compact 85530859 85628169 1.00
tpcds_q29/duckdb:vortex-compact 52486649 49396127 1.06
tpcds_q30/duckdb:vortex-compact 34657721 32643781 1.06
tpcds_q31/duckdb:vortex-compact 36032011 36464485 0.99
tpcds_q32/duckdb:vortex-compact 23589055 24174594 0.98
tpcds_q33/duckdb:vortex-compact 143545913 134647475 1.07
tpcds_q34/duckdb:vortex-compact 30651523 30933069 0.99
tpcds_q35/duckdb:vortex-compact 76064862 79694559 0.95
tpcds_q36/duckdb:vortex-compact 35682424 35613467 1.00
tpcds_q37/duckdb:vortex-compact 31590082 31609439 1.00
tpcds_q38/duckdb:vortex-compact 47744916 43477432 1.10
tpcds_q39/duckdb:vortex-compact 🚀 52451899 63180628 0.83
tpcds_q40/duckdb:vortex-compact 29470739 28631173 1.03
tpcds_q41/duckdb:vortex-compact 15867615 15575603 1.02
tpcds_q42/duckdb:vortex-compact 17186921 16442424 1.05
tpcds_q43/duckdb:vortex-compact 39102795 39565410 0.99
tpcds_q44/duckdb:vortex-compact 34941114 35496225 0.98
tpcds_q45/duckdb:vortex-compact 34220799 31977639 1.07
tpcds_q46/duckdb:vortex-compact 62326160 64683275 0.96
tpcds_q47/duckdb:vortex-compact 59165341 56713767 1.04
tpcds_q48/duckdb:vortex-compact 58573405 56880793 1.03
tpcds_q49/duckdb:vortex-compact 45419145 46194296 0.98
tpcds_q50/duckdb:vortex-compact 57616392 56038207 1.03
tpcds_q51/duckdb:vortex-compact 105176502 105554997 1.00
tpcds_q52/duckdb:vortex-compact 16911966 16781051 1.01
tpcds_q53/duckdb:vortex-compact 25097085 23582606 1.06
tpcds_q54/duckdb:vortex-compact 80495258 79778522 1.01
tpcds_q55/duckdb:vortex-compact 17239805 17075436 1.01
tpcds_q56/duckdb:vortex-compact 139888579 139409617 1.00
tpcds_q57/duckdb:vortex-compact 49088262 47673900 1.03
tpcds_q58/duckdb:vortex-compact 49627384 46768033 1.06
tpcds_q59/duckdb:vortex-compact 103362302 101990921 1.01
tpcds_q60/duckdb:vortex-compact 140006305 140401553 1.00
tpcds_q61/duckdb:vortex-compact 56555331 57012235 0.99
tpcds_q62/duckdb:vortex-compact 20623855 19791918 1.04
tpcds_q63/duckdb:vortex-compact 25479550 24663150 1.03
tpcds_q64/duckdb:vortex-compact 104937317 108580123 0.97
tpcds_q65/duckdb:vortex-compact 30719325 30273087 1.01
tpcds_q66/duckdb:vortex-compact 94367840 91076063 1.04
tpcds_q67/duckdb:vortex-compact 155066980 152170132 1.02
tpcds_q68/duckdb:vortex-compact 57966369 57751223 1.00
tpcds_q69/duckdb:vortex-compact 54180351 53866794 1.01
tpcds_q70/duckdb:vortex-compact 34754989 36073137 0.96
tpcds_q71/duckdb:vortex-compact 27314237 27268115 1.00
tpcds_q72/duckdb:vortex-compact 196189738 195839676 1.00
tpcds_q73/duckdb:vortex-compact 30092345 29069767 1.04
tpcds_q74/duckdb:vortex-compact 55421791 56165621 0.99
tpcds_q75/duckdb:vortex-compact 66887170 70451089 0.95
tpcds_q76/duckdb:vortex-compact 136115314 144034332 0.95
tpcds_q77/duckdb:vortex-compact 128453342 132476967 0.97
tpcds_q78/duckdb:vortex-compact 89057676 89702535 0.99
tpcds_q79/duckdb:vortex-compact 64930279 65958890 0.98
tpcds_q80/duckdb:vortex-compact 167181974 161450470 1.04
tpcds_q81/duckdb:vortex-compact 38999079 40150187 0.97
tpcds_q82/duckdb:vortex-compact 31609969 31916595 0.99
tpcds_q83/duckdb:vortex-compact 45431535 44801910 1.01
tpcds_q84/duckdb:vortex-compact 21166021 21463235 0.99
tpcds_q85/duckdb:vortex-compact 59125430 59093908 1.00
tpcds_q86/duckdb:vortex-compact 19722131 19667859 1.00
tpcds_q87/duckdb:vortex-compact 51848789 52917203 0.98
tpcds_q88/duckdb:vortex-compact 44810018 41750245 1.07
tpcds_q89/duckdb:vortex-compact 25765971 25717080 1.00
tpcds_q90/duckdb:vortex-compact 15236369 15459581 0.99
tpcds_q91/duckdb:vortex-compact 45911775 46879156 0.98
tpcds_q92/duckdb:vortex-compact 21427276 21662184 0.99
tpcds_q93/duckdb:vortex-compact 35640643 34252797 1.04
tpcds_q94/duckdb:vortex-compact 24333518 24253718 1.00
tpcds_q95/duckdb:vortex-compact 161736629 157139272 1.03
tpcds_q96/duckdb:vortex-compact 18060285 19692849 0.92
tpcds_q97/duckdb:vortex-compact 41983178 40875014 1.03
tpcds_q98/duckdb:vortex-compact 23840252 24597104 0.97
tpcds_q99/duckdb:vortex-compact 🚨 39682729 35311124 1.12
duckdb / parquet (0.995x ➖, 2↑ 2↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 43447064 44120471 0.98
tpcds_q02/duckdb:parquet 63135676 60509967 1.04
tpcds_q03/duckdb:parquet 11929212 11610522 1.03
tpcds_q04/duckdb:parquet 124074762 127491653 0.97
tpcds_q05/duckdb:parquet 72834934 74555000 0.98
tpcds_q06/duckdb:parquet 28502749 28102591 1.01
tpcds_q07/duckdb:parquet 23041987 23141401 1.00
tpcds_q08/duckdb:parquet 27623044 27264747 1.01
tpcds_q09/duckdb:parquet 39175043 39985898 0.98
tpcds_q10/duckdb:parquet 33789704 34657481 0.97
tpcds_q11/duckdb:parquet 88068058 86537189 1.02
tpcds_q12/duckdb:parquet 14322089 14427719 0.99
tpcds_q13/duckdb:parquet 34197326 33790755 1.01
tpcds_q14/duckdb:parquet 156427711 161516820 0.97
tpcds_q15/duckdb:parquet 29141025 30633537 0.95
tpcds_q16/duckdb:parquet 20965046 20666793 1.01
tpcds_q17/duckdb:parquet 36768558 38709220 0.95
tpcds_q18/duckdb:parquet 45465480 47458688 0.96
tpcds_q19/duckdb:parquet 28869782 29354719 0.98
tpcds_q20/duckdb:parquet 15357028 15332796 1.00
tpcds_q21/duckdb:parquet 🚀 10909075 12254014 0.89
tpcds_q22/duckdb:parquet 67413350 65351971 1.03
tpcds_q23/duckdb:parquet 116229083 113554993 1.02
tpcds_q24/duckdb:parquet 43745054 44535622 0.98
tpcds_q25/duckdb:parquet 32635821 32213447 1.01
tpcds_q26/duckdb:parquet 33434219 35490343 0.94
tpcds_q27/duckdb:parquet 88808979 88143857 1.01
tpcds_q28/duckdb:parquet 36610958 37096219 0.99
tpcds_q29/duckdb:parquet 35247536 35176475 1.00
tpcds_q30/duckdb:parquet 41375023 38277063 1.08
tpcds_q31/duckdb:parquet 24072704 22057438 1.09
tpcds_q32/duckdb:parquet 11277047 11669977 0.97
tpcds_q33/duckdb:parquet 71635055 70730183 1.01
tpcds_q34/duckdb:parquet 20711384 20772255 1.00
tpcds_q35/duckdb:parquet 57876577 57777476 1.00
tpcds_q36/duckdb:parquet 20685602 20169184 1.03
tpcds_q37/duckdb:parquet 12984079 13189678 0.98
tpcds_q38/duckdb:parquet 32496652 32421365 1.00
tpcds_q39/duckdb:parquet 32259857 32619825 0.99
tpcds_q40/duckdb:parquet 17704305 18626463 0.95
tpcds_q41/duckdb:parquet 7228264 7423813 0.97
tpcds_q42/duckdb:parquet 10072071 10089432 1.00
tpcds_q43/duckdb:parquet 15302331 15296698 1.00
tpcds_q44/duckdb:parquet 21238591 21795978 0.97
tpcds_q45/duckdb:parquet 26004411 27429111 0.95
tpcds_q46/duckdb:parquet 44273040 44386877 1.00
tpcds_q47/duckdb:parquet 44964054 45835813 0.98
tpcds_q48/duckdb:parquet 29815659 30315048 0.98
tpcds_q49/duckdb:parquet 24590097 25167208 0.98
tpcds_q50/duckdb:parquet 23962915 24613416 0.97
tpcds_q51/duckdb:parquet 🚨 116982851 94133443 1.24
tpcds_q52/duckdb:parquet 10326032 10396313 0.99
tpcds_q53/duckdb:parquet 16020754 16288336 0.98
tpcds_q54/duckdb:parquet 39644280 41633956 0.95
tpcds_q55/duckdb:parquet 10302442 10715629 0.96
tpcds_q56/duckdb:parquet 67965919 66465468 1.02
tpcds_q57/duckdb:parquet 35397330 35314359 1.00
tpcds_q58/duckdb:parquet 21629893 20953941 1.03
tpcds_q59/duckdb:parquet 34599423 36587936 0.95
tpcds_q60/duckdb:parquet 71759618 70897324 1.01
tpcds_q61/duckdb:parquet 28837498 28406416 1.02
tpcds_q62/duckdb:parquet 12226665 12586953 0.97
tpcds_q63/duckdb:parquet 15262847 15261339 1.00
tpcds_q64/duckdb:parquet 73499844 75618506 0.97
tpcds_q65/duckdb:parquet 19708266 19783152 1.00
tpcds_q66/duckdb:parquet 53024798 56208624 0.94
tpcds_q67/duckdb:parquet 133171714 133668810 1.00
tpcds_q68/duckdb:parquet 37868716 37706851 1.00
tpcds_q69/duckdb:parquet 38199092 38128055 1.00
tpcds_q70/duckdb:parquet 19413444 19244408 1.01
tpcds_q71/duckdb:parquet 18756982 19266303 0.97
tpcds_q72/duckdb:parquet 161424063 164220661 0.98
tpcds_q73/duckdb:parquet 17429575 19136743 0.91
tpcds_q74/duckdb:parquet 49469969 49543654 1.00
tpcds_q75/duckdb:parquet 52417815 53947007 0.97
tpcds_q76/duckdb:parquet 71398063 70136633 1.02
tpcds_q77/duckdb:parquet 62896267 64751259 0.97
tpcds_q78/duckdb:parquet 73961521 74262061 1.00
tpcds_q79/duckdb:parquet 27251022 27205523 1.00
tpcds_q80/duckdb:parquet 83652179 81769687 1.02
tpcds_q81/duckdb:parquet 46926501 46963123 1.00
tpcds_q82/duckdb:parquet 15807436 16433764 0.96
tpcds_q83/duckdb:parquet 15969017 16148251 0.99
tpcds_q84/duckdb:parquet 20263705 19648493 1.03
tpcds_q85/duckdb:parquet 39847718 39686015 1.00
tpcds_q86/duckdb:parquet 12060653 12384930 0.97
tpcds_q87/duckdb:parquet 36189844 35616611 1.02
tpcds_q88/duckdb:parquet 28777244 28843487 1.00
tpcds_q89/duckdb:parquet 17024120 16907995 1.01
tpcds_q90/duckdb:parquet 🚀 7003748 8044342 0.87
tpcds_q91/duckdb:parquet 22308264 23121249 0.96
tpcds_q92/duckdb:parquet 11416717 10961684 1.04
tpcds_q93/duckdb:parquet 31021790 30152754 1.03
tpcds_q94/duckdb:parquet 16199333 16218025 1.00
tpcds_q95/duckdb:parquet 🚨 139884719 119063195 1.17
tpcds_q96/duckdb:parquet 9109311 9242458 0.99
tpcds_q97/duckdb:parquet 36036254 33901351 1.06
tpcds_q98/duckdb:parquet 17758819 17975601 0.99
tpcds_q99/duckdb:parquet 19830914 19585237 1.01
duckdb / duckdb (1.004x ➖, 1↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19835592 20477695 0.97
tpcds_q02/duckdb:duckdb 18513402 18591432 1.00
tpcds_q03/duckdb:duckdb 8586311 7960878 1.08
tpcds_q04/duckdb:duckdb 161222747 161906396 1.00
tpcds_q05/duckdb:duckdb 16834720 18083954 0.93
tpcds_q06/duckdb:duckdb 21682560 22730346 0.95
tpcds_q07/duckdb:duckdb 38360754 38216264 1.00
tpcds_q08/duckdb:duckdb 119760473 118934347 1.01
tpcds_q09/duckdb:duckdb 19542772 19371192 1.01
tpcds_q10/duckdb:duckdb 22932234 23553884 0.97
tpcds_q11/duckdb:duckdb 139280307 138323014 1.01
tpcds_q12/duckdb:duckdb 11408118 10936531 1.04
tpcds_q13/duckdb:duckdb 23599956 23420844 1.01
tpcds_q14/duckdb:duckdb 91184003 92884260 0.98
tpcds_q15/duckdb:duckdb 24180817 22887236 1.06
tpcds_q16/duckdb:duckdb 17419113 17541665 0.99
tpcds_q17/duckdb:duckdb 21540924 21525521 1.00
tpcds_q18/duckdb:duckdb 42837517 43637333 0.98
tpcds_q19/duckdb:duckdb 16464157 16631438 0.99
tpcds_q20/duckdb:duckdb 11657335 11650208 1.00
tpcds_q21/duckdb:duckdb 6801568 6729631 1.01
tpcds_q22/duckdb:duckdb 59943312 61597239 0.97
tpcds_q23/duckdb:duckdb 77302090 72929225 1.06
tpcds_q24/duckdb:duckdb 22250228 22024653 1.01
tpcds_q25/duckdb:duckdb 17248060 17147686 1.01
tpcds_q26/duckdb:duckdb 25833413 25500992 1.01
tpcds_q27/duckdb:duckdb 36613024 37666169 0.97
tpcds_q28/duckdb:duckdb 21017495 20852782 1.01
tpcds_q29/duckdb:duckdb 20321793 20041504 1.01
tpcds_q30/duckdb:duckdb 28862650 28889893 1.00
tpcds_q31/duckdb:duckdb 19053240 19552762 0.97
tpcds_q32/duckdb:duckdb 7258090 6944825 1.05
tpcds_q33/duckdb:duckdb 13125103 12597219 1.04
tpcds_q34/duckdb:duckdb 14265582 14443540 0.99
tpcds_q35/duckdb:duckdb 34923779 33838282 1.03
tpcds_q36/duckdb:duckdb 69227159 68265080 1.01
tpcds_q37/duckdb:duckdb 7793312 7699236 1.01
tpcds_q38/duckdb:duckdb 29804464 30345004 0.98
tpcds_q39/duckdb:duckdb 26626228 24869645 1.07
tpcds_q40/duckdb:duckdb 12561911 13320945 0.94
tpcds_q41/duckdb:duckdb 🚀 8028474 9059460 0.89
tpcds_q42/duckdb:duckdb 5993672 6473888 0.93
tpcds_q43/duckdb:duckdb 11276690 11438724 0.99
tpcds_q44/duckdb:duckdb 13524799 13202553 1.02
tpcds_q45/duckdb:duckdb 17628176 17676592 1.00
tpcds_q46/duckdb:duckdb 35086637 35232215 1.00
tpcds_q47/duckdb:duckdb 40485221 41013289 0.99
tpcds_q48/duckdb:duckdb 21382002 21459257 1.00
tpcds_q49/duckdb:duckdb 16662388 15402265 1.08
tpcds_q50/duckdb:duckdb 13899060 13440700 1.03
tpcds_q51/duckdb:duckdb 91530238 90402224 1.01
tpcds_q52/duckdb:duckdb 7404025 6970472 1.06
tpcds_q53/duckdb:duckdb 11424898 11295724 1.01
tpcds_q54/duckdb:duckdb 16661728 16918995 0.98
tpcds_q55/duckdb:duckdb 6543391 6873064 0.95
tpcds_q56/duckdb:duckdb 12964552 13157774 0.99
tpcds_q57/duckdb:duckdb 31690408 32177979 0.98
tpcds_q58/duckdb:duckdb 11852210 12125325 0.98
tpcds_q59/duckdb:duckdb 34083873 34045754 1.00
tpcds_q60/duckdb:duckdb 14787983 14120425 1.05
tpcds_q61/duckdb:duckdb 14546243 14171812 1.03
tpcds_q62/duckdb:duckdb 8858865 8873204 1.00
tpcds_q63/duckdb:duckdb 11005233 10757007 1.02
tpcds_q64/duckdb:duckdb 51918316 53146811 0.98
tpcds_q65/duckdb:duckdb 34364136 33740788 1.02
tpcds_q66/duckdb:duckdb 23877600 24823465 0.96
tpcds_q67/duckdb:duckdb 130195740 129474289 1.01
tpcds_q68/duckdb:duckdb 24903682 24416410 1.02
tpcds_q69/duckdb:duckdb 23669224 23300304 1.02
tpcds_q70/duckdb:duckdb 13967576 13926480 1.00
tpcds_q71/duckdb:duckdb 12955423 12141126 1.07
tpcds_q72/duckdb:duckdb 42271718 42420142 1.00
tpcds_q73/duckdb:duckdb 10219318 10452344 0.98
tpcds_q74/duckdb:duckdb 96815083 96690850 1.00
tpcds_q75/duckdb:duckdb 41939593 41024431 1.02
tpcds_q76/duckdb:duckdb 11947363 11543141 1.04
tpcds_q77/duckdb:duckdb 11783302 11474131 1.03
tpcds_q78/duckdb:duckdb 63420476 62077985 1.02
tpcds_q79/duckdb:duckdb 17117829 17411391 0.98
tpcds_q80/duckdb:duckdb 28134582 27857020 1.01
tpcds_q81/duckdb:duckdb 36542134 36007194 1.01
tpcds_q82/duckdb:duckdb 8404156 8122838 1.03
tpcds_q83/duckdb:duckdb 8987314 8833747 1.02
tpcds_q84/duckdb:duckdb 12937528 14284881 0.91
tpcds_q85/duckdb:duckdb 23506320 22952014 1.02
tpcds_q86/duckdb:duckdb 🚨 10946026 9931868 1.10
tpcds_q87/duckdb:duckdb 33658225 34243452 0.98
tpcds_q88/duckdb:duckdb 23814953 23762422 1.00
tpcds_q89/duckdb:duckdb 12913984 13145847 0.98
tpcds_q90/duckdb:duckdb 5535892 5352452 1.03
tpcds_q91/duckdb:duckdb 13608322 12715213 1.07
tpcds_q92/duckdb:duckdb 8670890 9025875 0.96
tpcds_q93/duckdb:duckdb 22105837 21677695 1.02
tpcds_q94/duckdb:duckdb 12889060 12926321 1.00
tpcds_q95/duckdb:duckdb 123387953 124680390 0.99
tpcds_q96/duckdb:duckdb 4450693 4280555 1.04
tpcds_q97/duckdb:duckdb 30128027 29936567 1.01
tpcds_q98/duckdb:duckdb 13210847 12567853 1.05
tpcds_q99/duckdb:duckdb 16000344 16228716 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.8% -1.0% +2.8% +11.4% ➖ noise
1 datafusion:vortex-file-compressed -0.3% -1.0% +0.7% +10.1% ➖ noise
1 duckdb:duckdb -3.1% -1.0% -2.1% +14.0% ➖ noise
1 duckdb:vortex-compact -5.7% -1.0% -4.7% +15.1% ➖ noise
1 duckdb:vortex-file-compressed -2.1% -1.0% -1.1% +10.0% ➖ noise
2 datafusion:vortex-compact -1.0% +0.2% -1.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.7% +0.2% -2.9% +10.5% ➖ noise
2 duckdb:duckdb -0.4% +0.2% -0.6% +13.1% ➖ noise
2 duckdb:vortex-compact -2.3% +0.2% -2.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -5.0% +0.2% -5.3% +13.0% ➖ noise
3 datafusion:vortex-compact +0.6% +1.6% -1.0% +11.0% ➖ noise
3 datafusion:vortex-file-compressed -0.5% +1.6% -2.1% +11.5% ➖ noise
3 duckdb:duckdb +7.9% +1.6% +6.2% +22.5% ➖ noise
3 duckdb:vortex-compact +1.7% +1.6% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +4.7% +1.6% +3.1% +12.4% ➖ noise
4 datafusion:vortex-compact +1.2% -2.0% +3.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.9% -2.0% +1.2% +10.0% ➖ noise
4 duckdb:duckdb -0.4% -2.0% +1.6% +10.0% ➖ noise
4 duckdb:vortex-compact -2.4% -2.0% -0.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.3% -2.0% +2.4% +10.0% ➖ noise
5 datafusion:vortex-compact +0.6% -0.8% +1.4% +10.8% ➖ noise
5 datafusion:vortex-file-compressed -2.9% -0.8% -2.1% +11.0% ➖ noise
5 duckdb:duckdb -6.9% -0.8% -6.1% +17.9% ➖ noise
5 duckdb:vortex-compact +0.3% -0.8% +1.2% +13.7% ➖ noise
5 duckdb:vortex-file-compressed +3.1% -0.8% +4.0% +14.0% ➖ noise
6 datafusion:vortex-compact +4.1% -0.7% +4.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.0% -0.7% +3.7% +10.0% ➖ noise
6 duckdb:duckdb -4.6% -0.7% -4.0% +14.1% ➖ noise
6 duckdb:vortex-compact +0.3% -0.7% +0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.2% -0.7% -1.5% +10.0% ➖ noise
7 datafusion:vortex-compact +0.8% -0.7% +1.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -3.4% -0.7% -2.8% +10.0% ➖ noise
7 duckdb:duckdb +0.4% -0.7% +1.0% +17.5% ➖ noise
7 duckdb:vortex-compact +2.2% -0.7% +2.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.1% -0.7% -1.4% +10.0% ➖ noise
8 datafusion:vortex-compact +0.0% +1.1% -1.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.3% +1.1% -1.4% +10.0% ➖ noise
8 duckdb:duckdb +0.7% +1.1% -0.4% +10.0% ➖ noise
8 duckdb:vortex-compact -2.6% +1.1% -3.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.1% +1.1% -1.0% +10.0% ➖ noise
9 datafusion:vortex-compact +2.8% +0.0% +2.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.1% +0.0% +0.0% +10.0% ➖ noise
9 duckdb:duckdb +0.9% +0.0% +0.9% +10.0% ➖ noise
9 duckdb:vortex-compact -1.0% +0.0% -1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.4% +0.0% -1.4% +10.4% ➖ noise
10 datafusion:vortex-compact +3.6% -2.4% +6.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.7% -2.4% +4.2% +10.0% ➖ noise
10 duckdb:duckdb -2.6% -2.4% -0.3% +10.0% ➖ noise
10 duckdb:vortex-compact -5.9% -2.4% -3.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -3.2% -2.4% -0.9% +10.0% ➖ noise
11 datafusion:vortex-compact +0.6% +0.2% +0.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.4% +0.2% -0.7% +10.0% ➖ noise
11 duckdb:duckdb +0.7% +0.2% +0.5% +10.0% ➖ noise
11 duckdb:vortex-compact +0.9% +0.2% +0.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -5.3% +0.2% -5.5% +10.0% ➖ noise
12 datafusion:vortex-compact +0.7% -3.9% +4.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.1% -3.9% +5.1% +10.0% ➖ noise
12 duckdb:duckdb +4.3% -3.9% +8.5% +12.3% ➖ noise
12 duckdb:vortex-compact -5.8% -3.9% -2.0% +15.0% ➖ noise
12 duckdb:vortex-file-compressed +1.7% -3.9% +5.8% +17.4% ➖ noise
13 datafusion:vortex-compact -7.8% +0.1% -7.9% +11.2% ➖ noise
13 datafusion:vortex-file-compressed +1.0% +0.1% +0.9% +10.0% ➖ noise
13 duckdb:duckdb +0.8% +0.1% +0.6% +10.0% ➖ noise
13 duckdb:vortex-compact +1.1% +0.1% +1.0% +11.9% ➖ noise
13 duckdb:vortex-file-compressed +1.0% +0.1% +0.9% +10.0% ➖ noise
14 datafusion:vortex-compact +0.6% -4.0% +4.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.0% -4.0% +1.0% +10.0% ➖ noise
14 duckdb:duckdb -1.8% -4.0% +2.3% +10.0% ➖ noise
14 duckdb:vortex-compact -0.7% -4.0% +3.4% +13.9% ➖ noise
14 duckdb:vortex-file-compressed +7.2% -4.0% +11.7% +10.0% 🚨 regression
15 datafusion:vortex-compact +2.8% -0.1% +2.9% +11.6% ➖ noise
15 datafusion:vortex-file-compressed +0.2% -0.1% +0.3% +10.0% ➖ noise
15 duckdb:duckdb +5.7% -0.1% +5.8% +12.9% ➖ noise
15 duckdb:vortex-compact +2.0% -0.1% +2.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.6% -0.1% -1.5% +14.7% ➖ noise
16 datafusion:vortex-compact +1.2% -0.5% +1.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.3% -0.5% +2.8% +10.0% ➖ noise
16 duckdb:duckdb -0.7% -0.5% -0.2% +12.1% ➖ noise
16 duckdb:vortex-compact -5.7% -0.5% -5.2% +14.1% ➖ noise
16 duckdb:vortex-file-compressed -6.0% -0.5% -5.5% +10.0% ➖ noise
17 datafusion:vortex-compact +0.2% -3.8% +4.2% +10.3% ➖ noise
17 datafusion:vortex-file-compressed +0.5% -3.8% +4.4% +10.0% ➖ noise
17 duckdb:duckdb +0.1% -3.8% +4.0% +10.2% ➖ noise
17 duckdb:vortex-compact +2.7% -3.8% +6.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -2.7% -3.8% +1.1% +10.0% ➖ noise
18 datafusion:vortex-compact +2.7% -2.4% +5.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.1% -2.4% +2.6% +10.0% ➖ noise
18 duckdb:duckdb -1.8% -2.4% +0.6% +10.0% ➖ noise
18 duckdb:vortex-compact +2.2% -2.4% +4.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.3% -2.4% +2.8% +10.0% ➖ noise
19 datafusion:vortex-compact +2.2% +0.1% +2.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.3% +0.1% +1.2% +10.0% ➖ noise
19 duckdb:duckdb -1.0% +0.1% -1.1% +11.9% ➖ noise
19 duckdb:vortex-compact +1.5% +0.1% +1.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.4% +0.1% +1.3% +11.4% ➖ noise
20 datafusion:vortex-compact +1.3% -0.9% +2.2% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +0.3% -0.9% +1.2% +10.0% ➖ noise
20 duckdb:duckdb +0.1% -0.9% +0.9% +11.3% ➖ noise
20 duckdb:vortex-compact +0.0% -0.9% +0.9% +12.0% ➖ noise
20 duckdb:vortex-file-compressed -0.4% -0.9% +0.5% +10.6% ➖ noise
21 datafusion:vortex-compact -2.0% -7.9% +6.4% +11.3% ➖ noise
21 datafusion:vortex-file-compressed +1.1% -7.9% +9.7% +11.0% ➖ noise
21 duckdb:duckdb +1.1% -7.9% +9.7% +25.9% ➖ noise
21 duckdb:vortex-compact +0.1% -7.9% +8.6% +16.0% ➖ noise
21 duckdb:vortex-file-compressed -3.5% -7.9% +4.7% +18.8% ➖ noise
22 datafusion:vortex-compact +0.5% -0.0% +0.5% +12.4% ➖ noise
22 datafusion:vortex-file-compressed +1.2% -0.0% +1.2% +13.2% ➖ noise
22 duckdb:duckdb -2.7% -0.0% -2.7% +13.4% ➖ noise
22 duckdb:vortex-compact +1.9% -0.0% +2.0% +13.2% ➖ noise
22 duckdb:vortex-file-compressed -1.8% -0.0% -1.8% +10.9% ➖ noise
23 datafusion:vortex-compact +2.7% +2.5% +0.2% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +1.4% +2.5% -1.1% +10.0% ➖ noise
23 duckdb:duckdb +6.0% +2.5% +3.4% +12.4% ➖ noise
23 duckdb:vortex-compact -1.0% +2.5% -3.4% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -1.7% +2.5% -4.1% +13.1% ➖ noise
24 datafusion:vortex-compact +1.5% -1.1% +2.7% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +1.0% -1.1% +2.2% +10.0% ➖ noise
24 duckdb:duckdb +1.0% -1.1% +2.2% +10.9% ➖ noise
24 duckdb:vortex-compact +2.4% -1.1% +3.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +1.2% -1.1% +2.4% +12.5% ➖ noise
25 datafusion:vortex-compact +2.8% -1.2% +4.1% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -1.8% -1.2% -0.6% +10.0% ➖ noise
25 duckdb:duckdb +0.6% -1.2% +1.8% +10.0% ➖ noise
25 duckdb:vortex-compact +2.2% -1.2% +3.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -2.3% -1.2% -1.1% +10.0% ➖ noise
26 datafusion:vortex-compact -5.3% -2.1% -3.2% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +0.5% -2.1% +2.7% +10.7% ➖ noise
26 duckdb:duckdb +1.3% -2.1% +3.5% +11.6% ➖ noise
26 duckdb:vortex-compact -4.7% -2.1% -2.6% +13.5% ➖ noise
26 duckdb:vortex-file-compressed -1.7% -2.1% +0.5% +14.6% ➖ noise
27 datafusion:vortex-compact +1.5% +0.1% +1.4% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -1.7% +0.1% -1.8% +10.0% ➖ noise
27 duckdb:duckdb -2.8% +0.1% -2.9% +14.9% ➖ noise
27 duckdb:vortex-compact +1.4% +0.1% +1.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -2.0% +0.1% -2.0% +10.0% ➖ noise
28 datafusion:vortex-compact -1.3% -1.4% +0.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.1% -1.4% +3.6% +10.0% ➖ noise
28 duckdb:duckdb +0.8% -1.4% +2.3% +10.0% ➖ noise
28 duckdb:vortex-compact -0.1% -1.4% +1.4% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.8% -1.4% +0.7% +10.0% ➖ noise
29 datafusion:vortex-compact -0.9% -1.0% +0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +1.3% -1.0% +2.3% +10.0% ➖ noise
29 duckdb:duckdb +1.4% -1.0% +2.5% +10.5% ➖ noise
29 duckdb:vortex-compact +6.3% -1.0% +7.4% +13.5% ➖ noise
29 duckdb:vortex-file-compressed -0.8% -1.0% +0.2% +12.8% ➖ noise
30 datafusion:vortex-compact +2.5% +3.6% -1.1% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +3.3% +3.6% -0.3% +11.0% ➖ noise
30 duckdb:duckdb -0.1% +3.6% -3.5% +10.1% ➖ noise
30 duckdb:vortex-compact +6.2% +3.6% +2.5% +10.4% ➖ noise
30 duckdb:vortex-file-compressed +2.2% +3.6% -1.3% +11.9% ➖ noise
31 datafusion:vortex-compact +1.5% +4.8% -3.1% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +2.5% +4.8% -2.2% +10.0% ➖ noise
31 duckdb:duckdb -2.6% +4.8% -7.0% +19.5% ➖ noise
31 duckdb:vortex-compact -1.2% +4.8% -5.7% +15.2% ➖ noise
31 duckdb:vortex-file-compressed -1.1% +4.8% -5.7% +11.1% ➖ noise
32 datafusion:vortex-compact +0.8% -1.2% +2.0% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +3.2% -1.2% +4.4% +10.0% ➖ noise
32 duckdb:duckdb +4.5% -1.2% +5.8% +11.1% ➖ noise
32 duckdb:vortex-compact -2.4% -1.2% -1.3% +11.9% ➖ noise
32 duckdb:vortex-file-compressed -4.5% -1.2% -3.3% +14.1% ➖ noise
33 datafusion:vortex-compact -1.6% +2.2% -3.7% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.9% +2.2% -3.0% +10.0% ➖ noise
33 duckdb:duckdb +4.2% +2.2% +2.0% +11.5% ➖ noise
33 duckdb:vortex-compact +6.6% +2.2% +4.4% +11.0% ➖ noise
33 duckdb:vortex-file-compressed +0.3% +2.2% -1.9% +11.5% ➖ noise
34 datafusion:vortex-compact +2.2% -0.9% +3.1% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.3% -0.9% +1.2% +10.0% ➖ noise
34 duckdb:duckdb -1.2% -0.9% -0.3% +11.2% ➖ noise
34 duckdb:vortex-compact -0.9% -0.9% -0.0% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +4.1% -0.9% +5.1% +12.7% ➖ noise
35 datafusion:vortex-compact +3.0% +1.6% +1.3% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +4.0% +1.6% +2.3% +10.0% ➖ noise
35 duckdb:duckdb +3.2% +1.6% +1.5% +17.6% ➖ noise
35 duckdb:vortex-compact -4.6% +1.6% -6.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -5.0% +1.6% -6.5% +10.2% ➖ noise
36 datafusion:vortex-compact +0.5% +2.1% -1.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -2.1% +2.1% -4.1% +10.0% ➖ noise
36 duckdb:duckdb +1.4% +2.1% -0.6% +11.5% ➖ noise
36 duckdb:vortex-compact +0.2% +2.1% -1.8% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +0.7% +2.1% -1.3% +14.5% ➖ noise
37 datafusion:vortex-compact -0.2% +0.8% -0.9% +11.9% ➖ noise
37 datafusion:vortex-file-compressed -1.4% +0.8% -2.2% +10.0% ➖ noise
37 duckdb:duckdb +1.2% +0.8% +0.4% +15.1% ➖ noise
37 duckdb:vortex-compact -0.1% +0.8% -0.8% +12.4% ➖ noise
37 duckdb:vortex-file-compressed -2.0% +0.8% -2.8% +12.9% ➖ noise
38 datafusion:vortex-compact -0.0% -0.5% +0.5% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +4.4% -0.5% +4.9% +10.0% ➖ noise
38 duckdb:duckdb -1.8% -0.5% -1.3% +10.0% ➖ noise
38 duckdb:vortex-compact +9.8% -0.5% +10.4% +15.3% ➖ noise
38 duckdb:vortex-file-compressed -1.2% -0.5% -0.7% +10.0% ➖ noise
39 datafusion:vortex-compact +4.7% -0.7% +5.4% +17.1% ➖ noise
39 datafusion:vortex-file-compressed -3.1% -0.7% -2.5% +16.4% ➖ noise
39 duckdb:duckdb +7.1% -0.7% +7.8% +20.1% ➖ noise
39 duckdb:vortex-compact -17.0% -0.7% -16.4% +25.1% ➖ noise
39 duckdb:vortex-file-compressed +2.0% -0.7% +2.8% +20.0% ➖ noise
40 datafusion:vortex-compact +0.9% -5.9% +7.2% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -2.5% -5.9% +3.7% +10.0% ➖ noise
40 duckdb:duckdb -5.7% -5.9% +0.2% +16.0% ➖ noise
40 duckdb:vortex-compact +2.9% -5.9% +9.4% +11.8% ➖ noise
40 duckdb:vortex-file-compressed -5.4% -5.9% +0.6% +16.4% ➖ noise
41 datafusion:vortex-compact +2.1% -4.9% +7.5% +15.4% ➖ noise
41 datafusion:vortex-file-compressed +6.4% -4.9% +11.9% +13.7% ➖ noise
41 duckdb:duckdb -11.4% -4.9% -6.8% +11.4% ➖ noise
41 duckdb:vortex-compact +1.9% -4.9% +7.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +2.1% -4.9% +7.4% +10.0% ➖ noise
42 datafusion:vortex-compact +0.3% -0.5% +0.8% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +1.5% -0.5% +2.1% +14.3% ➖ noise
42 duckdb:duckdb -7.4% -0.5% -6.9% +15.0% ➖ noise
42 duckdb:vortex-compact +4.5% -0.5% +5.1% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +2.0% -0.5% +2.6% +14.3% ➖ noise
43 datafusion:vortex-compact +2.6% -0.3% +2.9% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -1.3% -0.3% -1.0% +10.0% ➖ noise
43 duckdb:duckdb -1.4% -0.3% -1.2% +10.0% ➖ noise
43 duckdb:vortex-compact -1.2% -0.3% -0.9% +10.0% ➖ noise
43 duckdb:vortex-file-compressed +1.1% -0.3% +1.4% +32.1% ➖ noise
44 datafusion:vortex-compact -0.8% -1.4% +0.6% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -1.9% -1.4% -0.5% +10.0% ➖ noise
44 duckdb:duckdb +2.4% -1.4% +3.9% +11.3% ➖ noise
44 duckdb:vortex-compact -1.6% -1.4% -0.1% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +1.6% -1.4% +3.0% +14.0% ➖ noise
45 datafusion:vortex-compact -2.8% -2.3% -0.5% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +1.1% -2.3% +3.5% +10.0% ➖ noise
45 duckdb:duckdb -0.3% -2.3% +2.0% +11.3% ➖ noise
45 duckdb:vortex-compact +7.0% -2.3% +9.5% +12.2% ➖ noise
45 duckdb:vortex-file-compressed -0.0% -2.3% +2.3% +11.9% ➖ noise
46 datafusion:vortex-compact -2.2% -0.8% -1.4% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -1.6% -0.8% -0.8% +13.9% ➖ noise
46 duckdb:duckdb -0.4% -0.8% +0.4% +10.0% ➖ noise
46 duckdb:vortex-compact -3.6% -0.8% -2.8% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +4.5% -0.8% +5.4% +10.0% ➖ noise
47 datafusion:vortex-compact +1.3% -0.8% +2.1% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +1.3% -0.8% +2.1% +10.0% ➖ noise
47 duckdb:duckdb -1.3% -0.8% -0.5% +10.1% ➖ noise
47 duckdb:vortex-compact +4.3% -0.8% +5.1% +11.4% ➖ noise
47 duckdb:vortex-file-compressed +1.3% -0.8% +2.1% +10.0% ➖ noise
48 datafusion:vortex-compact -6.3% -0.2% -6.1% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -4.8% -0.2% -4.6% +10.0% ➖ noise
48 duckdb:duckdb -0.4% -0.2% -0.2% +10.0% ➖ noise
48 duckdb:vortex-compact +3.0% -0.2% +3.1% +16.9% ➖ noise
48 duckdb:vortex-file-compressed +4.3% -0.2% +4.5% +10.0% ➖ noise
49 datafusion:vortex-compact -0.6% -2.8% +2.2% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +1.2% -2.8% +4.2% +10.0% ➖ noise
49 duckdb:duckdb +8.2% -2.8% +11.3% +13.1% ➖ noise
49 duckdb:vortex-compact -1.7% -2.8% +1.2% +13.2% ➖ noise
49 duckdb:vortex-file-compressed +10.3% -2.8% +13.5% +16.1% ➖ noise
50 datafusion:vortex-compact -1.8% -1.8% -0.0% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +0.1% -1.8% +2.0% +10.0% ➖ noise
50 duckdb:duckdb +3.4% -1.8% +5.3% +13.2% ➖ noise
50 duckdb:vortex-compact +2.8% -1.8% +4.7% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +2.3% -1.8% +4.2% +18.0% ➖ noise
51 datafusion:vortex-compact -0.5% +10.5% -10.0% +10.8% ✅ faster
51 datafusion:vortex-file-compressed +0.8% +10.5% -8.8% +10.8% ➖ noise
51 duckdb:duckdb +1.2% +10.5% -8.4% +11.7% ➖ noise
51 duckdb:vortex-compact -0.4% +10.5% -9.8% +10.4% ✅ faster
51 duckdb:vortex-file-compressed +2.7% +10.5% -7.1% +17.8% ➖ noise
52 datafusion:vortex-compact +2.9% -3.7% +6.9% +15.8% ➖ noise
52 datafusion:vortex-file-compressed -0.8% -3.7% +3.0% +13.7% ➖ noise
52 duckdb:duckdb +6.2% -3.7% +10.3% +17.7% ➖ noise
52 duckdb:vortex-compact +0.8% -3.7% +4.7% +16.4% ➖ noise
52 duckdb:vortex-file-compressed +3.1% -3.7% +7.1% +20.5% ➖ noise
53 datafusion:vortex-compact +0.0% +2.6% -2.5% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -3.2% +2.6% -5.6% +10.0% ➖ noise
53 duckdb:duckdb +1.1% +2.6% -1.4% +11.2% ➖ noise
53 duckdb:vortex-compact +6.4% +2.6% +3.8% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +1.0% +2.6% -1.5% +10.0% ➖ noise
54 datafusion:vortex-compact +1.7% -3.2% +5.1% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -1.9% -3.2% +1.4% +10.0% ➖ noise
54 duckdb:duckdb -1.5% -3.2% +1.8% +11.5% ➖ noise
54 duckdb:vortex-compact +0.9% -3.2% +4.3% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -1.8% -3.2% +1.5% +11.2% ➖ noise
55 datafusion:vortex-compact -0.6% -5.4% +5.0% +10.5% ➖ noise
55 datafusion:vortex-file-compressed +0.6% -5.4% +6.3% +15.4% ➖ noise
55 duckdb:duckdb -4.8% -5.4% +0.6% +16.4% ➖ noise
55 duckdb:vortex-compact +1.0% -5.4% +6.7% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -2.6% -5.4% +2.9% +26.7% ➖ noise
56 datafusion:vortex-compact +1.2% +2.8% -1.5% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +2.9% +2.8% +0.1% +10.0% ➖ noise
56 duckdb:duckdb -1.5% +2.8% -4.1% +14.6% ➖ noise
56 duckdb:vortex-compact +0.3% +2.8% -2.4% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -0.4% +2.8% -3.1% +10.0% ➖ noise
57 datafusion:vortex-compact +2.4% +0.0% +2.4% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +2.0% +0.0% +1.9% +10.0% ➖ noise
57 duckdb:duckdb -1.5% +0.0% -1.5% +19.1% ➖ noise
57 duckdb:vortex-compact +3.0% +0.0% +2.9% +16.4% ➖ noise
57 duckdb:vortex-file-compressed +4.2% +0.0% +4.2% +10.7% ➖ noise
58 datafusion:vortex-compact -2.9% +1.7% -4.6% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -1.7% +1.7% -3.4% +10.0% ➖ noise
58 duckdb:duckdb -2.3% +1.7% -3.9% +13.2% ➖ noise
58 duckdb:vortex-compact +6.1% +1.7% +4.3% +17.2% ➖ noise
58 duckdb:vortex-file-compressed -5.6% +1.7% -7.3% +16.2% ➖ noise
59 datafusion:vortex-compact -1.5% -3.0% +1.5% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -0.0% -3.0% +3.1% +10.0% ➖ noise
59 duckdb:duckdb +0.1% -3.0% +3.2% +10.0% ➖ noise
59 duckdb:vortex-compact +1.3% -3.0% +4.5% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +2.6% -3.0% +5.7% +10.0% ➖ noise
60 datafusion:vortex-compact +1.8% -1.2% +3.1% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +1.6% -1.2% +2.8% +10.0% ➖ noise
60 duckdb:duckdb +4.7% -1.2% +6.0% +10.0% ➖ noise
60 duckdb:vortex-compact -0.3% -1.2% +1.0% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -5.4% -1.2% -4.2% +10.7% ➖ noise
61 datafusion:vortex-compact +2.7% +0.9% +1.7% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +1.6% +0.9% +0.7% +10.0% ➖ noise
61 duckdb:duckdb +2.6% +0.9% +1.7% +10.0% ➖ noise
61 duckdb:vortex-compact -0.8% +0.9% -1.7% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -2.6% +0.9% -3.5% +13.8% ➖ noise
62 datafusion:vortex-compact -5.1% -7.2% +2.4% +11.7% ➖ noise
62 datafusion:vortex-file-compressed -4.7% -7.2% +2.7% +13.0% ➖ noise
62 duckdb:duckdb -0.2% -7.2% +7.6% +12.9% ➖ noise
62 duckdb:vortex-compact +4.2% -7.2% +12.3% +15.9% ➖ noise
62 duckdb:vortex-file-compressed -10.8% -7.2% -3.8% +21.9% ➖ noise
63 datafusion:vortex-compact -1.2% +0.6% -1.8% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -2.0% +0.6% -2.5% +10.0% ➖ noise
63 duckdb:duckdb +2.3% +0.6% +1.7% +10.3% ➖ noise
63 duckdb:vortex-compact +3.3% +0.6% +2.7% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +1.9% +0.6% +1.3% +10.0% ➖ noise
64 datafusion:vortex-compact -0.2% -1.3% +1.1% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -0.9% -1.3% +0.4% +10.0% ➖ noise
64 duckdb:duckdb -2.3% -1.3% -1.0% +10.0% ➖ noise
64 duckdb:vortex-compact -3.4% -1.3% -2.1% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +1.1% -1.3% +2.4% +10.0% ➖ noise
65 datafusion:vortex-compact +2.9% -1.6% +4.6% +11.2% ➖ noise
65 datafusion:vortex-file-compressed +2.3% -1.6% +4.0% +11.2% ➖ noise
65 duckdb:duckdb +1.8% -1.6% +3.5% +16.9% ➖ noise
65 duckdb:vortex-compact +1.5% -1.6% +3.2% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +2.6% -1.6% +4.3% +13.0% ➖ noise
66 datafusion:vortex-compact +5.1% -0.7% +5.8% +12.9% ➖ noise
66 datafusion:vortex-file-compressed -2.5% -0.7% -1.8% +11.6% ➖ noise
66 duckdb:duckdb -3.8% -0.7% -3.1% +14.9% ➖ noise
66 duckdb:vortex-compact +3.6% -0.7% +4.3% +13.9% ➖ noise
66 duckdb:vortex-file-compressed -8.4% -0.7% -7.7% +18.9% ➖ noise
67 datafusion:vortex-compact +2.8% -0.5% +3.3% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +2.6% -0.5% +3.2% +10.0% ➖ noise
67 duckdb:duckdb +0.6% -0.5% +1.1% +10.0% ➖ noise
67 duckdb:vortex-compact +1.9% -0.5% +2.4% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -1.7% -0.5% -1.2% +10.0% ➖ noise
68 datafusion:vortex-compact -1.8% -1.6% -0.2% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -1.3% -1.6% +0.3% +10.0% ➖ noise
68 duckdb:duckdb +2.0% -1.6% +3.6% +10.0% ➖ noise
68 duckdb:vortex-compact +0.4% -1.6% +2.0% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +0.8% -1.6% +2.4% +10.0% ➖ noise
69 datafusion:vortex-compact +3.2% +1.2% +2.0% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +3.2% +1.2% +2.0% +10.0% ➖ noise
69 duckdb:duckdb +1.6% +1.2% +0.4% +10.0% ➖ noise
69 duckdb:vortex-compact +0.6% +1.2% -0.6% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +4.8% +1.2% +3.6% +10.0% ➖ noise
70 datafusion:vortex-compact -2.2% +0.3% -2.5% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -6.4% +0.3% -6.7% +10.0% ➖ noise
70 duckdb:duckdb +0.3% +0.3% -0.0% +12.6% ➖ noise
70 duckdb:vortex-compact -3.7% +0.3% -4.0% +13.4% ➖ noise
70 duckdb:vortex-file-compressed +0.2% +0.3% -0.1% +10.0% ➖ noise
71 datafusion:vortex-compact -1.4% -3.0% +1.7% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +0.8% -3.0% +4.0% +10.0% ➖ noise
71 duckdb:duckdb +6.7% -3.0% +10.1% +12.4% ➖ noise
71 duckdb:vortex-compact +0.2% -3.0% +3.3% +14.1% ➖ noise
71 duckdb:vortex-file-compressed +1.9% -3.0% +5.1% +13.4% ➖ noise
72 datafusion:vortex-compact -0.6% -0.6% -0.1% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +1.0% -0.6% +1.6% +10.0% ➖ noise
72 duckdb:duckdb -0.3% -0.6% +0.2% +14.6% ➖ noise
72 duckdb:vortex-compact +0.2% -0.6% +0.7% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.2% -0.6% +0.4% +10.0% ➖ noise
73 datafusion:vortex-compact +0.0% -3.4% +3.5% +21.2% ➖ noise
73 datafusion:vortex-file-compressed +5.0% -3.4% +8.7% +27.0% ➖ noise
73 duckdb:duckdb -2.2% -3.4% +1.2% +12.2% ➖ noise
73 duckdb:vortex-compact +3.5% -3.4% +7.1% +12.0% ➖ noise
73 duckdb:vortex-file-compressed -2.7% -3.4% +0.7% +10.0% ➖ noise
74 datafusion:vortex-compact +2.0% -0.2% +2.1% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +0.5% -0.2% +0.7% +10.0% ➖ noise
74 duckdb:duckdb +0.1% -0.2% +0.3% +10.0% ➖ noise
74 duckdb:vortex-compact -1.3% -0.2% -1.2% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +2.5% -0.2% +2.7% +10.0% ➖ noise
75 datafusion:vortex-compact +2.6% -2.0% +4.7% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -0.3% -2.0% +1.8% +10.0% ➖ noise
75 duckdb:duckdb +2.2% -2.0% +4.3% +10.0% ➖ noise
75 duckdb:vortex-compact -5.1% -2.0% -3.1% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +2.0% -2.0% +4.1% +10.0% ➖ noise
76 datafusion:vortex-compact +1.2% +1.1% +0.1% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -5.1% +1.1% -6.2% +10.0% ➖ noise
76 duckdb:duckdb +3.5% +1.1% +2.3% +15.4% ➖ noise
76 duckdb:vortex-compact -5.5% +1.1% -6.6% +10.7% ➖ noise
76 duckdb:vortex-file-compressed -13.2% +1.1% -14.1% +11.8% ✅ faster
77 datafusion:vortex-compact +5.0% -2.1% +7.3% +10.1% ➖ noise
77 datafusion:vortex-file-compressed -0.1% -2.1% +2.0% +10.0% ➖ noise
77 duckdb:duckdb +2.7% -2.1% +4.9% +11.2% ➖ noise
77 duckdb:vortex-compact -3.0% -2.1% -0.9% +10.0% ➖ noise
77 duckdb:vortex-file-compressed -4.8% -2.1% -2.8% +10.0% ➖ noise
78 datafusion:vortex-compact +1.0% -0.6% +1.7% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -0.5% -0.6% +0.1% +10.0% ➖ noise
78 duckdb:duckdb +2.2% -0.6% +2.8% +10.0% ➖ noise
78 duckdb:vortex-compact -0.7% -0.6% -0.1% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +3.8% -0.6% +4.5% +10.0% ➖ noise
79 datafusion:vortex-compact +2.0% +0.6% +1.4% +10.6% ➖ noise
79 datafusion:vortex-file-compressed -4.3% +0.6% -4.9% +11.9% ➖ noise
79 duckdb:duckdb -1.7% +0.6% -2.2% +12.5% ➖ noise
79 duckdb:vortex-compact -1.6% +0.6% -2.1% +10.3% ➖ noise
79 duckdb:vortex-file-compressed -1.8% +0.6% -2.4% +12.5% ➖ noise
80 datafusion:vortex-compact -2.9% +1.5% -4.3% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +1.0% +1.5% -0.5% +10.0% ➖ noise
80 duckdb:duckdb +1.0% +1.5% -0.5% +16.6% ➖ noise
80 duckdb:vortex-compact +3.6% +1.5% +2.0% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +0.6% +1.5% -0.9% +10.3% ➖ noise
81 datafusion:vortex-compact -6.4% +0.2% -6.5% +11.5% ➖ noise
81 datafusion:vortex-file-compressed +0.8% +0.2% +0.7% +16.9% ➖ noise
81 duckdb:duckdb +1.5% +0.2% +1.3% +10.0% ➖ noise
81 duckdb:vortex-compact -2.9% +0.2% -3.0% +10.0% ➖ noise
81 duckdb:vortex-file-compressed +0.9% +0.2% +0.8% +10.0% ➖ noise
82 datafusion:vortex-compact -4.1% -2.4% -1.7% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -0.8% -2.4% +1.6% +10.0% ➖ noise
82 duckdb:duckdb +3.5% -2.4% +6.0% +13.5% ➖ noise
82 duckdb:vortex-compact -1.0% -2.4% +1.5% +10.0% ➖ noise
82 duckdb:vortex-file-compressed +4.4% -2.4% +6.9% +13.4% ➖ noise
83 datafusion:vortex-compact -0.6% -0.3% -0.3% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +1.3% -0.3% +1.6% +10.0% ➖ noise
83 duckdb:duckdb +1.7% -0.3% +2.1% +10.0% ➖ noise
83 duckdb:vortex-compact +1.4% -0.3% +1.7% +10.5% ➖ noise
83 duckdb:vortex-file-compressed -1.9% -0.3% -1.6% +13.7% ➖ noise
84 datafusion:vortex-compact +3.4% +0.8% +2.6% +11.0% ➖ noise
84 datafusion:vortex-file-compressed +4.4% +0.8% +3.6% +10.3% ➖ noise
84 duckdb:duckdb -9.4% +0.8% -10.2% +12.6% ➖ noise
84 duckdb:vortex-compact -1.4% +0.8% -2.2% +11.5% ➖ noise
84 duckdb:vortex-file-compressed +0.5% +0.8% -0.3% +10.0% ➖ noise
85 datafusion:vortex-compact -6.3% +0.3% -6.6% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -0.6% +0.3% -1.0% +10.0% ➖ noise
85 duckdb:duckdb +2.4% +0.3% +2.1% +12.8% ➖ noise
85 duckdb:vortex-compact +0.1% +0.3% -0.3% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +3.8% +0.3% +3.4% +10.0% ➖ noise
86 datafusion:vortex-compact -3.6% -4.4% +0.9% +10.0% ➖ noise
86 datafusion:vortex-file-compressed -1.1% -4.4% +3.4% +10.0% ➖ noise
86 duckdb:duckdb +10.2% -4.4% +15.2% +14.3% 🚨 regression
86 duckdb:vortex-compact +0.3% -4.4% +4.9% +15.2% ➖ noise
86 duckdb:vortex-file-compressed -0.1% -4.4% +4.5% +15.5% ➖ noise
87 datafusion:vortex-compact +0.4% -1.6% +2.0% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -3.0% -1.6% -1.5% +10.0% ➖ noise
87 duckdb:duckdb -1.7% -1.6% -0.2% +18.5% ➖ noise
87 duckdb:vortex-compact -2.0% -1.6% -0.5% +10.0% ➖ noise
87 duckdb:vortex-file-compressed +6.4% -1.6% +8.1% +12.1% ➖ noise
88 datafusion:vortex-compact -2.5% -1.0% -1.5% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -2.4% -1.0% -1.4% +10.0% ➖ noise
88 duckdb:duckdb +0.2% -1.0% +1.2% +10.0% ➖ noise
88 duckdb:vortex-compact +7.3% -1.0% +8.4% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +3.4% -1.0% +4.5% +10.0% ➖ noise
89 datafusion:vortex-compact +2.9% -0.1% +3.0% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -2.2% -0.1% -2.1% +10.0% ➖ noise
89 duckdb:duckdb -1.8% -0.1% -1.6% +13.0% ➖ noise
89 duckdb:vortex-compact +0.2% -0.1% +0.3% +10.1% ➖ noise
89 duckdb:vortex-file-compressed +2.2% -0.1% +2.3% +11.4% ➖ noise
90 datafusion:vortex-compact +0.1% -4.9% +5.2% +11.2% ➖ noise
90 datafusion:vortex-file-compressed -1.4% -4.9% +3.7% +27.0% ➖ noise
90 duckdb:duckdb +3.4% -4.9% +8.8% +12.4% ➖ noise
90 duckdb:vortex-compact -1.4% -4.9% +3.6% +11.3% ➖ noise
90 duckdb:vortex-file-compressed -1.5% -4.9% +3.6% +14.6% ➖ noise
91 datafusion:vortex-compact +5.7% -0.5% +6.2% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +4.1% -0.5% +4.6% +10.0% ➖ noise
91 duckdb:duckdb +7.0% -0.5% +7.5% +23.7% ➖ noise
91 duckdb:vortex-compact -2.1% -0.5% -1.6% +11.3% ➖ noise
91 duckdb:vortex-file-compressed +2.3% -0.5% +2.8% +10.0% ➖ noise
92 datafusion:vortex-compact +3.3% +4.0% -0.7% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +1.7% +4.0% -2.3% +10.0% ➖ noise
92 duckdb:duckdb -3.9% +4.0% -7.7% +11.1% ➖ noise
92 duckdb:vortex-compact -1.1% +4.0% -4.9% +20.2% ➖ noise
92 duckdb:vortex-file-compressed +8.8% +4.0% +4.6% +11.4% ➖ noise
93 datafusion:vortex-compact +1.6% +0.4% +1.2% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -2.4% +0.4% -2.9% +11.7% ➖ noise
93 duckdb:duckdb +2.0% +0.4% +1.5% +14.6% ➖ noise
93 duckdb:vortex-compact +4.1% +0.4% +3.6% +12.5% ➖ noise
93 duckdb:vortex-file-compressed +0.1% +0.4% -0.3% +12.0% ➖ noise
94 datafusion:vortex-compact -3.3% -0.3% -3.0% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +0.7% -0.3% +1.0% +10.0% ➖ noise
94 duckdb:duckdb -0.3% -0.3% -0.0% +10.0% ➖ noise
94 duckdb:vortex-compact +0.3% -0.3% +0.6% +10.0% ➖ noise
94 duckdb:vortex-file-compressed +1.7% -0.3% +1.9% +10.0% ➖ noise
95 datafusion:vortex-compact +0.0% +7.9% -7.3% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +0.5% +7.9% -6.8% +10.2% ➖ noise
95 duckdb:duckdb -1.0% +7.9% -8.3% +19.5% ➖ noise
95 duckdb:vortex-compact +2.9% +7.9% -4.6% +15.4% ➖ noise
95 duckdb:vortex-file-compressed +1.2% +7.9% -6.2% +17.8% ➖ noise
96 datafusion:vortex-compact +0.4% +1.6% -1.2% +11.0% ➖ noise
96 datafusion:vortex-file-compressed -1.8% +1.6% -3.4% +16.9% ➖ noise
96 duckdb:duckdb +4.0% +1.6% +2.3% +16.9% ➖ noise
96 duckdb:vortex-compact -8.3% +1.6% -9.8% +24.3% ➖ noise
96 duckdb:vortex-file-compressed +6.0% +1.6% +4.3% +20.5% ➖ noise
97 datafusion:vortex-compact -2.4% +1.6% -4.0% +23.5% ➖ noise
97 datafusion:vortex-file-compressed +0.8% +1.6% -0.8% +10.0% ➖ noise
97 duckdb:duckdb +0.6% +1.6% -1.0% +10.0% ➖ noise
97 duckdb:vortex-compact +2.7% +1.6% +1.1% +10.0% ➖ noise
97 duckdb:vortex-file-compressed +7.3% +1.6% +5.6% +11.7% ➖ noise
98 datafusion:vortex-compact -2.4% -0.9% -1.4% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -4.4% -0.9% -3.5% +10.4% ➖ noise
98 duckdb:duckdb +5.1% -0.9% +6.1% +14.2% ➖ noise
98 duckdb:vortex-compact -3.1% -0.9% -2.2% +10.2% ➖ noise
98 duckdb:vortex-file-compressed -5.6% -0.9% -4.7% +13.0% ➖ noise
99 datafusion:vortex-compact -6.4% +0.9% -7.2% +14.8% ➖ noise
99 datafusion:vortex-file-compressed +2.5% +0.9% +1.6% +15.4% ➖ noise
99 duckdb:duckdb -1.4% +0.9% -2.3% +25.2% ➖ noise
99 duckdb:vortex-compact +12.4% +0.9% +11.4% +40.5% ➖ noise
99 duckdb:vortex-file-compressed -0.3% +0.9% -1.2% +22.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (medium confidence)
Attributed Vortex impact: +7.4%
Vortex (geomean): 1.108x ❌
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +6.1%


datafusion / vortex-file-compressed (1.019x ➖, 0↑ 4↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 409761553 406728148 1.01
tpch_q02/datafusion:vortex-file-compressed 116767652 120773996 0.97
tpch_q03/datafusion:vortex-file-compressed 202194846 212604222 0.95
tpch_q04/datafusion:vortex-file-compressed 100024707 102318577 0.98
tpch_q05/datafusion:vortex-file-compressed 389210956 394777133 0.99
tpch_q06/datafusion:vortex-file-compressed 41967847 41506256 1.01
tpch_q07/datafusion:vortex-file-compressed 579660937 575622983 1.01
tpch_q08/datafusion:vortex-file-compressed 382551742 379146531 1.01
tpch_q09/datafusion:vortex-file-compressed 666989685 677584664 0.98
tpch_q10/datafusion:vortex-file-compressed 256523788 246420664 1.04
tpch_q11/datafusion:vortex-file-compressed 🚨 97567115 86313972 1.13
tpch_q12/datafusion:vortex-file-compressed 111949481 109367907 1.02
tpch_q13/datafusion:vortex-file-compressed 222386111 226595185 0.98
tpch_q14/datafusion:vortex-file-compressed 57972072 59283154 0.98
tpch_q15/datafusion:vortex-file-compressed 108043390 111798493 0.97
tpch_q16/datafusion:vortex-file-compressed 79977356 80387652 0.99
tpch_q17/datafusion:vortex-file-compressed 681949456 681108062 1.00
tpch_q18/datafusion:vortex-file-compressed 933662387 920110490 1.01
tpch_q19/datafusion:vortex-file-compressed 94380578 95159268 0.99
tpch_q20/datafusion:vortex-file-compressed 🚨 195492222 177143255 1.10
tpch_q21/datafusion:vortex-file-compressed 🚨 831773435 702468352 1.18
tpch_q22/datafusion:vortex-file-compressed 🚨 70974545 61731808 1.15
datafusion / vortex-compact (1.125x ❌, 0↑ 15↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 495384133 462012396 1.07
tpch_q02/datafusion:vortex-compact 137837439 126226297 1.09
tpch_q03/datafusion:vortex-compact 🚨 260816338 228026766 1.14
tpch_q04/datafusion:vortex-compact 🚨 142515127 123086340 1.16
tpch_q05/datafusion:vortex-compact 🚨 484801569 410569204 1.18
tpch_q06/datafusion:vortex-compact 🚨 74194008 64017498 1.16
tpch_q07/datafusion:vortex-compact 🚨 712576142 609708719 1.17
tpch_q08/datafusion:vortex-compact 🚨 447186114 403677069 1.11
tpch_q09/datafusion:vortex-compact 🚨 799158200 702254570 1.14
tpch_q10/datafusion:vortex-compact 🚨 317667276 278504343 1.14
tpch_q11/datafusion:vortex-compact 🚨 104308976 92751905 1.12
tpch_q12/datafusion:vortex-compact 183066507 168691513 1.09
tpch_q13/datafusion:vortex-compact 299006746 279142756 1.07
tpch_q14/datafusion:vortex-compact 82296452 75747521 1.09
tpch_q15/datafusion:vortex-compact 🚨 191589075 168078245 1.14
tpch_q16/datafusion:vortex-compact 🚨 95859952 85079037 1.13
tpch_q17/datafusion:vortex-compact 🚨 794787093 675971114 1.18
tpch_q18/datafusion:vortex-compact 🚨 1082774103 925080694 1.17
tpch_q19/datafusion:vortex-compact 147391170 137147892 1.07
tpch_q20/datafusion:vortex-compact 🚨 232506365 203909098 1.14
tpch_q21/datafusion:vortex-compact 🚨 815246307 734477585 1.11
tpch_q22/datafusion:vortex-compact 80861445 74464139 1.09
datafusion / parquet (0.981x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 431074404 427050369 1.01
tpch_q02/datafusion:parquet 185902855 191612256 0.97
tpch_q03/datafusion:parquet 299057922 306020521 0.98
tpch_q04/datafusion:parquet 133803436 136490734 0.98
tpch_q05/datafusion:parquet 447237824 465114998 0.96
tpch_q06/datafusion:parquet 119833942 116437430 1.03
tpch_q07/datafusion:parquet 634621466 664358651 0.96
tpch_q08/datafusion:parquet 485453601 498388482 0.97
tpch_q09/datafusion:parquet 768528614 800478751 0.96
tpch_q10/datafusion:parquet 503350781 521258004 0.97
tpch_q11/datafusion:parquet 132499409 137094150 0.97
tpch_q12/datafusion:parquet 203273417 207411846 0.98
tpch_q13/datafusion:parquet 340425557 346338802 0.98
tpch_q14/datafusion:parquet 165767016 164355611 1.01
tpch_q15/datafusion:parquet 249718798 251147309 0.99
tpch_q16/datafusion:parquet 138271931 145641131 0.95
tpch_q17/datafusion:parquet 703578148 716469001 0.98
tpch_q18/datafusion:parquet 891157292 920963037 0.97
tpch_q19/datafusion:parquet 286367972 274658314 1.04
tpch_q20/datafusion:parquet 310147161 321359029 0.97
tpch_q21/datafusion:parquet 737394234 763913771 0.97
tpch_q22/datafusion:parquet 221280430 222899602 0.99
datafusion / arrow (0.968x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 621378982 619395079 1.00
tpch_q02/datafusion:arrow 166644134 166020492 1.00
tpch_q03/datafusion:arrow 453406930 475985740 0.95
tpch_q04/datafusion:arrow 348087704 372667771 0.93
tpch_q05/datafusion:arrow 923834593 961824250 0.96
tpch_q06/datafusion:arrow 279824662 280337208 1.00
tpch_q07/datafusion:arrow 1189233204 1178365559 1.01
tpch_q08/datafusion:arrow 1095623726 1167801334 0.94
tpch_q09/datafusion:arrow 1326319427 1369168427 0.97
tpch_q10/datafusion:arrow 607951225 623137952 0.98
tpch_q11/datafusion:arrow 148963365 155496082 0.96
tpch_q12/datafusion:arrow 668946199 674326358 0.99
tpch_q13/datafusion:arrow 515364830 542822439 0.95
tpch_q14/datafusion:arrow 305637372 323139894 0.95
tpch_q15/datafusion:arrow 666812689 709997915 0.94
tpch_q16/datafusion:arrow 107987052 109946751 0.98
tpch_q17/datafusion:arrow 1336308825 1375652610 0.97
tpch_q18/datafusion:arrow 1816203166 1910810856 0.95
tpch_q19/datafusion:arrow 500361055 512120109 0.98
tpch_q20/datafusion:arrow 505099993 513206905 0.98
tpch_q21/datafusion:arrow 2797701719 2941233828 0.95
tpch_q22/datafusion:arrow 143126458 149970351 0.95
duckdb / vortex-file-compressed (1.156x ❌, 0↑ 19↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 201251004 179251227 1.12
tpch_q02/duckdb:vortex-file-compressed 🚨 61234681 54066264 1.13
tpch_q03/duckdb:vortex-file-compressed 🚨 163730734 128198151 1.28
tpch_q04/duckdb:vortex-file-compressed 🚨 193374504 149556375 1.29
tpch_q05/duckdb:vortex-file-compressed 🚨 167512712 132321216 1.27
tpch_q06/duckdb:vortex-file-compressed 🚨 59660899 48988648 1.22
tpch_q07/duckdb:vortex-file-compressed 🚨 181790589 151364922 1.20
tpch_q08/duckdb:vortex-file-compressed 🚨 230043069 192211289 1.20
tpch_q09/duckdb:vortex-file-compressed 🚨 395928383 348424498 1.14
tpch_q10/duckdb:vortex-file-compressed 🚨 186995176 159749584 1.17
tpch_q11/duckdb:vortex-file-compressed 🚨 41267982 36437025 1.13
tpch_q12/duckdb:vortex-file-compressed 🚨 103314548 92415859 1.12
tpch_q13/duckdb:vortex-file-compressed 🚨 291782123 258689457 1.13
tpch_q14/duckdb:vortex-file-compressed 🚨 85896114 72887904 1.18
tpch_q15/duckdb:vortex-file-compressed 🚨 117162622 100893344 1.16
tpch_q16/duckdb:vortex-file-compressed 90913945 82936284 1.10
tpch_q17/duckdb:vortex-file-compressed 🚨 123304290 107110904 1.15
tpch_q18/duckdb:vortex-file-compressed 🚨 330611565 287232429 1.15
tpch_q19/duckdb:vortex-file-compressed 🚨 102464001 92557298 1.11
tpch_q20/duckdb:vortex-file-compressed 186144375 171308809 1.09
tpch_q21/duckdb:vortex-file-compressed 🚨 634688949 573771483 1.11
tpch_q22/duckdb:vortex-file-compressed 82245824 79062761 1.04
duckdb / vortex-compact (1.138x ❌, 0↑ 19↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 248510931 230334123 1.08
tpch_q02/duckdb:vortex-compact 63510898 61508408 1.03
tpch_q03/duckdb:vortex-compact 🚨 161700322 144048164 1.12
tpch_q04/duckdb:vortex-compact 🚨 207650701 178518093 1.16
tpch_q05/duckdb:vortex-compact 🚨 172238361 154657481 1.11
tpch_q06/duckdb:vortex-compact 🚨 99233281 84255030 1.18
tpch_q07/duckdb:vortex-compact 🚨 241031673 205105351 1.18
tpch_q08/duckdb:vortex-compact 🚨 246864683 198630110 1.24
tpch_q09/duckdb:vortex-compact 🚨 432100186 370482189 1.17
tpch_q10/duckdb:vortex-compact 🚨 225894807 192082828 1.18
tpch_q11/duckdb:vortex-compact 🚨 50650167 42935846 1.18
tpch_q12/duckdb:vortex-compact 🚨 234735347 203914308 1.15
tpch_q13/duckdb:vortex-compact 🚨 351487029 309996075 1.13
tpch_q14/duckdb:vortex-compact 🚨 121045678 107268629 1.13
tpch_q15/duckdb:vortex-compact 🚨 136744195 121956516 1.12
tpch_q16/duckdb:vortex-compact 🚨 98671411 89018590 1.11
tpch_q17/duckdb:vortex-compact 🚨 142194136 121224493 1.17
tpch_q18/duckdb:vortex-compact 🚨 349957930 304376783 1.15
tpch_q19/duckdb:vortex-compact 127674472 117744579 1.08
tpch_q20/duckdb:vortex-compact 🚨 241573243 213365578 1.13
tpch_q21/duckdb:vortex-compact 🚨 741635483 654050424 1.13
tpch_q22/duckdb:vortex-compact 🚨 101499099 92045810 1.10
duckdb / parquet (1.031x ➖, 0↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 266284657 260968026 1.02
tpch_q02/duckdb:parquet 109553853 106284992 1.03
tpch_q03/duckdb:parquet 225765678 217309797 1.04
tpch_q04/duckdb:parquet 149628827 139050179 1.08
tpch_q05/duckdb:parquet 230432988 226907977 1.02
tpch_q06/duckdb:parquet 68974324 68448296 1.01
tpch_q07/duckdb:parquet 191852941 185619004 1.03
tpch_q08/duckdb:parquet 281131275 262102392 1.07
tpch_q09/duckdb:parquet 502310121 467061834 1.08
tpch_q10/duckdb:parquet 621923932 619217882 1.00
tpch_q11/duckdb:parquet 46694027 48019751 0.97
tpch_q12/duckdb:parquet 126753595 129554590 0.98
tpch_q13/duckdb:parquet 436223643 459999114 0.95
tpch_q14/duckdb:parquet 180108461 179332878 1.00
tpch_q15/duckdb:parquet 103858907 98837500 1.05
tpch_q16/duckdb:parquet 172192495 166966842 1.03
tpch_q17/duckdb:parquet 184478017 181509397 1.02
tpch_q18/duckdb:parquet 361132308 358196726 1.01
tpch_q19/duckdb:parquet 299003537 289046224 1.03
tpch_q20/duckdb:parquet 250654552 232513858 1.08
tpch_q21/duckdb:parquet 🚨 666210829 584138460 1.14
tpch_q22/duckdb:parquet 307720664 291244889 1.06
duckdb / duckdb (1.089x ➖, 0↑ 8↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 126597462 117700275 1.08
tpch_q02/duckdb:duckdb 49380689 45974111 1.07
tpch_q03/duckdb:duckdb 🚨 109608969 99166453 1.11
tpch_q04/duckdb:duckdb 🚨 156102202 135220883 1.15
tpch_q05/duckdb:duckdb 🚨 125224062 113301169 1.11
tpch_q06/duckdb:duckdb 37908803 39531378 0.96
tpch_q07/duckdb:duckdb 93176301 87610132 1.06
tpch_q08/duckdb:duckdb 123275870 112297754 1.10
tpch_q09/duckdb:duckdb 🚨 313282758 283067443 1.11
tpch_q10/duckdb:duckdb 226791283 206445674 1.10
tpch_q11/duckdb:duckdb 🚨 18589136 16071456 1.16
tpch_q12/duckdb:duckdb 91609501 84676122 1.08
tpch_q13/duckdb:duckdb 🚨 283213314 255959806 1.11
tpch_q14/duckdb:duckdb 78053732 72418588 1.08
tpch_q15/duckdb:duckdb 85692301 80488238 1.06
tpch_q16/duckdb:duckdb 🚨 83041113 74143009 1.12
tpch_q17/duckdb:duckdb 92981866 85565439 1.09
tpch_q18/duckdb:duckdb 🚨 242224856 218779205 1.11
tpch_q19/duckdb:duckdb 126167524 117053002 1.08
tpch_q20/duckdb:duckdb 120715707 113049911 1.07
tpch_q21/duckdb:duckdb 353410408 323874805 1.09
tpch_q22/duckdb:duckdb 71889380 65998873 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.3% +1.5% -1.2% +13.1% ➖ noise
1 datafusion:vortex-compact +7.2% +1.5% +5.7% +13.1% ➖ noise
1 datafusion:vortex-file-compressed +0.7% +1.5% -0.7% +13.4% ➖ noise
1 duckdb:duckdb +7.6% +1.5% +6.0% +11.5% ➖ noise
1 duckdb:vortex-compact +7.9% +1.5% +6.3% +12.6% ➖ noise
1 duckdb:vortex-file-compressed +12.3% +1.5% +10.6% +12.0% ➖ noise
2 datafusion:arrow +0.4% +0.0% +0.4% +10.0% ➖ noise
2 datafusion:vortex-compact +9.2% +0.0% +9.2% +11.3% ➖ noise
2 datafusion:vortex-file-compressed -3.3% +0.0% -3.3% +10.0% ➖ noise
2 duckdb:duckdb +7.4% +0.0% +7.4% +10.0% ➖ noise
2 duckdb:vortex-compact +3.3% +0.0% +3.3% +12.4% ➖ noise
2 duckdb:vortex-file-compressed +13.3% +0.0% +13.3% +10.0% 🚨 regression
3 datafusion:arrow -4.7% +0.8% -5.5% +10.0% ➖ noise
3 datafusion:vortex-compact +14.4% +0.8% +13.5% +10.0% 🚨 regression
3 datafusion:vortex-file-compressed -4.9% +0.8% -5.6% +10.0% ➖ noise
3 duckdb:duckdb +10.5% +0.8% +9.7% +10.0% ➖ noise
3 duckdb:vortex-compact +12.3% +0.8% +11.4% +10.0% 🚨 regression
3 duckdb:vortex-file-compressed +27.7% +0.8% +26.8% +10.0% 🚨 regression
4 datafusion:arrow -6.6% +2.7% -9.1% +10.0% ➖ noise
4 datafusion:vortex-compact +15.8% +2.7% +12.7% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed -2.2% +2.7% -4.8% +10.0% ➖ noise
4 duckdb:duckdb +15.4% +2.7% +12.4% +10.0% 🚨 regression
4 duckdb:vortex-compact +16.3% +2.7% +13.3% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +29.3% +2.7% +25.9% +10.0% 🚨 regression
5 datafusion:arrow -3.9% -1.2% -2.8% +10.0% ➖ noise
5 datafusion:vortex-compact +18.1% -1.2% +19.5% +10.0% 🚨 regression
5 datafusion:vortex-file-compressed -1.4% -1.2% -0.2% +10.0% ➖ noise
5 duckdb:duckdb +10.5% -1.2% +11.8% +10.0% 🚨 regression
5 duckdb:vortex-compact +11.4% -1.2% +12.7% +10.0% 🚨 regression
5 duckdb:vortex-file-compressed +26.6% -1.2% +28.1% +10.0% 🚨 regression
6 datafusion:arrow -0.2% +1.8% -2.0% +10.0% ➖ noise
6 datafusion:vortex-compact +15.9% +1.8% +13.8% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed +1.1% +1.8% -0.7% +10.0% ➖ noise
6 duckdb:duckdb -4.1% +1.8% -5.8% +17.1% ➖ noise
6 duckdb:vortex-compact +17.8% +1.8% +15.7% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed +21.8% +1.8% +19.6% +15.6% 🚨 regression
7 datafusion:arrow +0.9% -0.6% +1.6% +10.0% ➖ noise
7 datafusion:vortex-compact +16.9% -0.6% +17.6% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed +0.7% -0.6% +1.3% +10.0% ➖ noise
7 duckdb:duckdb +6.4% -0.6% +7.0% +10.0% ➖ noise
7 duckdb:vortex-compact +17.5% -0.6% +18.3% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +20.1% -0.6% +20.9% +10.0% 🚨 regression
8 datafusion:arrow -6.2% +2.2% -8.2% +10.0% ➖ noise
8 datafusion:vortex-compact +10.8% +2.2% +8.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.9% +2.2% -1.3% +10.0% ➖ noise
8 duckdb:duckdb +9.8% +2.2% +7.4% +10.0% ➖ noise
8 duckdb:vortex-compact +24.3% +2.2% +21.6% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +19.7% +2.2% +17.1% +10.0% 🚨 regression
9 datafusion:arrow -3.1% +1.6% -4.7% +10.0% ➖ noise
9 datafusion:vortex-compact +13.8% +1.6% +12.0% +10.0% 🚨 regression
9 datafusion:vortex-file-compressed -1.6% +1.6% -3.1% +10.0% ➖ noise
9 duckdb:duckdb +10.7% +1.6% +8.9% +10.0% ➖ noise
9 duckdb:vortex-compact +16.6% +1.6% +14.8% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed +13.6% +1.6% +11.8% +10.0% 🚨 regression
10 datafusion:arrow -2.4% -1.5% -0.9% +10.0% ➖ noise
10 datafusion:vortex-compact +14.1% -1.5% +15.8% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +4.1% -1.5% +5.7% +10.0% ➖ noise
10 duckdb:duckdb +9.9% -1.5% +11.5% +10.0% 🚨 regression
10 duckdb:vortex-compact +17.6% -1.5% +19.4% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +17.1% -1.5% +18.9% +10.0% 🚨 regression
11 datafusion:arrow -4.2% -3.1% -1.2% +12.4% ➖ noise
11 datafusion:vortex-compact +12.5% -3.1% +16.0% +12.4% 🚨 regression
11 datafusion:vortex-file-compressed +13.0% -3.1% +16.6% +12.8% 🚨 regression
11 duckdb:duckdb +15.7% -3.1% +19.3% +19.1% 🚨 regression
11 duckdb:vortex-compact +18.0% -3.1% +21.7% +15.5% 🚨 regression
11 duckdb:vortex-file-compressed +13.3% -3.1% +16.8% +15.6% 🚨 regression
12 datafusion:arrow -0.8% -2.1% +1.3% +54.7% ➖ noise
12 datafusion:vortex-compact +8.5% -2.1% +10.8% +10.0% 🚨 regression
12 datafusion:vortex-file-compressed +2.4% -2.1% +4.5% +10.0% ➖ noise
12 duckdb:duckdb +8.2% -2.1% +10.5% +10.0% 🚨 regression
12 duckdb:vortex-compact +15.1% -2.1% +17.6% +10.0% 🚨 regression
12 duckdb:vortex-file-compressed +11.8% -2.1% +14.2% +10.0% 🚨 regression
13 datafusion:arrow -5.1% -3.5% -1.7% +10.0% ➖ noise
13 datafusion:vortex-compact +7.1% -3.5% +10.9% +10.0% 🚨 regression
13 datafusion:vortex-file-compressed -1.9% -3.5% +1.7% +10.0% ➖ noise
13 duckdb:duckdb +10.6% -3.5% +14.6% +10.0% 🚨 regression
13 duckdb:vortex-compact +13.4% -3.5% +17.4% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +12.8% -3.5% +16.8% +10.0% 🚨 regression
14 datafusion:arrow -5.4% +0.6% -6.0% +10.0% ➖ noise
14 datafusion:vortex-compact +8.6% +0.6% +7.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.2% +0.6% -2.8% +12.7% ➖ noise
14 duckdb:duckdb +7.8% +0.6% +7.1% +10.0% ➖ noise
14 duckdb:vortex-compact +12.8% +0.6% +12.1% +10.0% 🚨 regression
14 duckdb:vortex-file-compressed +17.8% +0.6% +17.1% +10.0% 🚨 regression
15 datafusion:arrow -6.1% +2.2% -8.1% +10.0% ➖ noise
15 datafusion:vortex-compact +14.0% +2.2% +11.5% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed -3.4% +2.2% -5.5% +10.0% ➖ noise
15 duckdb:duckdb +6.5% +2.2% +4.2% +10.0% ➖ noise
15 duckdb:vortex-compact +12.1% +2.2% +9.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +16.1% +2.2% +13.6% +10.0% 🚨 regression
16 datafusion:arrow -1.8% -1.0% -0.7% +10.3% ➖ noise
16 datafusion:vortex-compact +12.7% -1.0% +13.9% +10.4% 🚨 regression
16 datafusion:vortex-file-compressed -0.5% -1.0% +0.5% +10.0% ➖ noise
16 duckdb:duckdb +12.0% -1.0% +13.2% +10.0% 🚨 regression
16 duckdb:vortex-compact +10.8% -1.0% +12.0% +11.1% 🚨 regression
16 duckdb:vortex-file-compressed +9.6% -1.0% +10.8% +10.5% 🚨 regression
17 datafusion:arrow -2.9% -0.1% -2.8% +10.0% ➖ noise
17 datafusion:vortex-compact +17.6% -0.1% +17.7% +10.0% 🚨 regression
17 datafusion:vortex-file-compressed +0.1% -0.1% +0.2% +10.0% ➖ noise
17 duckdb:duckdb +8.7% -0.1% +8.8% +10.1% ➖ noise
17 duckdb:vortex-compact +17.3% -0.1% +17.4% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +15.1% -0.1% +15.2% +10.0% 🚨 regression
18 datafusion:arrow -5.0% -1.2% -3.8% +10.0% ➖ noise
18 datafusion:vortex-compact +17.0% -1.2% +18.5% +10.0% 🚨 regression
18 datafusion:vortex-file-compressed +1.5% -1.2% +2.7% +10.0% ➖ noise
18 duckdb:duckdb +10.7% -1.2% +12.1% +10.0% 🚨 regression
18 duckdb:vortex-compact +15.0% -1.2% +16.4% +10.0% 🚨 regression
18 duckdb:vortex-file-compressed +15.1% -1.2% +16.5% +10.0% 🚨 regression
19 datafusion:arrow -2.3% +3.9% -5.9% +10.0% ➖ noise
19 datafusion:vortex-compact +7.5% +3.9% +3.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.8% +3.9% -4.5% +10.0% ➖ noise
19 duckdb:duckdb +7.8% +3.9% +3.8% +10.0% ➖ noise
19 duckdb:vortex-compact +8.4% +3.9% +4.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +10.7% +3.9% +6.6% +10.0% ➖ noise
20 datafusion:arrow -1.6% +2.0% -3.5% +10.0% ➖ noise
20 datafusion:vortex-compact +14.0% +2.0% +11.8% +10.0% 🚨 regression
20 datafusion:vortex-file-compressed +10.4% +2.0% +8.2% +10.0% ➖ noise
20 duckdb:duckdb +6.8% +2.0% +4.7% +10.0% ➖ noise
20 duckdb:vortex-compact +13.2% +2.0% +11.0% +10.0% 🚨 regression
20 duckdb:vortex-file-compressed +8.7% +2.0% +6.5% +10.0% ➖ noise
21 datafusion:arrow -4.9% +4.9% -9.3% +10.0% ✅ faster
21 datafusion:vortex-compact +11.0% +4.9% +5.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +18.4% +4.9% +12.9% +10.0% 🚨 regression
21 duckdb:duckdb +9.1% +4.9% +4.0% +10.0% ➖ noise
21 duckdb:vortex-compact +13.4% +4.9% +8.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +10.6% +4.9% +5.4% +10.0% ➖ noise
22 datafusion:arrow -4.6% +2.4% -6.8% +10.0% ➖ noise
22 datafusion:vortex-compact +8.6% +2.4% +6.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +15.0% +2.4% +12.3% +10.0% 🚨 regression
22 duckdb:duckdb +8.9% +2.4% +6.4% +13.9% ➖ noise
22 duckdb:vortex-compact +10.3% +2.4% +7.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +4.0% +2.4% +1.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -6.9%
Vortex (geomean): 0.915x ➖
Parquet (geomean): 0.983x ➖
Shifts: Parquet (control) -1.7% · Median polish -2.6%


duckdb / vortex-file-compressed (0.938x ➖, 1↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10931632 11274656 0.97
statpopgen_q01/duckdb:vortex-file-compressed 🚀 19096391 27947430 0.68
statpopgen_q02/duckdb:vortex-file-compressed 1297576736 1341013794 0.97
statpopgen_q03/duckdb:vortex-file-compressed 3078168030 3115847793 0.99
statpopgen_q04/duckdb:vortex-file-compressed 3131883253 3158402386 0.99
statpopgen_q05/duckdb:vortex-file-compressed 1404513556 1444882844 0.97
statpopgen_q06/duckdb:vortex-file-compressed 2068421658 2111454729 0.98
statpopgen_q07/duckdb:vortex-file-compressed 218217563 233617955 0.93
statpopgen_q08/duckdb:vortex-file-compressed 237651251 240459530 0.99
statpopgen_q09/duckdb:vortex-file-compressed 2873840775 3025086931 0.95
statpopgen_q10/duckdb:vortex-file-compressed 4572136515 4853293979 0.94
duckdb / vortex-compact (0.893x ✅, 1↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10701202 11315662 0.95
statpopgen_q01/duckdb:vortex-compact 🚀 71448799 171929414 0.42
statpopgen_q02/duckdb:vortex-compact 1800358116 1855980153 0.97
statpopgen_q03/duckdb:vortex-compact 3483398766 3585762317 0.97
statpopgen_q04/duckdb:vortex-compact 3532588407 3656451435 0.97
statpopgen_q05/duckdb:vortex-compact 1851589217 1896499978 0.98
statpopgen_q06/duckdb:vortex-compact 2650352646 2730473643 0.97
statpopgen_q07/duckdb:vortex-compact 907994335 943806885 0.96
statpopgen_q08/duckdb:vortex-compact 943394431 979167196 0.96
statpopgen_q09/duckdb:vortex-compact 3317782907 3508237135 0.95
statpopgen_q10/duckdb:vortex-compact 5379450252 5561526951 0.97
duckdb / parquet (0.983x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 315698674 324714908 0.97
statpopgen_q01/duckdb:parquet 403806536 411359962 0.98
statpopgen_q02/duckdb:parquet 1010004079 997784105 1.01
statpopgen_q03/duckdb:parquet 1514770764 1539424061 0.98
statpopgen_q04/duckdb:parquet 1517781196 1553925733 0.98
statpopgen_q05/duckdb:parquet 1017636486 1014977504 1.00
statpopgen_q06/duckdb:parquet 1480177012 1518828606 0.97
statpopgen_q07/duckdb:parquet 1880549528 1941973861 0.97
statpopgen_q08/duckdb:parquet 1901574552 1936131751 0.98
statpopgen_q09/duckdb:parquet 1386424391 1393507137 0.99
statpopgen_q10/duckdb:parquet 2662864943 2763496683 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -5.4% -2.8% -2.7% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -3.0% -2.8% -0.3% +10.0% ➖ noise
1 duckdb:vortex-compact -58.4% -1.8% -57.7% +72.7% ✅ faster
1 duckdb:vortex-file-compressed -31.7% -1.8% -30.4% +202.5% ➖ noise
2 duckdb:vortex-compact -3.0% +1.2% -4.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -3.2% +1.2% -4.4% +10.0% ➖ noise
3 duckdb:vortex-compact -2.9% -1.6% -1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.2% -1.6% +0.4% +10.0% ➖ noise
4 duckdb:vortex-compact -3.4% -2.3% -1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.8% -2.3% +1.5% +10.0% ➖ noise
5 duckdb:vortex-compact -2.4% +0.3% -2.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.8% +0.3% -3.0% +10.0% ➖ noise
6 duckdb:vortex-compact -2.9% -2.5% -0.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.0% -2.5% +0.5% +10.0% ➖ noise
7 duckdb:vortex-compact -3.8% -3.2% -0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -6.6% -3.2% -3.5% +10.0% ➖ noise
8 duckdb:vortex-compact -3.7% -1.8% -1.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.2% -1.8% +0.6% +10.0% ➖ noise
9 duckdb:vortex-compact -5.4% -0.5% -4.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -5.0% -0.5% -4.5% +10.0% ➖ noise
10 duckdb:vortex-compact -3.3% -3.6% +0.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -5.8% -3.6% -2.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.5%


datafusion / vortex-file-compressed (1.013x ➖, 0↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1911261 1882746 1.02
clickbench_q01/datafusion:vortex-file-compressed 🚨 19132756 13772947 1.39
clickbench_q02/datafusion:vortex-file-compressed 35435886 34575246 1.02
clickbench_q03/datafusion:vortex-file-compressed 38081527 38160445 1.00
clickbench_q04/datafusion:vortex-file-compressed 304610681 302609952 1.01
clickbench_q05/datafusion:vortex-file-compressed 314540084 310212428 1.01
clickbench_q06/datafusion:vortex-file-compressed 1864443 1881583 0.99
clickbench_q07/datafusion:vortex-file-compressed 17146406 18052888 0.95
clickbench_q08/datafusion:vortex-file-compressed 384091506 380923525 1.01
clickbench_q09/datafusion:vortex-file-compressed 552646212 551890876 1.00
clickbench_q10/datafusion:vortex-file-compressed 70393097 71853024 0.98
clickbench_q11/datafusion:vortex-file-compressed 83862607 79847366 1.05
clickbench_q12/datafusion:vortex-file-compressed 271736557 270890647 1.00
clickbench_q13/datafusion:vortex-file-compressed 402454406 402448716 1.00
clickbench_q14/datafusion:vortex-file-compressed 255981251 251604747 1.02
clickbench_q15/datafusion:vortex-file-compressed 355889627 358684748 0.99
clickbench_q16/datafusion:vortex-file-compressed 688872912 689877723 1.00
clickbench_q17/datafusion:vortex-file-compressed 689555166 684719571 1.01
clickbench_q18/datafusion:vortex-file-compressed 1391661233 1327578667 1.05
clickbench_q19/datafusion:vortex-file-compressed 22694335 23882271 0.95
clickbench_q20/datafusion:vortex-file-compressed 355420270 355261092 1.00
clickbench_q21/datafusion:vortex-file-compressed 405089771 399124590 1.01
clickbench_q22/datafusion:vortex-file-compressed 483989989 480759449 1.01
clickbench_q23/datafusion:vortex-file-compressed 698138808 670651295 1.04
clickbench_q24/datafusion:vortex-file-compressed 45329052 45376544 1.00
clickbench_q25/datafusion:vortex-file-compressed 68428156 71652449 0.96
clickbench_q26/datafusion:vortex-file-compressed 47391261 46851433 1.01
clickbench_q27/datafusion:vortex-file-compressed 793713754 801332616 0.99
clickbench_q28/datafusion:vortex-file-compressed 6661522585 6906346871 0.96
clickbench_q29/datafusion:vortex-file-compressed 252514324 239420531 1.05
clickbench_q30/datafusion:vortex-file-compressed 223581429 224506320 1.00
clickbench_q31/datafusion:vortex-file-compressed 268570539 263948895 1.02
clickbench_q32/datafusion:vortex-file-compressed 1225300800 1131841649 1.08
clickbench_q33/datafusion:vortex-file-compressed 1411749776 1383238194 1.02
clickbench_q34/datafusion:vortex-file-compressed 1415595016 1376242384 1.03
clickbench_q35/datafusion:vortex-file-compressed 516638318 504646516 1.02
clickbench_q36/datafusion:vortex-file-compressed 77164968 80463384 0.96
clickbench_q37/datafusion:vortex-file-compressed 38611556 39977674 0.97
clickbench_q38/datafusion:vortex-file-compressed 22538661 22663764 0.99
clickbench_q39/datafusion:vortex-file-compressed 149653127 145481316 1.03
clickbench_q40/datafusion:vortex-file-compressed 18750001 17312691 1.08
clickbench_q41/datafusion:vortex-file-compressed 16418268 17606521 0.93
clickbench_q42/datafusion:vortex-file-compressed 18225673 17889036 1.02
datafusion / parquet (1.005x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1792828 1772198 1.01
clickbench_q01/datafusion:parquet 20784110 19706107 1.05
clickbench_q02/datafusion:parquet 54594789 55350651 0.99
clickbench_q03/datafusion:parquet 43141677 43395991 0.99
clickbench_q04/datafusion:parquet 322709774 340613409 0.95
clickbench_q05/datafusion:parquet 367143531 373202188 0.98
clickbench_q06/datafusion:parquet 1754436 1725579 1.02
clickbench_q07/datafusion:parquet 24660129 25924556 0.95
clickbench_q08/datafusion:parquet 406447096 402491717 1.01
clickbench_q09/datafusion:parquet 637182086 631017531 1.01
clickbench_q10/datafusion:parquet 110763102 108308008 1.02
clickbench_q11/datafusion:parquet 135615686 135247110 1.00
clickbench_q12/datafusion:parquet 355987508 354960083 1.00
clickbench_q13/datafusion:parquet 502346727 502253484 1.00
clickbench_q14/datafusion:parquet 356881690 355315161 1.00
clickbench_q15/datafusion:parquet 372472244 372218926 1.00
clickbench_q16/datafusion:parquet 726450789 680921744 1.07
clickbench_q17/datafusion:parquet 686718294 671720226 1.02
clickbench_q18/datafusion:parquet 1389654323 1410776691 0.99
clickbench_q19/datafusion:parquet 32883501 33193691 0.99
clickbench_q20/datafusion:parquet 595927510 594348195 1.00
clickbench_q21/datafusion:parquet 669035625 644940311 1.04
clickbench_q22/datafusion:parquet 933833151 951063506 0.98
clickbench_q23/datafusion:parquet 3611875271 3547511373 1.02
clickbench_q24/datafusion:parquet 86085266 87977393 0.98
clickbench_q25/datafusion:parquet 136216965 137690318 0.99
clickbench_q26/datafusion:parquet 85070568 84409008 1.01
clickbench_q27/datafusion:parquet 1038075431 1027824292 1.01
clickbench_q28/datafusion:parquet 6701846310 6313511948 1.06
clickbench_q29/datafusion:parquet 248579366 247075554 1.01
clickbench_q30/datafusion:parquet 362935163 355111329 1.02
clickbench_q31/datafusion:parquet 391583164 386563394 1.01
clickbench_q32/datafusion:parquet 1176244801 1255166795 0.94
clickbench_q33/datafusion:parquet 1510619274 1508080005 1.00
clickbench_q34/datafusion:parquet 1513024355 1518014309 1.00
clickbench_q35/datafusion:parquet 527726119 523732002 1.01
clickbench_q36/datafusion:parquet 142238800 142180180 1.00
clickbench_q37/datafusion:parquet 61943707 60216655 1.03
clickbench_q38/datafusion:parquet 92198812 89780727 1.03
clickbench_q39/datafusion:parquet 276391519 267488266 1.03
clickbench_q40/datafusion:parquet 33181299 35285033 0.94
clickbench_q41/datafusion:parquet 31762109 29705026 1.07
clickbench_q42/datafusion:parquet 31251166 31320047 1.00
duckdb / vortex-file-compressed (0.991x ➖, 1↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5903492 6026359 0.98
clickbench_q01/duckdb:vortex-file-compressed 13525928 14446733 0.94
clickbench_q02/duckdb:vortex-file-compressed 26099323 25651808 1.02
clickbench_q03/duckdb:vortex-file-compressed 29016570 29335706 0.99
clickbench_q04/duckdb:vortex-file-compressed 181855823 182284305 1.00
clickbench_q05/duckdb:vortex-file-compressed 198701355 194381309 1.02
clickbench_q06/duckdb:vortex-file-compressed 18461905 17501823 1.05
clickbench_q07/duckdb:vortex-file-compressed 14821302 15455836 0.96
clickbench_q08/duckdb:vortex-file-compressed 267246921 264954879 1.01
clickbench_q09/duckdb:vortex-file-compressed 352939567 344729609 1.02
clickbench_q10/duckdb:vortex-file-compressed 72584114 70877479 1.02
clickbench_q11/duckdb:vortex-file-compressed 82757715 80002803 1.03
clickbench_q12/duckdb:vortex-file-compressed 222046656 219157862 1.01
clickbench_q13/duckdb:vortex-file-compressed 434623561 428949685 1.01
clickbench_q14/duckdb:vortex-file-compressed 248503083 239105446 1.04
clickbench_q15/duckdb:vortex-file-compressed 219358846 219557674 1.00
clickbench_q16/duckdb:vortex-file-compressed 714515105 727363891 0.98
clickbench_q17/duckdb:vortex-file-compressed 547130849 605331912 0.90
clickbench_q18/duckdb:vortex-file-compressed 1175248062 1231305870 0.95
clickbench_q19/duckdb:vortex-file-compressed 20618513 21279678 0.97
clickbench_q20/duckdb:vortex-file-compressed 380333802 371840205 1.02
clickbench_q21/duckdb:vortex-file-compressed 409415421 402468197 1.02
clickbench_q22/duckdb:vortex-file-compressed 536786910 549557406 0.98
clickbench_q23/duckdb:vortex-file-compressed 🚀 1143007263 1704839924 0.67
clickbench_q24/duckdb:vortex-file-compressed 🚨 51807780 45156885 1.15
clickbench_q25/duckdb:vortex-file-compressed 73020201 77017747 0.95
clickbench_q26/duckdb:vortex-file-compressed 46954069 43947699 1.07
clickbench_q27/duckdb:vortex-file-compressed 494703128 492254340 1.00
clickbench_q28/duckdb:vortex-file-compressed 2992609098 2991049406 1.00
clickbench_q29/duckdb:vortex-file-compressed 29577916 29098389 1.02
clickbench_q30/duckdb:vortex-file-compressed 179881040 181039155 0.99
clickbench_q31/duckdb:vortex-file-compressed 260675552 259778429 1.00
clickbench_q32/duckdb:vortex-file-compressed 1430904741 1424997385 1.00
clickbench_q33/duckdb:vortex-file-compressed 1602795991 1466072435 1.09
clickbench_q34/duckdb:vortex-file-compressed 1630362399 1564192413 1.04
clickbench_q35/duckdb:vortex-file-compressed 371280017 376175317 0.99
clickbench_q36/duckdb:vortex-file-compressed 29752300 30862761 0.96
clickbench_q37/duckdb:vortex-file-compressed 22072859 22974094 0.96
clickbench_q38/duckdb:vortex-file-compressed 23158362 23926756 0.97
clickbench_q39/duckdb:vortex-file-compressed 44495952 44176128 1.01
clickbench_q40/duckdb:vortex-file-compressed 21723584 22670911 0.96
clickbench_q41/duckdb:vortex-file-compressed 20992144 22420163 0.94
clickbench_q42/duckdb:vortex-file-compressed 23536802 23243026 1.01
duckdb / parquet (1.004x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 223566846 216068014 1.03
clickbench_q01/duckdb:parquet 49776941 51764274 0.96
clickbench_q02/duckdb:parquet 65536667 65849787 1.00
clickbench_q03/duckdb:parquet 63469217 64053861 0.99
clickbench_q04/duckdb:parquet 206088440 204278932 1.01
clickbench_q05/duckdb:parquet 282438937 274677782 1.03
clickbench_q06/duckdb:parquet 59586210 60113627 0.99
clickbench_q07/duckdb:parquet 53156500 51176226 1.04
clickbench_q08/duckdb:parquet 268477425 269950105 0.99
clickbench_q09/duckdb:parquet 395779094 395189050 1.00
clickbench_q10/duckdb:parquet 97497122 94491694 1.03
clickbench_q11/duckdb:parquet 106974966 106974341 1.00
clickbench_q12/duckdb:parquet 294925892 296627745 0.99
clickbench_q13/duckdb:parquet 512384690 508830626 1.01
clickbench_q14/duckdb:parquet 328198008 331633418 0.99
clickbench_q15/duckdb:parquet 243204739 241225446 1.01
clickbench_q16/duckdb:parquet 613715859 612611139 1.00
clickbench_q17/duckdb:parquet 507264020 505058895 1.00
clickbench_q18/duckdb:parquet 1048296973 1039349649 1.01
clickbench_q19/duckdb:parquet 49287143 49441135 1.00
clickbench_q20/duckdb:parquet 430517382 434575780 0.99
clickbench_q21/duckdb:parquet 558231753 561099105 0.99
clickbench_q22/duckdb:parquet 935782960 922764707 1.01
clickbench_q23/duckdb:parquet 320017675 310077822 1.03
clickbench_q24/duckdb:parquet 78483831 79265530 0.99
clickbench_q25/duckdb:parquet 141317942 140905557 1.00
clickbench_q26/duckdb:parquet 52517488 54215432 0.97
clickbench_q27/duckdb:parquet 643439700 643802958 1.00
clickbench_q28/duckdb:parquet 4858831868 4830511117 1.01
clickbench_q29/duckdb:parquet 61645640 60260078 1.02
clickbench_q30/duckdb:parquet 308815775 307236427 1.01
clickbench_q31/duckdb:parquet 349631194 346375862 1.01
clickbench_q32/duckdb:parquet 1165061370 1125139058 1.04
clickbench_q33/duckdb:parquet 1247156055 1231962992 1.01
clickbench_q34/duckdb:parquet 1267939039 1267203134 1.00
clickbench_q35/duckdb:parquet 355061514 353537811 1.00
clickbench_q36/duckdb:parquet 64396828 63512654 1.01
clickbench_q37/duckdb:parquet 54427140 53465425 1.02
clickbench_q38/duckdb:parquet 59121524 59510417 0.99
clickbench_q39/duckdb:parquet 98012722 102109510 0.96
clickbench_q40/duckdb:parquet 56736740 55427868 1.02
clickbench_q41/duckdb:parquet 59279826 58264136 1.02
clickbench_q42/duckdb:parquet 50161120 51896917 0.97
duckdb / duckdb (1.032x ➖, 0↑ 6↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 20818274 17280170 1.20
clickbench_q01/duckdb:duckdb 🚨 36231529 32465230 1.12
clickbench_q02/duckdb:duckdb 48238347 46008318 1.05
clickbench_q03/duckdb:duckdb 50007517 46925746 1.07
clickbench_q04/duckdb:duckdb 224929367 226718261 0.99
clickbench_q05/duckdb:duckdb 322213212 336287071 0.96
clickbench_q06/duckdb:duckdb 🚨 38203682 28189538 1.36
clickbench_q07/duckdb:duckdb 🚨 38654239 34957758 1.11
clickbench_q08/duckdb:duckdb 308662490 325409243 0.95
clickbench_q09/duckdb:duckdb 461023542 498161815 0.93
clickbench_q10/duckdb:duckdb 99169273 97072035 1.02
clickbench_q11/duckdb:duckdb 109100170 106516763 1.02
clickbench_q12/duckdb:duckdb 291289799 309903730 0.94
clickbench_q13/duckdb:duckdb 533696088 553186159 0.96
clickbench_q14/duckdb:duckdb 348292895 365139474 0.95
clickbench_q15/duckdb:duckdb 258187136 267037783 0.97
clickbench_q16/duckdb:duckdb 688469442 703085196 0.98
clickbench_q17/duckdb:duckdb 582433520 591539641 0.98
clickbench_q18/duckdb:duckdb 1259499238 1276238846 0.99
clickbench_q19/duckdb:duckdb 37635457 34285939 1.10
clickbench_q20/duckdb:duckdb 919628463 1003751038 0.92
clickbench_q21/duckdb:duckdb 984701132 975737126 1.01
clickbench_q22/duckdb:duckdb 1153656898 1099437068 1.05
clickbench_q23/duckdb:duckdb 254354536 254138145 1.00
clickbench_q24/duckdb:duckdb 63537509 60199133 1.06
clickbench_q25/duckdb:duckdb 126993108 122702746 1.03
clickbench_q26/duckdb:duckdb 59441588 55897524 1.06
clickbench_q27/duckdb:duckdb 1003819461 1029642536 0.97
clickbench_q28/duckdb:duckdb 4649534106 4633216577 1.00
clickbench_q29/duckdb:duckdb 51950137 48945038 1.06
clickbench_q30/duckdb:duckdb 286437062 283633262 1.01
clickbench_q31/duckdb:duckdb 399252305 405936840 0.98
clickbench_q32/duckdb:duckdb 1429561918 1468544349 0.97
clickbench_q33/duckdb:duckdb 2025742790 1895587365 1.07
clickbench_q34/duckdb:duckdb 🚨 2181765040 1974968228 1.10
clickbench_q35/duckdb:duckdb 265995467 265117087 1.00
clickbench_q36/duckdb:duckdb 🚨 41630895 37399655 1.11
clickbench_q37/duckdb:duckdb 34276524 31325482 1.09
clickbench_q38/duckdb:duckdb 33048357 30803826 1.07
clickbench_q39/duckdb:duckdb 62997918 63788846 0.99
clickbench_q40/duckdb:duckdb 34270912 31563590 1.09
clickbench_q41/duckdb:duckdb 32857259 29909628 1.10
clickbench_q42/duckdb:duckdb 34228325 31412172 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +1.5% +2.3% -0.8% +558.9% ➖ noise
0 duckdb:duckdb +20.5% +2.3% +17.8% +258.6% ➖ noise
0 duckdb:vortex-file-compressed -2.0% +2.3% -4.3% +300.0% ➖ noise
1 datafusion:vortex-file-compressed +38.9% +0.7% +37.9% +59.4% ➖ noise
1 duckdb:duckdb +11.6% +0.7% +10.8% +65.2% ➖ noise
1 duckdb:vortex-file-compressed -6.4% +0.7% -7.0% +14.5% ➖ noise
2 datafusion:vortex-file-compressed +2.5% -0.9% +3.4% +103.6% ➖ noise
2 duckdb:duckdb +4.8% -0.9% +5.8% +25.2% ➖ noise
2 duckdb:vortex-file-compressed +1.7% -0.9% +2.7% +15.0% ➖ noise
3 datafusion:vortex-file-compressed -0.2% -0.7% +0.5% +168.5% ➖ noise
3 duckdb:duckdb +6.6% -0.7% +7.4% +57.3% ➖ noise
3 duckdb:vortex-file-compressed -1.1% -0.7% -0.3% +29.5% ➖ noise
4 datafusion:vortex-file-compressed +0.7% -2.2% +3.0% +10.0% ➖ noise
4 duckdb:duckdb -0.8% -2.2% +1.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% -2.2% +2.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.4% +0.6% +0.8% +10.8% ➖ noise
5 duckdb:duckdb -4.2% +0.6% -4.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.2% +0.6% +1.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.9% +0.4% -1.3% +41.4% ➖ noise
6 duckdb:duckdb +35.5% +0.4% +35.0% +29.8% 🚨 regression
6 duckdb:vortex-file-compressed +5.5% +0.4% +5.1% +18.4% ➖ noise
7 datafusion:vortex-file-compressed -5.0% -0.6% -4.4% +10.9% ➖ noise
7 duckdb:duckdb +10.6% -0.6% +11.2% +11.5% ➖ noise
7 duckdb:vortex-file-compressed -4.1% -0.6% -3.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.8% +0.2% +0.6% +10.0% ➖ noise
8 duckdb:duckdb -5.1% +0.2% -5.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.9% +0.2% +0.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.1% +0.6% -0.4% +10.0% ➖ noise
9 duckdb:duckdb -7.5% +0.6% -8.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.4% +0.6% +1.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.0% +2.7% -4.6% +10.0% ➖ noise
10 duckdb:duckdb +2.2% +2.7% -0.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.4% +2.7% -0.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +5.0% +0.1% +4.9% +10.0% ➖ noise
11 duckdb:duckdb +2.4% +0.1% +2.3% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +3.4% +0.1% +3.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.3% -0.1% +0.5% +10.0% ➖ noise
12 duckdb:duckdb -6.0% -0.1% -5.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.3% -0.1% +1.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.0% +0.4% -0.4% +10.0% ➖ noise
13 duckdb:duckdb -3.5% +0.4% -3.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.3% +0.4% +1.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.7% -0.3% +2.0% +10.0% ➖ noise
14 duckdb:duckdb -4.6% -0.3% -4.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +3.9% -0.3% +4.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.8% +0.4% -1.2% +10.0% ➖ noise
15 duckdb:duckdb -3.3% +0.4% -3.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.1% +0.4% -0.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.1% +3.4% -3.4% +10.0% ➖ noise
16 duckdb:duckdb -2.1% +3.4% -5.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.8% +3.4% -5.0% +13.9% ➖ noise
17 datafusion:vortex-file-compressed +0.7% +1.3% -0.6% +10.0% ➖ noise
17 duckdb:duckdb -1.5% +1.3% -2.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -9.6% +1.3% -10.8% +11.2% ✅ faster
18 datafusion:vortex-file-compressed +4.8% -0.3% +5.2% +10.0% ➖ noise
18 duckdb:duckdb -1.3% -0.3% -1.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.6% -0.3% -4.2% +12.8% ➖ noise
19 datafusion:vortex-file-compressed -5.0% -0.6% -4.4% +13.2% ➖ noise
19 duckdb:duckdb +9.8% -0.6% +10.5% +10.8% ➖ noise
19 duckdb:vortex-file-compressed -3.1% -0.6% -2.5% +31.3% ➖ noise
20 datafusion:vortex-file-compressed +0.0% -0.3% +0.4% +196.0% ➖ noise
20 duckdb:duckdb -8.4% -0.3% -8.1% +27.4% ➖ noise
20 duckdb:vortex-file-compressed +2.3% -0.3% +2.6% +11.1% ➖ noise
21 datafusion:vortex-file-compressed +1.5% +1.6% -0.1% +10.0% ➖ noise
21 duckdb:duckdb +0.9% +1.6% -0.7% +12.6% ➖ noise
21 duckdb:vortex-file-compressed +1.7% +1.6% +0.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.7% -0.2% +0.9% +11.5% ➖ noise
22 duckdb:duckdb +4.9% -0.2% +5.2% +14.4% ➖ noise
22 duckdb:vortex-file-compressed -2.3% -0.2% -2.1% +17.0% ➖ noise
23 datafusion:vortex-file-compressed +4.1% +2.5% +1.6% +45.1% ➖ noise
23 duckdb:duckdb +0.1% +2.5% -2.4% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -33.0% +2.5% -34.6% +10.0% ✅ faster
24 datafusion:vortex-file-compressed -0.1% -1.6% +1.5% +17.6% ➖ noise
24 duckdb:duckdb +5.5% -1.6% +7.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +14.7% -1.6% +16.6% +28.0% ➖ noise
25 datafusion:vortex-file-compressed -4.5% -0.4% -4.1% +10.0% ➖ noise
25 duckdb:duckdb +3.5% -0.4% +3.9% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -5.2% -0.4% -4.8% +17.8% ➖ noise
26 datafusion:vortex-file-compressed +1.2% -1.2% +2.4% +22.9% ➖ noise
26 duckdb:duckdb +6.3% -1.2% +7.6% +17.0% ➖ noise
26 duckdb:vortex-file-compressed +6.8% -1.2% +8.1% +42.1% ➖ noise
27 datafusion:vortex-file-compressed -1.0% +0.5% -1.4% +10.0% ➖ noise
27 duckdb:duckdb -2.5% +0.5% -3.0% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +0.5% +0.5% +0.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -3.5% +3.3% -6.7% +10.0% ➖ noise
28 duckdb:duckdb +0.4% +3.3% -2.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.1% +3.3% -3.2% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +5.5% +1.5% +4.0% +10.0% ➖ noise
29 duckdb:duckdb +6.1% +1.5% +4.6% +11.5% ➖ noise
29 duckdb:vortex-file-compressed +1.6% +1.5% +0.2% +11.3% ➖ noise
30 datafusion:vortex-file-compressed -0.4% +1.4% -1.7% +10.0% ➖ noise
30 duckdb:duckdb +1.0% +1.4% -0.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.6% +1.4% -2.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +1.8% +1.1% +0.6% +10.0% ➖ noise
31 duckdb:duckdb -1.6% +1.1% -2.7% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.3% +1.1% -0.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +8.3% -1.5% +9.9% +15.0% ➖ noise
32 duckdb:duckdb -2.7% -1.5% -1.2% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +0.4% -1.5% +1.9% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +2.1% +0.7% +1.4% +16.9% ➖ noise
33 duckdb:duckdb +6.9% +0.7% +6.1% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +9.3% +0.7% +8.6% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +2.9% -0.1% +3.0% +10.0% ➖ noise
34 duckdb:duckdb +10.5% -0.1% +10.6% +10.0% 🚨 regression
34 duckdb:vortex-file-compressed +4.2% -0.1% +4.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.4% +0.6% +1.8% +10.0% ➖ noise
35 duckdb:duckdb +0.3% +0.6% -0.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.3% +0.6% -1.9% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -4.1% +0.7% -4.8% +10.0% ➖ noise
36 duckdb:duckdb +11.3% +0.7% +10.5% +10.0% 🚨 regression
36 duckdb:vortex-file-compressed -3.6% +0.7% -4.3% +10.6% ➖ noise
37 datafusion:vortex-file-compressed -3.4% +2.3% -5.6% +10.0% ➖ noise
37 duckdb:duckdb +9.4% +2.3% +6.9% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -3.9% +2.3% -6.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -0.6% +1.0% -1.5% +12.0% ➖ noise
38 duckdb:duckdb +7.3% +1.0% +6.2% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -3.2% +1.0% -4.2% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +2.9% -0.4% +3.3% +10.0% ➖ noise
39 duckdb:duckdb -1.2% -0.4% -0.8% +22.7% ➖ noise
39 duckdb:vortex-file-compressed +0.7% -0.4% +1.1% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +8.3% -1.9% +10.4% +10.7% ➖ noise
40 duckdb:duckdb +8.6% -1.9% +10.7% +10.0% 🚨 regression
40 duckdb:vortex-file-compressed -4.2% -1.9% -2.3% +10.3% ➖ noise
41 datafusion:vortex-file-compressed -6.7% +4.3% -10.6% +10.7% ✅ faster
41 duckdb:duckdb +9.9% +4.3% +5.3% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -6.4% +4.3% -10.2% +10.0% ✅ faster
42 datafusion:vortex-file-compressed +1.9% -1.8% +3.7% +10.0% ➖ noise
42 duckdb:duckdb +9.0% -1.8% +11.0% +10.0% 🚨 regression
42 duckdb:vortex-file-compressed +1.3% -1.8% +3.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

File Sizes: Clickbench on NVME

File Size Changes (101 files changed, -33.3% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
hits_6.vortex 1.0 vortex-compact 62.94 MB 0 B 62.94 MB -100.0%
hits_64.vortex 1.0 vortex-compact 53.69 MB 0 B 53.69 MB -100.0%
hits_39.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.68 MB 0 B 75.68 MB -100.0%
hits_11.vortex 1.0 vortex-compact 54.10 MB 0 B 54.10 MB -100.0%
hits_52.vortex 1.0 vortex-compact 63.41 MB 0 B 63.41 MB -100.0%
hits_95.vortex 1.0 vortex-compact 57.43 MB 0 B 57.43 MB -100.0%
hits_41.vortex 1.0 vortex-compact 165.44 MB 0 B 165.44 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.72 MB 0 B 35.72 MB -100.0%
hits_97.vortex 1.0 vortex-compact 68.90 MB 0 B 68.90 MB -100.0%
hits_0.vortex 1.0 vortex-compact 58.38 MB 0 B 58.38 MB -100.0%
hits_72.vortex 1.0 vortex-compact 51.54 MB 0 B 51.54 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.04 MB 0 B 77.04 MB -100.0%
hits_37.vortex 1.0 vortex-compact 53.60 MB 0 B 53.60 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.03 MB 0 B 69.03 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.06 MB 0 B 61.06 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.51 MB 0 B 52.51 MB -100.0%
hits_10.vortex 1.0 vortex-compact 48.67 MB 0 B 48.67 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.07 MB 0 B 73.07 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.05 MB 0 B 129.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 163.89 MB 0 B 163.89 MB -100.0%
hits_96.vortex 1.0 vortex-compact 90.83 MB 0 B 90.83 MB -100.0%
hits_36.vortex 1.0 vortex-compact 48.68 MB 0 B 48.68 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.53 MB 0 B 97.53 MB -100.0%
hits_59.vortex 1.0 vortex-compact 65.96 MB 0 B 65.96 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_30.vortex 1.0 vortex-compact 58.49 MB 0 B 58.49 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.38 MB 0 B 36.38 MB -100.0%
hits_13.vortex 1.0 vortex-compact 67.72 MB 0 B 67.72 MB -100.0%
hits_25.vortex 1.0 vortex-compact 72.86 MB 0 B 72.86 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.53 MB 0 B 71.53 MB -100.0%
hits_98.vortex 1.0 vortex-compact 72.43 MB 0 B 72.43 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.28 MB 0 B 55.28 MB -100.0%
hits_73.vortex 1.0 vortex-compact 69.77 MB 0 B 69.77 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.03 MB 0 B 64.03 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.06 MB 0 B 18.06 MB -100.0%
hits_83.vortex 1.0 vortex-compact 52.30 MB 0 B 52.30 MB -100.0%
hits_9.vortex 1.0 vortex-compact 65.45 MB 0 B 65.45 MB -100.0%
hits_53.vortex 1.0 vortex-compact 58.85 MB 0 B 58.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 50.27 MB 0 B 50.27 MB -100.0%
hits_26.vortex 1.0 vortex-compact 70.61 MB 0 B 70.61 MB -100.0%
hits_16.vortex 1.0 vortex-compact 48.09 MB 0 B 48.09 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.31 MB 0 B 51.31 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.66 MB 0 B 69.66 MB -100.0%
hits_89.vortex 1.0 vortex-compact 112.44 MB 0 B 112.44 MB -100.0%
hits_40.vortex 1.0 vortex-compact 75.59 MB 0 B 75.59 MB -100.0%
hits_38.vortex 1.0 vortex-compact 62.85 MB 0 B 62.85 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.06 MB 0 B 64.06 MB -100.0%
hits_44.vortex 1.0 vortex-compact 132.13 MB 0 B 132.13 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.05 MB 0 B 44.05 MB -100.0%
hits_7.vortex 1.0 vortex-compact 63.58 MB 0 B 63.58 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.21 MB 0 B 65.21 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.73 MB 0 B 118.73 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.08 MB 0 B 58.08 MB -100.0%
hits_56.vortex 1.0 vortex-compact 77.69 MB 0 B 77.69 MB -100.0%
hits_3.vortex 1.0 vortex-compact 93.91 MB 0 B 93.91 MB -100.0%
hits_22.vortex 1.0 vortex-compact 44.47 MB 0 B 44.47 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.37 MB 0 B 71.37 MB -100.0%
hits_8.vortex 1.0 vortex-compact 62.67 MB 0 B 62.67 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.46 MB 0 B 129.46 MB -100.0%
hits_35.vortex 1.0 vortex-compact 74.79 MB 0 B 74.79 MB -100.0%
hits_77.vortex 1.0 vortex-compact 117.87 MB 0 B 117.87 MB -100.0%
hits_91.vortex 1.0 vortex-compact 60.68 MB 0 B 60.68 MB -100.0%
hits_14.vortex 1.0 vortex-compact 73.51 MB 0 B 73.51 MB -100.0%
hits_75.vortex 1.0 vortex-compact 43.42 MB 0 B 43.42 MB -100.0%
hits_82.vortex 1.0 vortex-compact 66.59 MB 0 B 66.59 MB -100.0%
hits_19.vortex 1.0 vortex-compact 44.54 MB 0 B 44.54 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.04 MB 0 B 69.04 MB -100.0%
hits_58.vortex 1.0 vortex-compact 60.19 MB 0 B 60.19 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.07 MB 0 B 90.07 MB -100.0%
hits_50.vortex 1.0 vortex-compact 112.74 MB 0 B 112.74 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.25 MB 0 B 117.25 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.00 MB 0 B 94.00 MB -100.0%
hits_93.vortex 1.0 vortex-compact 58.65 MB 0 B 58.65 MB -100.0%
hits_80.vortex 1.0 vortex-compact 67.82 MB 0 B 67.82 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.01 MB 0 B 58.01 MB -100.0%
hits_79.vortex 1.0 vortex-compact 85.36 MB 0 B 85.36 MB -100.0%
hits_84.vortex 1.0 vortex-compact 72.85 MB 0 B 72.85 MB -100.0%
hits_67.vortex 1.0 vortex-compact 113.69 MB 0 B 113.69 MB -100.0%
hits_63.vortex 1.0 vortex-compact 45.88 MB 0 B 45.88 MB -100.0%
hits_20.vortex 1.0 vortex-compact 37.88 MB 0 B 37.88 MB -100.0%
hits_43.vortex 1.0 vortex-compact 168.57 MB 0 B 168.57 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.74 MB 0 B 80.74 MB -100.0%
hits_55.vortex 1.0 vortex-compact 93.42 MB 0 B 93.42 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.02 MB 0 B 70.02 MB -100.0%
hits_24.vortex 1.0 vortex-compact 43.39 MB 0 B 43.39 MB -100.0%
hits_90.vortex 1.0 vortex-compact 81.59 MB 0 B 81.59 MB -100.0%
hits_62.vortex 1.0 vortex-compact 74.04 MB 0 B 74.04 MB -100.0%
hits_68.vortex 1.0 vortex-compact 75.68 MB 0 B 75.68 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.24 MB 0 B 53.24 MB -100.0%
hits_51.vortex 1.0 vortex-compact 167.28 MB 0 B 167.28 MB -100.0%
hits_76.vortex 1.0 vortex-compact 76.12 MB 0 B 76.12 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.30 MB 0 B 83.30 MB -100.0%
hits_15.vortex 1.0 vortex-compact 47.87 MB 0 B 47.87 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.36 MB 0 B 90.36 MB -100.0%
hits_23.vortex 1.0 vortex-compact 43.94 MB 0 B 43.94 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.12 MB 0 B 17.12 MB -100.0%
hits_86.vortex 1.0 vortex-compact 47.99 MB 0 B 47.99 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.40 MB 0 B 57.40 MB -100.0%
hits_46.vortex 1.0 vortex-compact 41.61 MB 0 B 41.61 MB -100.0%
hits_5.vortex 1.0 vortex-compact 62.68 MB 0 B 62.68 MB -100.0%

Totals:

  • vortex-compact: 7.03 GB → 0 B (-100.0%)
  • vortex-file-compressed: 14.08 GB → 14.08 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -7.0%
Vortex (geomean): 1.003x ➖
Parquet (geomean): 1.079x ➖
Shifts: Parquet (control) +7.9% · Median polish +4.0%


datafusion / vortex-file-compressed (0.977x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 31189082 33079396 0.94
fineweb_q01/datafusion:vortex-file-compressed 492125664 577249632 0.85
fineweb_q02/datafusion:vortex-file-compressed 551549917 588366914 0.94
fineweb_q03/datafusion:vortex-file-compressed 1442708157 1349324009 1.07
fineweb_q04/datafusion:vortex-file-compressed 1387471687 1387854185 1.00
fineweb_q05/datafusion:vortex-file-compressed 1355705283 1373914632 0.99
fineweb_q06/datafusion:vortex-file-compressed 1521695045 1465186811 1.04
fineweb_q07/datafusion:vortex-file-compressed 1377975864 1382759180 1.00
fineweb_q08/datafusion:vortex-file-compressed 569435867 579716655 0.98
datafusion / vortex-compact (0.885x ➖, 1↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35471577 32329819 1.10
fineweb_q01/datafusion:vortex-compact 🚀 538136042 982312683 0.55
fineweb_q02/datafusion:vortex-compact 677194995 902013831 0.75
fineweb_q03/datafusion:vortex-compact 1824920364 1855719282 0.98
fineweb_q04/datafusion:vortex-compact 2192285514 2180723588 1.01
fineweb_q05/datafusion:vortex-compact 1685480069 1679793825 1.00
fineweb_q06/datafusion:vortex-compact 1438637550 1649200683 0.87
fineweb_q07/datafusion:vortex-compact 1319072328 1350666613 0.98
fineweb_q08/datafusion:vortex-compact 421234710 484526786 0.87
datafusion / parquet (1.078x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1195497921 1006472602 1.19
fineweb_q01/datafusion:parquet 1984228430 1749992734 1.13
fineweb_q02/datafusion:parquet 1942891340 1834202093 1.06
fineweb_q03/datafusion:parquet 1888319971 1787674534 1.06
fineweb_q04/datafusion:parquet 2117949974 2232288105 0.95
fineweb_q05/datafusion:parquet 1925459817 1994886282 0.97
fineweb_q06/datafusion:parquet 1993108141 1836840846 1.09
fineweb_q07/datafusion:parquet 1967394041 1761070350 1.12
fineweb_q08/datafusion:parquet 1996419112 1698997478 1.18
duckdb / vortex-file-compressed (1.047x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 101146322 80212607 1.26
fineweb_q01/duckdb:vortex-file-compressed 625669459 558451988 1.12
fineweb_q02/duckdb:vortex-file-compressed 438629153 481638449 0.91
fineweb_q03/duckdb:vortex-file-compressed 1482089751 1463113948 1.01
fineweb_q04/duckdb:vortex-file-compressed 1451076125 1432758669 1.01
fineweb_q05/duckdb:vortex-file-compressed 1455811096 1446614096 1.01
fineweb_q06/duckdb:vortex-file-compressed 1647837996 1575309586 1.05
fineweb_q07/duckdb:vortex-file-compressed 1454613675 1397287321 1.04
fineweb_q08/duckdb:vortex-file-compressed 619697141 591328508 1.05
duckdb / vortex-compact (1.121x ➖, 0↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 108000730 56810635 1.90
fineweb_q01/duckdb:vortex-compact 673102028 538383193 1.25
fineweb_q02/duckdb:vortex-compact 667020364 616236340 1.08
fineweb_q03/duckdb:vortex-compact 1570827618 1589882503 0.99
fineweb_q04/duckdb:vortex-compact 1624068617 1671042697 0.97
fineweb_q05/duckdb:vortex-compact 1460129379 1492539984 0.98
fineweb_q06/duckdb:vortex-compact 1448462724 1391461972 1.04
fineweb_q07/duckdb:vortex-compact 1356053339 1301629025 1.04
fineweb_q08/duckdb:vortex-compact 504168250 474027645 1.06
duckdb / parquet (1.079x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1122443827 1015294385 1.11
fineweb_q01/duckdb:parquet 1747925726 1674297203 1.04
fineweb_q02/duckdb:parquet 1716173776 1510563983 1.14
fineweb_q03/duckdb:parquet 4231173880 3921471702 1.08
fineweb_q04/duckdb:parquet 2012961777 1819604387 1.11
fineweb_q05/duckdb:parquet 2745210308 2630935655 1.04
fineweb_q06/duckdb:parquet 3556040921 3522730888 1.01
fineweb_q07/duckdb:parquet 4180657348 3949187264 1.06
fineweb_q08/duckdb:parquet 1200695329 1052724992 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +9.7% +14.6% -4.3% +169.1% ➖ noise
0 datafusion:vortex-file-compressed -5.7% +14.6% -17.7% +163.4% ➖ noise
0 duckdb:vortex-compact +90.1% +14.6% +65.9% +48.9% 🚨 regression
0 duckdb:vortex-file-compressed +26.1% +14.6% +10.0% +41.4% ➖ noise
1 datafusion:vortex-compact -45.2% +8.8% -49.6% +68.5% ✅ faster
1 datafusion:vortex-file-compressed -14.7% +8.8% -21.6% +78.1% ➖ noise
1 duckdb:vortex-compact +25.0% +8.8% +14.9% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +12.0% +8.8% +3.0% +30.0% ➖ noise
2 datafusion:vortex-compact -24.9% +9.7% -31.6% +35.4% ✅ faster
2 datafusion:vortex-file-compressed -6.3% +9.7% -14.5% +42.4% ➖ noise
2 duckdb:vortex-compact +8.2% +9.7% -1.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -8.9% +9.7% -17.0% +30.0% ➖ noise
3 datafusion:vortex-compact -1.7% +6.8% -7.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +6.9% +6.8% +0.2% +30.0% ➖ noise
3 duckdb:vortex-compact -1.2% +6.8% -7.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +1.3% +6.8% -5.1% +30.0% ➖ noise
4 datafusion:vortex-compact +0.5% +2.5% -1.9% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.0% +2.5% -2.4% +30.0% ➖ noise
4 duckdb:vortex-compact -2.8% +2.5% -5.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +1.3% +2.5% -1.1% +30.0% ➖ noise
5 datafusion:vortex-compact +0.3% +0.4% -0.0% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -1.3% +0.4% -1.7% +30.0% ➖ noise
5 duckdb:vortex-compact -2.2% +0.4% -2.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +0.6% +0.4% +0.3% +30.0% ➖ noise
6 datafusion:vortex-compact -12.8% +4.7% -16.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +3.9% +4.7% -0.8% +30.0% ➖ noise
6 duckdb:vortex-compact +4.1% +4.7% -0.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +4.6% +4.7% -0.1% +30.0% ➖ noise
7 datafusion:vortex-compact -2.3% +8.7% -10.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -0.3% +8.7% -8.4% +30.0% ➖ noise
7 duckdb:vortex-compact +4.2% +8.7% -4.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +4.1% +8.7% -4.3% +30.0% ➖ noise
8 datafusion:vortex-compact -13.1% +15.8% -24.9% +30.0% ✅ faster
8 datafusion:vortex-file-compressed -1.8% +15.8% -15.2% +30.0% ➖ noise
8 duckdb:vortex-compact +6.4% +15.8% -8.1% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +4.8% +15.8% -9.5% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.8%
Vortex (geomean): 1.121x ➖
Parquet (geomean): 1.101x ➖
Shifts: Parquet (control) +10.1% · Median polish +13.2%


datafusion / vortex-file-compressed (1.150x ➖, 0↑ 5↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 222044819 260812407 0.85
tpch_q02/datafusion:vortex-file-compressed 502394068 423169287 1.19
tpch_q03/datafusion:vortex-file-compressed 425894424 367879945 1.16
tpch_q04/datafusion:vortex-file-compressed 230537343 199631084 1.15
tpch_q05/datafusion:vortex-file-compressed 🚨 677827110 370066039 1.83
tpch_q06/datafusion:vortex-file-compressed 🚨 354607428 248958164 1.42
tpch_q07/datafusion:vortex-file-compressed 🚨 505666258 343033928 1.47
tpch_q08/datafusion:vortex-file-compressed 🚨 754935766 516529942 1.46
tpch_q09/datafusion:vortex-file-compressed 358276518 418895170 0.86
tpch_q10/datafusion:vortex-file-compressed 487097544 433555057 1.12
tpch_q11/datafusion:vortex-file-compressed 335670475 352335625 0.95
tpch_q12/datafusion:vortex-file-compressed 395161498 354525476 1.11
tpch_q13/datafusion:vortex-file-compressed 269820271 219355120 1.23
tpch_q14/datafusion:vortex-file-compressed 202743254 181881146 1.11
tpch_q15/datafusion:vortex-file-compressed 342610575 291106971 1.18
tpch_q16/datafusion:vortex-file-compressed 185575715 188682229 0.98
tpch_q17/datafusion:vortex-file-compressed 🚨 406282204 306541034 1.33
tpch_q18/datafusion:vortex-file-compressed 318200927 360606994 0.88
tpch_q19/datafusion:vortex-file-compressed 373327241 384907597 0.97
tpch_q20/datafusion:vortex-file-compressed 380363237 347261778 1.10
tpch_q21/datafusion:vortex-file-compressed 550519849 465888834 1.18
tpch_q22/datafusion:vortex-file-compressed 175257577 145393288 1.21
datafusion / vortex-compact (1.103x ➖, 1↑ 3↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 243386436 264373699 0.92
tpch_q02/datafusion:vortex-compact 454893084 425771895 1.07
tpch_q03/datafusion:vortex-compact 372090947 356677727 1.04
tpch_q04/datafusion:vortex-compact 263210032 210189928 1.25
tpch_q05/datafusion:vortex-compact 522168612 448236294 1.16
tpch_q06/datafusion:vortex-compact 🚨 434935519 303963353 1.43
tpch_q07/datafusion:vortex-compact 🚨 775343437 496485839 1.56
tpch_q08/datafusion:vortex-compact 634006059 512777111 1.24
tpch_q09/datafusion:vortex-compact 481044009 393627880 1.22
tpch_q10/datafusion:vortex-compact 493871796 405973379 1.22
tpch_q11/datafusion:vortex-compact 286682879 245472441 1.17
tpch_q12/datafusion:vortex-compact 426894252 430912302 0.99
tpch_q13/datafusion:vortex-compact 219676904 212389742 1.03
tpch_q14/datafusion:vortex-compact 280318489 287964527 0.97
tpch_q15/datafusion:vortex-compact 479048568 424411432 1.13
tpch_q16/datafusion:vortex-compact 190833049 256660572 0.74
tpch_q17/datafusion:vortex-compact 359005645 393395048 0.91
tpch_q18/datafusion:vortex-compact 321999919 278819135 1.15
tpch_q19/datafusion:vortex-compact 🚀 506007284 774275396 0.65
tpch_q20/datafusion:vortex-compact 518165308 475713939 1.09
tpch_q21/datafusion:vortex-compact 791348196 611566474 1.29
tpch_q22/datafusion:vortex-compact 🚨 214988555 144337123 1.49
datafusion / parquet (1.089x ➖, 0↑ 3↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 199067007 227904051 0.87
tpch_q02/datafusion:parquet 457797441 436256347 1.05
tpch_q03/datafusion:parquet 328727276 369825131 0.89
tpch_q04/datafusion:parquet 172101905 186054992 0.93
tpch_q05/datafusion:parquet 🚨 647924380 472969619 1.37
tpch_q06/datafusion:parquet 🚨 280727684 178579708 1.57
tpch_q07/datafusion:parquet 608963167 487442812 1.25
tpch_q08/datafusion:parquet 598394019 636506196 0.94
tpch_q09/datafusion:parquet 549390289 560892760 0.98
tpch_q10/datafusion:parquet 597921159 506519500 1.18
tpch_q11/datafusion:parquet 349916932 349417224 1.00
tpch_q12/datafusion:parquet 259043697 230480183 1.12
tpch_q13/datafusion:parquet 465535694 434613319 1.07
tpch_q14/datafusion:parquet 189630416 173147867 1.10
tpch_q15/datafusion:parquet 305169556 299896582 1.02
tpch_q16/datafusion:parquet 199907751 161776062 1.24
tpch_q17/datafusion:parquet 456970856 354605190 1.29
tpch_q18/datafusion:parquet 533204333 426390274 1.25
tpch_q19/datafusion:parquet 376735172 484008725 0.78
tpch_q20/datafusion:parquet 🚨 427785119 322993302 1.32
tpch_q21/datafusion:parquet 729436070 564586827 1.29
tpch_q22/datafusion:parquet 124129592 150151077 0.83
duckdb / vortex-file-compressed (1.107x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 298878918 289450857 1.03
tpch_q02/duckdb:vortex-file-compressed 1019130780 985661916 1.03
tpch_q03/duckdb:vortex-file-compressed 675840660 626049314 1.08
tpch_q04/duckdb:vortex-file-compressed 403869696 361435526 1.12
tpch_q05/duckdb:vortex-file-compressed 970917651 810466112 1.20
tpch_q06/duckdb:vortex-file-compressed 485369282 487569268 1.00
tpch_q07/duckdb:vortex-file-compressed 808070472 720295891 1.12
tpch_q08/duckdb:vortex-file-compressed 1075883337 924408323 1.16
tpch_q09/duckdb:vortex-file-compressed 963409698 850574392 1.13
tpch_q10/duckdb:vortex-file-compressed 775333534 657330346 1.18
tpch_q11/duckdb:vortex-file-compressed 549581106 479001358 1.15
tpch_q12/duckdb:vortex-file-compressed 503744367 494037485 1.02
tpch_q13/duckdb:vortex-file-compressed 506411447 473301318 1.07
tpch_q14/duckdb:vortex-file-compressed 482426998 496356533 0.97
tpch_q15/duckdb:vortex-file-compressed 318910812 282461864 1.13
tpch_q16/duckdb:vortex-file-compressed 411654513 398019949 1.03
tpch_q17/duckdb:vortex-file-compressed 796850902 660671798 1.21
tpch_q18/duckdb:vortex-file-compressed 621705451 543604096 1.14
tpch_q19/duckdb:vortex-file-compressed 579205779 470482308 1.23
tpch_q20/duckdb:vortex-file-compressed 968491654 795990994 1.22
tpch_q21/duckdb:vortex-file-compressed 1313609161 1171447491 1.12
tpch_q22/duckdb:vortex-file-compressed 367124531 348587419 1.05
duckdb / vortex-compact (1.126x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 306604695 318859623 0.96
tpch_q02/duckdb:vortex-compact 1037146315 907524221 1.14
tpch_q03/duckdb:vortex-compact 649800148 643729311 1.01
tpch_q04/duckdb:vortex-compact 427826399 329342605 1.30
tpch_q05/duckdb:vortex-compact 967917315 803205341 1.21
tpch_q06/duckdb:vortex-compact 439934996 414247839 1.06
tpch_q07/duckdb:vortex-compact 749975926 636692128 1.18
tpch_q08/duckdb:vortex-compact 958442951 920889217 1.04
tpch_q09/duckdb:vortex-compact 1026046255 884086144 1.16
tpch_q10/duckdb:vortex-compact 712223484 622816015 1.14
tpch_q11/duckdb:vortex-compact 520250571 452098808 1.15
tpch_q12/duckdb:vortex-compact 488206088 439546019 1.11
tpch_q13/duckdb:vortex-compact 480615593 462774877 1.04
tpch_q14/duckdb:vortex-compact 541697508 503174815 1.08
tpch_q15/duckdb:vortex-compact 378402447 333521158 1.13
tpch_q16/duckdb:vortex-compact 378916490 341626026 1.11
tpch_q17/duckdb:vortex-compact 709698232 566975941 1.25
tpch_q18/duckdb:vortex-compact 524239186 422815719 1.24
tpch_q19/duckdb:vortex-compact 482614353 457625455 1.05
tpch_q20/duckdb:vortex-compact 805033008 727010999 1.11
tpch_q21/duckdb:vortex-compact 1270400197 1009922716 1.26
tpch_q22/duckdb:vortex-compact 422305201 379781998 1.11
duckdb / parquet (1.114x ➖, 0↑ 2↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 610665281 452817138 1.35
tpch_q02/duckdb:parquet 1491922821 1388127469 1.07
tpch_q03/duckdb:parquet 1177172807 954815964 1.23
tpch_q04/duckdb:parquet 🚨 796526946 610840007 1.30
tpch_q05/duckdb:parquet 1694140396 1526501552 1.11
tpch_q06/duckdb:parquet 462916165 408725300 1.13
tpch_q07/duckdb:parquet 1308709293 1147687827 1.14
tpch_q08/duckdb:parquet 1750794747 1643820322 1.07
tpch_q09/duckdb:parquet 1490950210 1604298851 0.93
tpch_q10/duckdb:parquet 1438575352 1490189740 0.97
tpch_q11/duckdb:parquet 959338427 820972855 1.17
tpch_q12/duckdb:parquet 678636003 580215557 1.17
tpch_q13/duckdb:parquet 1031885123 874216162 1.18
tpch_q14/duckdb:parquet 754434419 855806038 0.88
tpch_q15/duckdb:parquet 665661240 515983997 1.29
tpch_q16/duckdb:parquet 641370820 548820292 1.17
tpch_q17/duckdb:parquet 785413930 880431320 0.89
tpch_q18/duckdb:parquet 961920612 838041398 1.15
tpch_q19/duckdb:parquet 918542286 852975272 1.08
tpch_q20/duckdb:parquet 1149519438 1081589918 1.06
tpch_q21/duckdb:parquet 1357740436 1174248952 1.16
tpch_q22/duckdb:parquet 588617090 508903497 1.16
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.9% +8.5% -15.2% +95.6% ➖ noise
1 datafusion:vortex-file-compressed -14.9% +8.5% -21.6% +119.2% ➖ noise
1 duckdb:vortex-compact -3.8% +8.5% -11.4% +67.0% ➖ noise
1 duckdb:vortex-file-compressed +3.3% +8.5% -4.9% +48.9% ➖ noise
2 datafusion:vortex-compact +6.8% +6.2% +0.6% +43.9% ➖ noise
2 datafusion:vortex-file-compressed +18.7% +6.2% +11.8% +40.4% ➖ noise
2 duckdb:vortex-compact +14.3% +6.2% +7.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +3.4% +6.2% -2.6% +30.0% ➖ noise
3 datafusion:vortex-compact +4.3% +4.7% -0.3% +68.4% ➖ noise
3 datafusion:vortex-file-compressed +15.8% +4.7% +10.6% +80.0% ➖ noise
3 duckdb:vortex-compact +0.9% +4.7% -3.6% +35.3% ➖ noise
3 duckdb:vortex-file-compressed +8.0% +4.7% +3.1% +34.1% ➖ noise
4 datafusion:vortex-compact +25.2% +9.8% +14.0% +51.0% ➖ noise
4 datafusion:vortex-file-compressed +15.5% +9.8% +5.1% +30.0% ➖ noise
4 duckdb:vortex-compact +29.9% +9.8% +18.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +11.7% +9.8% +1.7% +30.0% ➖ noise
5 datafusion:vortex-compact +16.5% +23.3% -5.5% +38.9% ➖ noise
5 datafusion:vortex-file-compressed +83.2% +23.3% +48.5% +38.8% 🚨 regression
5 duckdb:vortex-compact +20.5% +23.3% -2.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +19.8% +23.3% -2.8% +30.0% ➖ noise
6 datafusion:vortex-compact +43.1% +33.4% +7.2% +37.4% ➖ noise
6 datafusion:vortex-file-compressed +42.4% +33.4% +6.7% +30.0% ➖ noise
6 duckdb:vortex-compact +6.2% +33.4% -20.4% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -0.5% +33.4% -25.4% +30.0% ✅ faster
7 datafusion:vortex-compact +56.2% +19.4% +30.8% +39.7% ➖ noise
7 datafusion:vortex-file-compressed +47.4% +19.4% +23.5% +30.0% ➖ noise
7 duckdb:vortex-compact +17.8% +19.4% -1.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +12.2% +19.4% -6.0% +30.0% ➖ noise
8 datafusion:vortex-compact +23.6% +0.1% +23.6% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +46.2% +0.1% +46.1% +30.0% 🚨 regression
8 duckdb:vortex-compact +4.1% +0.1% +4.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +16.4% +0.1% +16.3% +30.0% ➖ noise
9 datafusion:vortex-compact +22.2% -4.6% +28.1% +32.4% ➖ noise
9 datafusion:vortex-file-compressed -14.5% -4.6% -10.4% +30.0% ➖ noise
9 duckdb:vortex-compact +16.1% -4.6% +21.6% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +13.3% -4.6% +18.7% +30.0% ➖ noise
10 datafusion:vortex-compact +21.7% +6.8% +14.0% +39.5% ➖ noise
10 datafusion:vortex-file-compressed +12.3% +6.8% +5.2% +33.4% ➖ noise
10 duckdb:vortex-compact +14.4% +6.8% +7.1% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +18.0% +6.8% +10.5% +30.0% ➖ noise
11 datafusion:vortex-compact +16.8% +8.2% +8.0% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -4.7% +8.2% -11.9% +30.0% ➖ noise
11 duckdb:vortex-compact +15.1% +8.2% +6.4% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +14.7% +8.2% +6.1% +30.0% ➖ noise
12 datafusion:vortex-compact -0.9% +14.7% -13.6% +35.1% ➖ noise
12 datafusion:vortex-file-compressed +11.5% +14.7% -2.8% +43.7% ➖ noise
12 duckdb:vortex-compact +11.1% +14.7% -3.1% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +2.0% +14.7% -11.1% +32.7% ➖ noise
13 datafusion:vortex-compact +3.4% +12.4% -8.0% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +23.0% +12.4% +9.4% +75.0% ➖ noise
13 duckdb:vortex-compact +3.9% +12.4% -7.6% +33.3% ➖ noise
13 duckdb:vortex-file-compressed +7.0% +12.4% -4.8% +30.0% ➖ noise
14 datafusion:vortex-compact -2.7% -1.7% -0.9% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +11.5% -1.7% +13.4% +30.0% ➖ noise
14 duckdb:vortex-compact +7.7% -1.7% +9.6% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -2.8% -1.7% -1.1% +30.0% ➖ noise
15 datafusion:vortex-compact +12.9% +14.6% -1.5% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +17.7% +14.6% +2.7% +30.0% ➖ noise
15 duckdb:vortex-compact +13.5% +14.6% -1.0% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +12.9% +14.6% -1.5% +30.0% ➖ noise
16 datafusion:vortex-compact -25.6% +20.2% -38.1% +30.0% ✅ faster
16 datafusion:vortex-file-compressed -1.6% +20.2% -18.2% +30.0% ➖ noise
16 duckdb:vortex-compact +10.9% +20.2% -7.7% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +3.4% +20.2% -13.9% +30.0% ➖ noise
17 datafusion:vortex-compact -8.7% +7.2% -14.9% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +32.5% +7.2% +23.6% +30.0% ➖ noise
17 duckdb:vortex-compact +25.2% +7.2% +16.7% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +20.6% +7.2% +12.5% +30.0% ➖ noise
18 datafusion:vortex-compact +15.5% +19.8% -3.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -11.8% +19.8% -26.3% +30.0% ✅ faster
18 duckdb:vortex-compact +24.0% +19.8% +3.5% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +14.4% +19.8% -4.5% +30.0% ➖ noise
19 datafusion:vortex-compact -34.6% -8.4% -28.6% +74.4% ➖ noise
19 datafusion:vortex-file-compressed -3.0% -8.4% +5.9% +30.0% ➖ noise
19 duckdb:vortex-compact +5.5% -8.4% +15.2% +30.1% ➖ noise
19 duckdb:vortex-file-compressed +23.1% -8.4% +34.5% +90.9% ➖ noise
20 datafusion:vortex-compact +8.9% +18.6% -8.2% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +9.5% +18.6% -7.7% +30.0% ➖ noise
20 duckdb:vortex-compact +10.7% +18.6% -6.7% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +21.7% +18.6% +2.6% +30.0% ➖ noise
21 datafusion:vortex-compact +29.4% +22.2% +5.9% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +18.2% +22.2% -3.3% +30.0% ➖ noise
21 duckdb:vortex-compact +25.8% +22.2% +2.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +12.1% +22.2% -8.3% +30.0% ➖ noise
22 datafusion:vortex-compact +48.9% -2.2% +52.3% +30.0% 🚨 regression
22 datafusion:vortex-file-compressed +20.5% -2.2% +23.3% +30.0% ➖ noise
22 duckdb:vortex-compact +11.2% -2.2% +13.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +5.3% -2.2% +7.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.3%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.062x ➖
Shifts: Parquet (control) +6.2% · Median polish +1.7%


datafusion / vortex-file-compressed (0.976x ➖, 0↑ 2↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 715885599 965637338 0.74
tpch_q02/datafusion:vortex-file-compressed 803284674 703272360 1.14
tpch_q03/datafusion:vortex-file-compressed 🚨 1248783136 802518989 1.56
tpch_q04/datafusion:vortex-file-compressed 696818333 875949048 0.80
tpch_q05/datafusion:vortex-file-compressed 1106633051 1013698853 1.09
tpch_q06/datafusion:vortex-file-compressed 822923408 917520566 0.90
tpch_q07/datafusion:vortex-file-compressed 🚨 1480218300 1116960158 1.33
tpch_q08/datafusion:vortex-file-compressed 1464147236 1431276301 1.02
tpch_q09/datafusion:vortex-file-compressed 1442616855 1644526952 0.88
tpch_q10/datafusion:vortex-file-compressed 1024850055 1380189269 0.74
tpch_q11/datafusion:vortex-file-compressed 492214558 468461746 1.05
tpch_q12/datafusion:vortex-file-compressed 1082212502 1017729949 1.06
tpch_q13/datafusion:vortex-file-compressed 444837779 470189458 0.95
tpch_q14/datafusion:vortex-file-compressed 804717128 656629487 1.23
tpch_q15/datafusion:vortex-file-compressed 1353825575 1597533033 0.85
tpch_q16/datafusion:vortex-file-compressed 389407136 422901058 0.92
tpch_q17/datafusion:vortex-file-compressed 1436652976 1316281492 1.09
tpch_q18/datafusion:vortex-file-compressed 1270320927 1794011981 0.71
tpch_q19/datafusion:vortex-file-compressed 885131864 826897328 1.07
tpch_q20/datafusion:vortex-file-compressed 1059547106 1096923104 0.97
tpch_q21/datafusion:vortex-file-compressed 1668802170 2180088333 0.77
tpch_q22/datafusion:vortex-file-compressed 372042371 352392539 1.06
datafusion / vortex-compact (1.065x ➖, 1↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 690472422 684255322 1.01
tpch_q02/datafusion:vortex-compact 690610339 637415824 1.08
tpch_q03/datafusion:vortex-compact 856495725 669364660 1.28
tpch_q04/datafusion:vortex-compact 🚀 684469809 1271075077 0.54
tpch_q05/datafusion:vortex-compact 1238641968 968621459 1.28
tpch_q06/datafusion:vortex-compact 671911829 690847496 0.97
tpch_q07/datafusion:vortex-compact 1021076446 1033637526 0.99
tpch_q08/datafusion:vortex-compact 1104470338 1093300897 1.01
tpch_q09/datafusion:vortex-compact 1265243422 1160487811 1.09
tpch_q10/datafusion:vortex-compact 1055013119 866300829 1.22
tpch_q11/datafusion:vortex-compact 481103091 444710781 1.08
tpch_q12/datafusion:vortex-compact 🚨 1169666264 832329653 1.41
tpch_q13/datafusion:vortex-compact 423590065 395065331 1.07
tpch_q14/datafusion:vortex-compact 644011081 591926873 1.09
tpch_q15/datafusion:vortex-compact 1138575222 1026468881 1.11
tpch_q16/datafusion:vortex-compact 370462415 340336131 1.09
tpch_q17/datafusion:vortex-compact 1181209248 1159692198 1.02
tpch_q18/datafusion:vortex-compact 1155561260 1098445446 1.05
tpch_q19/datafusion:vortex-compact 778937808 775448423 1.00
tpch_q20/datafusion:vortex-compact 906104993 841054263 1.08
tpch_q21/datafusion:vortex-compact 1619228614 1452063533 1.12
tpch_q22/datafusion:vortex-compact 436014344 371806428 1.17
datafusion / parquet (1.044x ➖, 0↑ 2↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 819161840 872218864 0.94
tpch_q02/datafusion:parquet 676920984 656251634 1.03
tpch_q03/datafusion:parquet 946322049 920661407 1.03
tpch_q04/datafusion:parquet 450091582 564035675 0.80
tpch_q05/datafusion:parquet 1317347430 1260560416 1.05
tpch_q06/datafusion:parquet 536426274 511451452 1.05
tpch_q07/datafusion:parquet 1317752621 1301394241 1.01
tpch_q08/datafusion:parquet 1697206781 1586370015 1.07
tpch_q09/datafusion:parquet 1853769594 1846754666 1.00
tpch_q10/datafusion:parquet 2130467019 2193050434 0.97
tpch_q11/datafusion:parquet 🚨 706677436 530530285 1.33
tpch_q12/datafusion:parquet 662473464 701876270 0.94
tpch_q13/datafusion:parquet 684870536 673287522 1.02
tpch_q14/datafusion:parquet 728962897 751060042 0.97
tpch_q15/datafusion:parquet 1180196251 1153699963 1.02
tpch_q16/datafusion:parquet 378172746 427691933 0.88
tpch_q17/datafusion:parquet 1350032360 1326617907 1.02
tpch_q18/datafusion:parquet 1450664085 1420665054 1.02
tpch_q19/datafusion:parquet 1203243517 969799680 1.24
tpch_q20/datafusion:parquet 🚨 1874064317 1137583480 1.65
tpch_q21/datafusion:parquet 1972332522 1643487127 1.20
tpch_q22/datafusion:parquet 737645130 755794287 0.98
duckdb / vortex-file-compressed (0.938x ➖, 1↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 611894755 646911316 0.95
tpch_q02/duckdb:vortex-file-compressed 1210574606 1133914907 1.07
tpch_q03/duckdb:vortex-file-compressed 938660851 1013269038 0.93
tpch_q04/duckdb:vortex-file-compressed 689412517 751558665 0.92
tpch_q05/duckdb:vortex-file-compressed 1127685734 1298575041 0.87
tpch_q06/duckdb:vortex-file-compressed 836614259 832182380 1.01
tpch_q07/duckdb:vortex-file-compressed 1387231505 1149902412 1.21
tpch_q08/duckdb:vortex-file-compressed 1557480505 1545972125 1.01
tpch_q09/duckdb:vortex-file-compressed 1466791414 1410580702 1.04
tpch_q10/duckdb:vortex-file-compressed 1237903845 1232096250 1.00
tpch_q11/duckdb:vortex-file-compressed 623461481 650035617 0.96
tpch_q12/duckdb:vortex-file-compressed 695611545 949058651 0.73
tpch_q13/duckdb:vortex-file-compressed 917286806 978750263 0.94
tpch_q14/duckdb:vortex-file-compressed 1001056829 856906624 1.17
tpch_q15/duckdb:vortex-file-compressed 609930897 567249590 1.08
tpch_q16/duckdb:vortex-file-compressed 490003838 663795690 0.74
tpch_q17/duckdb:vortex-file-compressed 1043929452 1326799602 0.79
tpch_q18/duckdb:vortex-file-compressed 🚀 834841518 1363890981 0.61
tpch_q19/duckdb:vortex-file-compressed 867015512 900517126 0.96
tpch_q20/duckdb:vortex-file-compressed 1283479804 1376217244 0.93
tpch_q21/duckdb:vortex-file-compressed 2002431316 2478063008 0.81
tpch_q22/duckdb:vortex-file-compressed 664852861 545745167 1.22
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 601149155 595425393 1.01
tpch_q02/duckdb:vortex-compact 1065736773 1030871181 1.03
tpch_q03/duckdb:vortex-compact 871427769 842485611 1.03
tpch_q04/duckdb:vortex-compact 518478097 474952034 1.09
tpch_q05/duckdb:vortex-compact 1070374865 1021692642 1.05
tpch_q06/duckdb:vortex-compact 746367999 688384258 1.08
tpch_q07/duckdb:vortex-compact 1028947675 1052979803 0.98
tpch_q08/duckdb:vortex-compact 1390924469 1360365123 1.02
tpch_q09/duckdb:vortex-compact 1330575385 1321894238 1.01
tpch_q10/duckdb:vortex-compact 938165717 1226715577 0.76
tpch_q11/duckdb:vortex-compact 686470143 718621505 0.96
tpch_q12/duckdb:vortex-compact 662734344 660686069 1.00
tpch_q13/duckdb:vortex-compact 883996069 831997654 1.06
tpch_q14/duckdb:vortex-compact 841849526 834984140 1.01
tpch_q15/duckdb:vortex-compact 540343840 534760284 1.01
tpch_q16/duckdb:vortex-compact 483913715 442216172 1.09
tpch_q17/duckdb:vortex-compact 882147271 997847825 0.88
tpch_q18/duckdb:vortex-compact 739221567 729875239 1.01
tpch_q19/duckdb:vortex-compact 748820798 682572422 1.10
tpch_q20/duckdb:vortex-compact 1126531908 1204024712 0.94
tpch_q21/duckdb:vortex-compact 1688557303 1726959039 0.98
tpch_q22/duckdb:vortex-compact 627647887 611352210 1.03
duckdb / parquet (1.080x ➖, 0↑ 1↓)
name PR 56a16a8 (ns) base 77c8e95 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1016461061 862517839 1.18
tpch_q02/duckdb:parquet 1540925782 1539285570 1.00
tpch_q03/duckdb:parquet 1704625420 1790889080 0.95
tpch_q04/duckdb:parquet 1211845352 1062729615 1.14
tpch_q05/duckdb:parquet 🚨 2491592204 1875685981 1.33
tpch_q06/duckdb:parquet 768789640 727195450 1.06
tpch_q07/duckdb:parquet 1913077816 1755492731 1.09
tpch_q08/duckdb:parquet 2557601632 2260600481 1.13
tpch_q09/duckdb:parquet 2371672037 2311807726 1.03
tpch_q10/duckdb:parquet 3293315390 3111764879 1.06
tpch_q11/duckdb:parquet 1014618007 843556869 1.20
tpch_q12/duckdb:parquet 1116020714 967613695 1.15
tpch_q13/duckdb:parquet 1267951000 1284342272 0.99
tpch_q14/duckdb:parquet 1298017361 1119141490 1.16
tpch_q15/duckdb:parquet 950993836 1016525273 0.94
tpch_q16/duckdb:parquet 857609886 711575417 1.21
tpch_q17/duckdb:parquet 1405727301 1184086899 1.19
tpch_q18/duckdb:parquet 1336772178 1391428968 0.96
tpch_q19/duckdb:parquet 1710181719 1518173351 1.13
tpch_q20/duckdb:parquet 1842129122 1814335657 1.02
tpch_q21/duckdb:parquet 1883192608 1981853954 0.95
tpch_q22/duckdb:parquet 1006105573 993546015 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.9% +5.2% -4.1% +67.9% ➖ noise
1 datafusion:vortex-file-compressed -25.9% +5.2% -29.5% +62.8% ➖ noise
1 duckdb:vortex-compact +1.0% +5.2% -4.0% +40.1% ➖ noise
1 duckdb:vortex-file-compressed -5.4% +5.2% -10.1% +33.7% ➖ noise
2 datafusion:vortex-compact +8.3% +1.6% +6.6% +62.0% ➖ noise
2 datafusion:vortex-file-compressed +14.2% +1.6% +12.4% +70.8% ➖ noise
2 duckdb:vortex-compact +3.4% +1.6% +1.7% +36.8% ➖ noise
2 duckdb:vortex-file-compressed +6.8% +1.6% +5.1% +40.2% ➖ noise
3 datafusion:vortex-compact +28.0% -1.1% +29.4% +65.6% ➖ noise
3 datafusion:vortex-file-compressed +55.6% -1.1% +57.3% +76.8% ➖ noise
3 duckdb:vortex-compact +3.4% -1.1% +4.6% +41.2% ➖ noise
3 duckdb:vortex-file-compressed -7.4% -1.1% -6.3% +51.3% ➖ noise
4 datafusion:vortex-compact -46.2% -4.6% -43.5% +107.1% ➖ noise
4 datafusion:vortex-file-compressed -20.4% -4.6% -16.6% +48.4% ➖ noise
4 duckdb:vortex-compact +9.2% -4.6% +14.4% +34.6% ➖ noise
4 duckdb:vortex-file-compressed -8.3% -4.6% -3.8% +30.0% ➖ noise
5 datafusion:vortex-compact +27.9% +17.8% +8.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +9.2% +17.8% -7.3% +30.0% ➖ noise
5 duckdb:vortex-compact +4.8% +17.8% -11.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -13.2% +17.8% -26.3% +30.0% ✅ faster
6 datafusion:vortex-compact -2.7% +5.3% -7.6% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -10.3% +5.3% -14.8% +30.0% ➖ noise
6 duckdb:vortex-compact +8.4% +5.3% +3.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +0.5% +5.3% -4.5% +30.0% ➖ noise
7 datafusion:vortex-compact -1.2% +5.0% -6.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +32.5% +5.0% +26.2% +30.0% ➖ noise
7 duckdb:vortex-compact -2.3% +5.0% -7.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +20.6% +5.0% +14.8% +81.3% ➖ noise
8 datafusion:vortex-compact +1.0% +10.0% -8.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +2.3% +10.0% -7.0% +30.0% ➖ noise
8 duckdb:vortex-compact +2.2% +10.0% -7.1% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +0.7% +10.0% -8.4% +30.0% ➖ noise
9 datafusion:vortex-compact +9.0% +1.5% +7.4% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -12.3% +1.5% -13.6% +30.0% ➖ noise
9 duckdb:vortex-compact +0.7% +1.5% -0.8% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +4.0% +1.5% +2.5% +30.0% ➖ noise
10 datafusion:vortex-compact +21.8% +1.4% +20.1% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -25.7% +1.4% -26.8% +41.4% ➖ noise
10 duckdb:vortex-compact -23.5% +1.4% -24.6% +32.9% ➖ noise
10 duckdb:vortex-file-compressed +0.5% +1.4% -0.9% +31.5% ➖ noise
11 datafusion:vortex-compact +8.2% +26.6% -14.5% +34.4% ➖ noise
11 datafusion:vortex-file-compressed +5.1% +26.6% -17.0% +50.7% ➖ noise
11 duckdb:vortex-compact -4.5% +26.6% -24.5% +30.0% ✅ faster
11 duckdb:vortex-file-compressed -4.1% +26.6% -24.2% +30.0% ✅ faster
12 datafusion:vortex-compact +40.5% +4.3% +34.7% +38.6% ➖ noise
12 datafusion:vortex-file-compressed +6.3% +4.3% +1.9% +53.0% ➖ noise
12 duckdb:vortex-compact +0.3% +4.3% -3.9% +37.6% ➖ noise
12 duckdb:vortex-file-compressed -26.7% +4.3% -29.8% +46.9% ➖ noise
13 datafusion:vortex-compact +7.2% +0.2% +7.0% +40.1% ➖ noise
13 datafusion:vortex-file-compressed -5.4% +0.2% -5.6% +37.3% ➖ noise
13 duckdb:vortex-compact +6.2% +0.2% +6.0% +60.9% ➖ noise
13 duckdb:vortex-file-compressed -6.3% +0.2% -6.5% +60.6% ➖ noise
14 datafusion:vortex-compact +8.8% +6.1% +2.5% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +22.6% +6.1% +15.5% +30.0% ➖ noise
14 duckdb:vortex-compact +0.8% +6.1% -5.0% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +16.8% +6.1% +10.1% +30.0% ➖ noise
15 datafusion:vortex-compact +10.9% -2.2% +13.4% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -15.3% -2.2% -13.4% +30.0% ➖ noise
15 duckdb:vortex-compact +1.0% -2.2% +3.3% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +7.5% -2.2% +9.9% +36.5% ➖ noise
16 datafusion:vortex-compact +8.9% +3.2% +5.4% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -7.9% +3.2% -10.8% +36.5% ➖ noise
16 duckdb:vortex-compact +9.4% +3.2% +6.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -26.2% +3.2% -28.5% +34.0% ✅ faster
17 datafusion:vortex-compact +1.9% +9.9% -7.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +9.1% +9.9% -0.7% +30.0% ➖ noise
17 duckdb:vortex-compact -11.6% +9.9% -19.6% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -21.3% +9.9% -28.4% +30.0% ✅ faster
18 datafusion:vortex-compact +5.2% -1.0% +6.2% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -29.2% -1.0% -28.5% +30.0% ✅ faster
18 duckdb:vortex-compact +1.3% -1.0% +2.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -38.8% -1.0% -38.2% +30.0% ✅ faster
19 datafusion:vortex-compact +0.4% +18.2% -15.0% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +7.0% +18.2% -9.5% +34.9% ➖ noise
19 duckdb:vortex-compact +9.7% +18.2% -7.2% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -3.7% +18.2% -18.6% +30.3% ➖ noise
20 datafusion:vortex-compact +7.7% +29.3% -16.7% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -3.4% +29.3% -25.3% +31.1% ✅ faster
20 duckdb:vortex-compact -6.4% +29.3% -27.7% +30.0% ✅ faster
20 duckdb:vortex-file-compressed -6.7% +29.3% -27.9% +32.1% ✅ faster
21 datafusion:vortex-compact +11.5% +6.8% +4.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -23.5% +6.8% -28.3% +30.0% ✅ faster
21 duckdb:vortex-compact -2.2% +6.8% -8.4% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -19.2% +6.8% -24.3% +30.0% ✅ faster
22 datafusion:vortex-compact +17.3% -0.6% +18.0% +31.5% ➖ noise
22 datafusion:vortex-file-compressed +5.6% -0.6% +6.2% +30.0% ➖ noise
22 duckdb:vortex-compact +2.7% -0.6% +3.3% +32.7% ➖ noise
22 duckdb:vortex-file-compressed +21.8% -0.6% +22.5% +30.0% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant