Skip to content

Conversation

@marmarek
Copy link
Member

Release candidate build for testing

@marmarek
Copy link
Member Author

openQArun

@qubesos-bot
Copy link

qubesos-bot commented Oct 23, 2022

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=202601060402-4.3&flavor=kernel

Test run included the following:

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=202511101135-4.3&flavor=kernel

  • system_tests_basic_vm_qrexec_gui_zfs

    • switch_pool: Failed (test died)
      # Test died: command 'modprobe zfs zfs_arc_max=67108864' failed at ...
  • system_tests_extra

    • TC_00_QVCTest_debian-13-xfce: test_010_screenshare (failure + cleanup)
      ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1179648 != 0
  • system_tests_network_updates

  • system_tests_gui_interactive@hw11

    • gui_keyboard_layout: Failed (test died)
      # Test died: command 'qvm-shutdown --wait work' failed at /usr/lib/...
  • system_tests_basic_vm_qrexec_gui@hw6

  • system_tests_gui_interactive@hw8

    • gui_keyboard_layout: Failed (test died)
      # Test died: command 'qvm-shutdown --wait work' failed at /usr/lib/...
  • system_tests_gui_tools@hw9

  • system_tests_basic_vm_qrexec_gui@hw11

    • startup: unnamed test (unknown)
    • startup: Failed (test died)
      # Test died: no candidate needle with tag(s) 'luks-prompt, login-pr...
  • system_tests_gpu_passthrough@hw13

    • gpu_passthrough: Failed (test died)
      # Test died: command 'qvm-template install debian-12-xfce' failed a...
  • system_tests_basic_vm_qrexec_gui@hw13

    • TC_20_NonAudio_whonix-gateway-18: test_000_start_shutdown (error + timed out)
      qubes.exc.QubesVMShutdownTimeoutError: Domain shutdown timed out: '...
  • system_tests_guivm_gui_interactive

    • guivm_startup: Failed (test died)
      # Test died: command 'qvm-shutdown --all --wait && sleep 2 && qvm-s...

    • guivm_startup: wait_serial (wait serial expected)
      # wait_serial expected: qr/wHeLC-\d+-/...

  • system_tests_qrexec_perf@hw15

    • TC_00_QrexecPerf_debian-13-xfce: test_030_socket_root (failure)
      AssertionError: '/usr/lib/qubes/tests/qrexec_perf.py --vm1=test-ins...
  • system_tests_wifi@hw11

    • startup: unnamed test (unknown)
    • startup: Failed (test died)
      # Test died: no candidate needle with tag(s) 'luks-prompt, login-pr...
  • system_tests_gui_tools@hw11

    • startup: unnamed test (unknown)
    • startup: Failed (test died)
      # Test died: no candidate needle with tag(s) 'luks-prompt, login-pr...

Failed tests

22 failures
  • system_tests_basic_vm_qrexec_gui_zfs

    • switch_pool: Failed (test died)
      # Test died: command 'modprobe zfs zfs_arc_max=67108864' failed at ...
  • system_tests_extra

    • TC_00_QVCTest_debian-13-xfce: test_010_screenshare (failure + cleanup)
      ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1179648 != 0
  • system_tests_network_updates

  • system_tests_gui_interactive@hw11

    • gui_keyboard_layout: Failed (test died)
      # Test died: command 'qvm-shutdown --wait work' failed at /usr/lib/...
  • system_tests_basic_vm_qrexec_gui@hw6

  • system_tests_gui_interactive@hw8

    • gui_keyboard_layout: Failed (test died)
      # Test died: command 'qvm-shutdown --wait work' failed at /usr/lib/...
  • system_tests_gui_tools@hw9

    • qubesmanager_vmsettings: unnamed test (unknown)
    • qubesmanager_vmsettings: Failed (test died)
      # Test died: no candidate needle with tag(s) 'vm-settings-template-...
  • system_tests_basic_vm_qrexec_gui@hw11

    • startup: unnamed test (unknown)
    • startup: Failed (test died)
      # Test died: no candidate needle with tag(s) 'luks-prompt, login-pr...
  • system_tests_gpu_passthrough@hw13

    • gpu_passthrough: Failed (test died)
      # Test died: command 'qvm-template install debian-12-xfce' failed a...
  • system_tests_basic_vm_qrexec_gui@hw13

    • TC_20_NonAudio_whonix-gateway-18: test_000_start_shutdown (error + timed out)
      qubes.exc.QubesVMShutdownTimeoutError: Domain shutdown timed out: '...
  • system_tests_guivm_gui_interactive

    • guivm_startup: Failed (test died)
      # Test died: command 'qvm-shutdown --all --wait && sleep 2 && qvm-s...

    • guivm_startup: wait_serial (wait serial expected)
      # wait_serial expected: qr/wHeLC-\d+-/...

  • system_tests_qrexec_perf@hw15

    • TC_00_QrexecPerf_debian-13-xfce: test_030_socket_root (failure)
      AssertionError: '/usr/lib/qubes/tests/qrexec_perf.py --vm1=test-ins...
  • system_tests_suspend_s0ix@hw15

    • suspend: Failed (test died)
      # Test died: command 'qvm-run -p sys-firewall "curl https://www.qub...

    • suspend: wait_serial (wait serial expected)
      # wait_serial expected: "lspci; echo 2E8vz-\$?-"...

    • suspend: wait_serial (wait serial expected)
      # wait_serial expected: qr/2E8vz-\d+-/...

  • system_tests_wifi@hw11

    • startup: unnamed test (unknown)
    • startup: Failed (test died)
      # Test died: no candidate needle with tag(s) 'luks-prompt, login-pr...
  • system_tests_gui_tools@hw11

    • startup: unnamed test (unknown)
    • startup: Failed (test died)
      # Test died: no candidate needle with tag(s) 'luks-prompt, login-pr...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/158826#dependencies

22 fixed
  • system_tests_gui_tools@hw1

    • qubesmanager_vmsettings: unnamed test (unknown)
    • qubesmanager_vmsettings: Failed (test died)
      # Test died: no candidate needle with tag(s) 'vm-settings-devices-s...
  • system_tests_suspend@hw1

    • microcode: wait_serial (wait serial expected)
      # wait_serial expected: "SCRIPT_FINISHEDgo23e-\\d+-"...

    • microcode: Failed (test died)
      # Test died: script timeout: (od -t x4 /lib/firmware/intel-ucode/17...

  • system_tests_gui_tools@hw6

    • qubesmanager_vmsettings: unnamed test (unknown)
    • qubesmanager_vmsettings: Failed (test died)
      # Test died: no candidate needle with tag(s) 'vm-settings-devices-s...
  • system_tests_gui_interactive@hw9

    • gui_keyboard_layout: unnamed test (unknown)

    • gui_keyboard_layout: Failed (test died)
      # Test died: no candidate needle with tag(s) 'work-xterm, work-xter...

    • gui_keyboard_layout: unnamed test (unknown)

  • system_tests_gui_tools@hw9

  • system_tests_basic_vm_qrexec_gui@hw16

    • startup: unnamed test (unknown)
    • startup: Failed (test died)
      # Test died: no candidate needle with tag(s) 'nm-applet' matched...
  • system_tests_gui_interactive@hw16

    • screenlocker_leaks: unnamed test (unknown)
    • screenlocker_leaks: Failed (test died)
      # Test died: no candidate needle with tag(s) 'screenlocker-blank' m...
  • system_tests_gui_tools@hw16

    • desktop_linux_manager_create_qube: unnamed test (unknown)
    • desktop_linux_manager_create_qube: Failed (test died)
      # Test died: no candidate needle with tag(s) 'new-qube-createtest3-...
  • system_tests_suspend@hw16

    • suspend: unnamed test (unknown)
    • suspend: Failed (test died)
      # Test died: no candidate needle with tag(s) 'xscreensaver-prompt-w...
  • system_tests_gui_interactive@hw17

    • gui_filecopy: unnamed test (unknown)
    • gui_filecopy: Failed (test died)
      # Test died: no candidate needle with tag(s) 'files-test-file' matc...
  • system_tests_gui_tools@hw11

    • qui_widgets_update: unnamed test (unknown)
    • qui_widgets_update: Failed (test died)
      # Test died: no candidate needle with tag(s) 'qubes-update-launch-u...

Unstable tests

Details
  • system_tests_gui_interactive@hw13

    collect_logs/Failed (1/5 times with errors)
    collect_logs/wait_serial (1/5 times with errors)
    • job 163926 # wait_serial expected: qr/yCLOp-\d+-/...
    collect_logs/wait_serial (1/5 times with errors)
    • job 163926 # wait_serial expected: qr/S0w8Z-\d+-/...
  • system_tests_gui_interactive@hw7

    collect_logs/Failed (1/5 times with errors)
    collect_logs/wait_serial (1/5 times with errors)
    • job 163926 # wait_serial expected: qr/yCLOp-\d+-/...
    collect_logs/wait_serial (1/5 times with errors)
    • job 163926 # wait_serial expected: qr/S0w8Z-\d+-/...
  • system_tests_gui_interactive@hw15

    collect_logs/Failed (1/5 times with errors)
    collect_logs/wait_serial (1/5 times with errors)
    • job 163926 # wait_serial expected: qr/yCLOp-\d+-/...
    collect_logs/wait_serial (1/5 times with errors)
    • job 163926 # wait_serial expected: qr/S0w8Z-\d+-/...
  • system_tests_gui_interactive@hw16

    collect_logs/Failed (1/5 times with errors)
    collect_logs/wait_serial (1/5 times with errors)
    • job 163926 # wait_serial expected: qr/yCLOp-\d+-/...
    collect_logs/wait_serial (1/5 times with errors)
    • job 163926 # wait_serial expected: qr/S0w8Z-\d+-/...
  • system_tests_gui_interactive@hw17

    collect_logs/Failed (1/5 times with errors)
    collect_logs/wait_serial (1/5 times with errors)
    • job 163926 # wait_serial expected: qr/yCLOp-\d+-/...
    collect_logs/wait_serial (1/5 times with errors)
    • job 163926 # wait_serial expected: qr/S0w8Z-\d+-/...

Performance Tests

Performance degradation:

6 performance degradations
  • fedora-42-xfce_exec: 6.39 🔻 ( previous job: 5.72, degradation: 111.65%)
  • whonix-gateway-18_socket: 7.34 🔻 ( previous job: 6.41, degradation: 114.61%)
  • whonix-gateway-18_exec-data-simplex: 35.96 🔻 ( previous job: 31.84, degradation: 112.92%)
  • whonix-workstation-18_socket: 8.01 🔻 ( previous job: 7.28, degradation: 110.12%)
  • whonix-workstation-18_socket-root: 8.01 🔻 ( previous job: 7.02, degradation: 114.13%)
  • whonix-workstation-18_exec-data-simplex: 35.07 🔻 ( previous job: 31.75, degradation: 110.44%)

Remaining performance tests:

25 tests
  • debian-13-xfce_exec: 5.78 🔻 ( previous job: 5.61, degradation: 103.14%)
  • debian-13-xfce_exec-root: 21.93 🔻 ( previous job: 20.79, degradation: 105.49%)
  • debian-13-xfce_socket: 7.05 🟢 ( previous job: 7.21, improvement: 97.83%)
  • debian-13-xfce_exec-data-simplex: 36.11 🔻 ( previous job: 33.15, degradation: 108.94%)
  • debian-13-xfce_exec-data-duplex: 32.62 🟢 ( previous job: 37.07, improvement: 87.99%)
  • debian-13-xfce_exec-data-duplex-root: 49.08 🔻 ( previous job: 46.92, degradation: 104.60%)
  • debian-13-xfce_socket-data-duplex: 55.27 🔻 ( previous job: 54.96, degradation: 100.57%)
  • fedora-42-xfce_exec-root: 41.03 🟢 ( previous job: 44.16, improvement: 92.91%)
  • fedora-42-xfce_socket: 6.66 🟢 ( previous job: 7.54, improvement: 88.29%)
  • fedora-42-xfce_socket-root: 6.82 🟢 ( previous job: 7.12, improvement: 95.79%)
  • fedora-42-xfce_exec-data-simplex: 32.05 🟢 ( previous job: 34.73, improvement: 92.28%)
  • fedora-42-xfce_exec-data-duplex: 36.03 🔻 ( previous job: 33.74, degradation: 106.78%)
  • fedora-42-xfce_exec-data-duplex-root: 60.06 🔻 ( previous job: 58.69, degradation: 102.34%)
  • fedora-42-xfce_socket-data-duplex: 59.84 🔻 ( previous job: 56.76, degradation: 105.43%)
  • whonix-gateway-18_exec: 6.02 🟢 ( previous job: 6.02, improvement: 99.98%)
  • whonix-gateway-18_exec-root: 80.15 🟢 ( previous job: 83.31, improvement: 96.20%)
  • whonix-gateway-18_socket-root: 6.93 🟢 ( previous job: 6.96, improvement: 99.64%)
  • whonix-gateway-18_exec-data-duplex: 34.97 🟢 ( previous job: 35.17, improvement: 99.46%)
  • whonix-gateway-18_exec-data-duplex-root: 77.77 🟢 ( previous job: 81.74, improvement: 95.15%)
  • whonix-gateway-18_socket-data-duplex: 55.14 🟢 ( previous job: 70.94, improvement: 77.73%)
  • whonix-workstation-18_exec: 5.81 🟢 ( previous job: 5.96, improvement: 97.47%)
  • whonix-workstation-18_exec-root: 98.82 🔻 ( previous job: 93.60, degradation: 105.57%)
  • whonix-workstation-18_exec-data-duplex: 33.77 🟢 ( previous job: 34.73, improvement: 97.23%)
  • whonix-workstation-18_exec-data-duplex-root: 92.08 🔻 ( previous job: 85.77, degradation: 107.36%)
  • whonix-workstation-18_socket-data-duplex: 56.78 🔻 ( previous job: 55.92, degradation: 101.54%)

@marmarek marmarek force-pushed the test-rc branch 2 times, most recently from b4348ff to e9dee7f Compare November 28, 2022 12:50
@marmarek marmarek changed the title version 6.1-rc1 version 6.1-rc7 Nov 28, 2022
@marmarek
Copy link
Member Author

openQArun

1 similar comment
@marmarek
Copy link
Member Author

marmarek commented Dec 2, 2022

openQArun

@marmarek
Copy link
Member Author

openQArun

@marmarek marmarek force-pushed the test-rc branch 2 times, most recently from 15c2e0b to 51b22ca Compare February 4, 2023 23:09
@marmarek
Copy link
Member Author

marmarek commented Feb 5, 2023

openQArun

@marmarek
Copy link
Member Author

marmarek commented Feb 5, 2023

openQArun

@marmarek marmarek force-pushed the test-rc branch 2 times, most recently from 0602f07 to 1817cf8 Compare March 30, 2023 07:57
@marmarek
Copy link
Member Author

openQArun

@marmarek
Copy link
Member Author

marmarek commented Apr 7, 2023

openQArun

@marmarek marmarek changed the title version 6.1-rc7 version 6.4-rc1 May 12, 2023
@marmarek
Copy link
Member Author

openQArun

@marmarek marmarek changed the title version 6.4-rc1 version 6.4-rc2 May 22, 2023
@marmarek marmarek changed the title version 6.16-rc6 version 6.17-rc2 Aug 21, 2025
@marmarek
Copy link
Member Author

openQArun

@marmarek
Copy link
Member Author

openQArun

@marmarek marmarek changed the title version 6.17-rc2 version 6.17-rc5 Sep 8, 2025
@marmarek
Copy link
Member Author

marmarek commented Sep 8, 2025

openQArun

@marmarek marmarek force-pushed the test-rc branch 2 times, most recently from f40b251 to 213ca8b Compare October 27, 2025 18:44
@marmarek marmarek changed the title version 6.17-rc5 version 6.18-rc3 Oct 27, 2025
@marmarek
Copy link
Member Author

marmarek commented Nov 1, 2025

openQArun

1 similar comment
@marmarek
Copy link
Member Author

openQArun

@marmarek marmarek force-pushed the test-rc branch 2 times, most recently from 92e8062 to 811a24a Compare November 22, 2025 18:28
@marmarek marmarek changed the title version 6.18-rc3 version 6.18-rc6 Nov 24, 2025
@marmarek
Copy link
Member Author

openQArun

@marmarek marmarek force-pushed the test-rc branch 3 times, most recently from f7374ad to ccc9c91 Compare December 26, 2025 10:59
@marmarek marmarek changed the title version 6.18-rc6 version 6.19-rc2 Dec 26, 2025
@marmarek
Copy link
Member Author

openQArun

3c7bf5af21960 "e1000e: Introduce private flag to disable K1" upstream
should be a long term workaround.
@marmarek marmarek changed the title version 6.19-rc2 version 6.19-rc3 Jan 4, 2026
@marmarek
Copy link
Member Author

marmarek commented Jan 4, 2026

openQArun

Release candidate build for testing
@marmarek
Copy link
Member Author

marmarek commented Jan 6, 2026

openQArun

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants