OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025111600-4.3&flavor=pull-requests

Test run included the following:

https://github.com/QubesOS/qubes-core-admin-client/pull/332 (https://github.com/QubesOS/qubes-core-admin-client/pull/332/commits/40487bcb59ff4a704248144f4783ce0b0e1532b8)
https://github.com/QubesOS/qubes-core-admin/pull/736 (https://github.com/QubesOS/qubes-core-admin/pull/736/commits/a3fc21c156442bb42fa5e13c994c3dfb51ba5e1c)
https://github.com/QubesOS/qubes-core-agent-linux/pull/604 (https://github.com/QubesOS/qubes-core-agent-linux/pull/604/commits/659e8e620ac8d0191f65a68db2058e4c6ee2a09d)
https://github.com/QubesOS/qubes-core-agent-windows/pull/15 (https://github.com/QubesOS/qubes-core-agent-windows/pull/15/commits/f59d7ffb46a229af5f671ca0d846d737d6e07cb2)
https://github.com/QubesOS/qubes-core-agent-windows/pull/16 (https://github.com/QubesOS/qubes-core-agent-windows/pull/16/commits/4988f40c72cc90e8ba63d930e7505ea7893a398d)
https://github.com/QubesOS/qubes-desktop-linux-i3-settings-qubes/pull/21 (https://github.com/QubesOS/qubes-desktop-linux-i3-settings-qubes/pull/21/commits/bc2319e27b26d84793190c11588e44b50d6cfa96)
https://github.com/QubesOS/qubes-gui-agent-linux/pull/251 (https://github.com/QubesOS/qubes-gui-agent-linux/pull/251/commits/3e53341a588f0704802a440afa0c4b1c3204bbdd)
https://github.com/QubesOS/qubes-gui-daemon/pull/173 (https://github.com/QubesOS/qubes-gui-daemon/pull/173/commits/d37169cd7bd2778651801e93e835e0a568d19a54)
https://github.com/QubesOS/qubes-installer-qubes-os-windows-tools/pull/10 (https://github.com/QubesOS/qubes-installer-qubes-os-windows-tools/pull/10/commits/6d011f5ddbc174cd6d138d84b3132cba382bfd9d)

Upload failures

system_tests_splitgpg
- system_tests: wait_serial (wait serial expected) # wait_serial expected: qr/ELtBH-\d+-/...
- system_tests: Failed (test died + timed out) # Test died: command 'testfunc qubes.tests.extra' timed out at qube...
system_tests_network_ipv6
- system_tests: Failed (test died) # Test died: command 'curl --form [email protected]...
system_tests_basic_vm_qrexec_gui_btrfs
- system_tests: Failed (test died) # Test died: command 'curl --form [email protected]...
system_tests_basic_vm_qrexec_gui_ext4
- system_tests: Failed (test died) # Test died: command 'curl --form [email protected]...

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025111104-4.3&flavor=update

system_tests_pvgrub_salt_storage
- TC_41_HVMGrub_debian-13-xfce: test_011_template_based_vm_dracut (error) qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
system_tests_network_updates
- TC_00_Dom0Upgrade_whonix-gateway-18: test_001_update_check (failure) ^... AssertionError: '' is not true
system_tests_audio
- TC_20_AudioVM_PipeWire_fedora-42-xfce: test_260_audio_mic_enabled_switch_audiovm (failure) AssertionError: 0 not greater than 0 : Failed to move-source-output
system_tests_audio@hw1
- TC_20_AudioVM_PipeWire_fedora-42-xfce: test_260_audio_mic_enabled_switch_audiovm (failure) AssertionError: Failed to get mic attach/detach status!
system_tests_qwt_win10@hw13
- windows_clipboard_and_filecopy: unnamed test (unknown)
- windows_clipboard_and_filecopy: Failed (test died) # Test died: no candidate needle with tag(s) 'clipboard-copy-notifi...
system_tests_qwt_win10_seamless@hw13
- windows_clipboard_and_filecopy: unnamed test (unknown)
install_default_upload@hw7
- install_do_user: unnamed test (unknown)
- install_do_user: Failed (test died) # Test died: no candidate needle with tag(s) 'installer-post-instal...
- install_do_user: wait_serial (wait serial expected) # wait_serial expected: qr/4tG2W-\d+-/...
system_tests_guivm_vnc_gui_interactive
- clipboard_and_web: unnamed test (unknown)
- clipboard_and_web: Failed (test died) # Test died: no candidate needle with tag(s) 'text-editor-save-prom...
system_tests_i3_gui_interactive
- gui_keyboard_layout: unnamed test (unknown)
- gui_keyboard_layout: Failed (test died) # Test died: no candidate needle with tag(s) 'work-xterm, work-xter...

Failed tests

19 failures

system_tests_pvgrub_salt_storage
- TC_41_HVMGrub_debian-13-xfce: test_011_template_based_vm_dracut (error) qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
system_tests_extra
- TC_00_QVCTest_whonix-gateway-18: test_010_screenshare (failure) AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...
- TC_00_QVCTest_whonix-workstation-18: test_010_screenshare (failure) AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...
system_tests_network_updates
- TC_00_Dom0Upgrade_whonix-gateway-18: test_001_update_check (failure) ^... AssertionError: '' is not true
system_tests_dispvm
- TC_20_DispVM_whonix-workstation-18: test_100_open_in_dispvm (failure) AssertionError: './open-file test.txt' failed with ./open-file test...
system_tests_audio
- TC_20_AudioVM_PipeWire_fedora-42-xfce: test_260_audio_mic_enabled_switch_audiovm (failure) AssertionError: 0 not greater than 0 : Failed to move-source-output
system_tests_audio@hw1
- TC_20_AudioVM_PipeWire_fedora-42-xfce: test_260_audio_mic_enabled_switch_audiovm (failure) AssertionError: Failed to get mic attach/detach status!
system_tests_qwt_win10@hw13
- windows_clipboard_and_filecopy: unnamed test (unknown)
- windows_clipboard_and_filecopy: Failed (test died) # Test died: no candidate needle with tag(s) 'clipboard-copy-notifi...
system_tests_qwt_win10_seamless@hw13
- windows_clipboard_and_filecopy: unnamed test (unknown)
- windows_clipboard_and_filecopy: Failed (test died) # Test died: no candidate needle with tag(s) 'clipboard-copy-notifi...
system_tests_qwt_win11@hw13
- windows_install: Failed (test died) # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
install_default_upload@hw7
- install_do_user: unnamed test (unknown)
- install_do_user: Failed (test died) # Test died: no candidate needle with tag(s) 'installer-post-instal...
- install_do_user: wait_serial (wait serial expected) # wait_serial expected: qr/4tG2W-\d+-/...
system_tests_guivm_vnc_gui_interactive
- clipboard_and_web: unnamed test (unknown)
- clipboard_and_web: Failed (test died) # Test died: no candidate needle with tag(s) 'text-editor-save-prom...
system_tests_i3_gui_interactive
- gui_keyboard_layout: unnamed test (unknown)
- gui_keyboard_layout: Failed (test died) # Test died: no candidate needle with tag(s) 'work-xterm, work-xter...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/158999#dependencies

18 fixed

system_tests_extra
- TC_00_QVCTest_debian-13-xfce: test_010_screenshare (failure + cleanup) AssertionError: 2.4614345149565264 not less than 2.0
system_tests_guivm_gui_interactive
- gui_keyboard_layout: unnamed test (unknown)
- gui_keyboard_layout: Failed (test died) # Test died: no candidate needle with tag(s) 'work-xterm, work-xter...
system_tests_dispvm
- TC_20_DispVM_whonix-workstation-18: test_030_edit_file (failure) AssertionError: Timeout waiting for editor window
system_tests_qwt_win10@hw13
- windows_install: wait_serial (wait serial expected) # wait_serial expected: qr/kauF4-\d+-/...
- windows_install: Failed (test died + timed out) # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_qwt_win10_seamless@hw13
- windows_clipboard_and_filecopy: unnamed test (unknown)
system_tests_qwt_win11@hw13
- windows_install: wait_serial (wait serial expected) # wait_serial expected: qr/iDVvW-\d+-/...
system_tests_whonix@hw7
- whonixcheck: fail (unknown) Whonixcheck for sys-whonix failed...
- whonixcheck: Failed (test died) # Test died: systemcheck failed at qubesos/tests/whonixcheck.pm lin...
system_tests_dispvm_perf@hw7
- system_tests: Fail (unknown) Tests qubes.tests.integ.dispvm_perf failed (exit code 1), details r...
- system_tests: Failed (test died) # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
- TC_00_DispVMPerf_debian-13-xfce: test_411_dom0_dispvm_preload_gui_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_900_reader (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf_reader.py --templ...
- TC_00_DispVMPerf_whonix-workstation-18: test_409_dom0_dispvm_preload_gui_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_900_reader (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf_reader.py --templ...
system_tests_guivm_vnc_gui_interactive
- gui_filecopy: unnamed test (unknown)
- gui_filecopy: Failed (test died) # Test died: no candidate needle with tag(s) 'disp-text-editor' mat...

Unstable tests

Performance Tests

Performance degradation:

18 performance degradations

debian-13-xfce_exec: 7.86 🔻 ( previous job: 6.42, degradation: 122.45%)
fedora-42-xfce_exec-data-simplex: 72.86 🔻 ( previous job: 66.18, degradation: 110.09%)
whonix-gateway-18_socket-root: 9.00 🔻 ( previous job: 7.76, degradation: 116.02%)
dom0_root_seq1m_q8t1_write 3:write_bandwidth_kb: 156299.00 🔻 ( previous job: 231269.00, degradation: 67.58%)
dom0_root_seq1m_q1t1_read 3:read_bandwidth_kb: 51516.00 🔻 ( previous job: 110619.00, degradation: 46.57%)
dom0_root_seq1m_q1t1_write 3:write_bandwidth_kb: 41606.00 🔻 ( previous job: 130397.00, degradation: 31.91%)
dom0_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 17603.00 🔻 ( previous job: 39923.00, degradation: 44.09%)
dom0_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 1775.00 🔻 ( previous job: 3264.00, degradation: 54.38%)
dom0_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 1842.00 🔻 ( previous job: 2099.00, degradation: 87.76%)
dom0_varlibqubes_seq1m_q8t1_read 3:read_bandwidth_kb: 416101.00 🔻 ( previous job: 491827.00, degradation: 84.60%)
dom0_varlibqubes_rnd4k_q32t1_write 3:write_bandwidth_kb: 8521.00 🔻 ( previous job: 10236.00, degradation: 83.25%)
dom0_varlibqubes_rnd4k_q1t1_write 3:write_bandwidth_kb: 3468.00 🔻 ( previous job: 3936.00, degradation: 88.11%)
fedora-42-xfce_root_seq1m_q8t1_write 3:write_bandwidth_kb: 110242.00 🔻 ( previous job: 137220.00, degradation: 80.34%)
fedora-42-xfce_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 1942.00 🔻 ( previous job: 3964.00, degradation: 48.99%)
fedora-42-xfce_private_seq1m_q1t1_read 3:read_bandwidth_kb: 266136.00 🔻 ( previous job: 351871.00, degradation: 75.63%)
fedora-42-xfce_volatile_seq1m_q8t1_write 3:write_bandwidth_kb: 46036.00 🔻 ( previous job: 140939.00, degradation: 32.66%)
fedora-42-xfce_volatile_seq1m_q1t1_write 3:write_bandwidth_kb: 39479.00 🔻 ( previous job: 46842.00, degradation: 84.28%)
fedora-42-xfce_volatile_rnd4k_q1t1_write 3:write_bandwidth_kb: 459.00 🔻 ( previous job: 861.00, degradation: 53.31%)

Remaining performance tests:

54 tests

debian-13-xfce_exec-root: 27.74 🔻 ( previous job: 27.48, degradation: 100.93%)
debian-13-xfce_socket: 8.61 🟢 ( previous job: 8.68, improvement: 99.24%)
debian-13-xfce_socket-root: 8.53 🔻 ( previous job: 8.40, degradation: 101.53%)
debian-13-xfce_exec-data-simplex: 68.88 🔻 ( previous job: 67.70, degradation: 101.75%)
debian-13-xfce_exec-data-duplex: 70.07 🔻 ( previous job: 69.20, degradation: 101.26%)
debian-13-xfce_exec-data-duplex-root: 82.62 🟢 ( previous job: 86.64, improvement: 95.36%)
debian-13-xfce_socket-data-duplex: 130.79 🟢 ( previous job: 136.31, improvement: 95.95%)
fedora-42-xfce_exec: 9.27 🔻 ( previous job: 9.23, degradation: 100.50%)
fedora-42-xfce_exec-root: 58.77 🟢 ( previous job: 59.89, improvement: 98.13%)
fedora-42-xfce_socket: 8.51 🔻 ( previous job: 8.23, degradation: 103.30%)
fedora-42-xfce_socket-root: 7.97 🟢 ( previous job: 8.31, improvement: 95.92%)
fedora-42-xfce_exec-data-duplex: 70.79 🟢 ( previous job: 71.51, improvement: 99.01%)
fedora-42-xfce_exec-data-duplex-root: 93.16 🟢 ( previous job: 96.52, improvement: 96.52%)
fedora-42-xfce_socket-data-duplex: 139.89 🔻 ( previous job: 137.78, degradation: 101.53%)
whonix-gateway-18_exec: 8.18 🟢 ( previous job: 8.52, improvement: 96.02%)
whonix-gateway-18_exec-root: 128.59 🟢 ( previous job: 129.05, improvement: 99.65%)
whonix-gateway-18_socket: 8.20 🟢 ( previous job: 8.26, improvement: 99.21%)
whonix-gateway-18_exec-data-simplex: 69.23 🟢 ( previous job: 73.13, improvement: 94.68%)
whonix-gateway-18_exec-data-duplex: 72.70 🔻 ( previous job: 71.98, degradation: 101.01%)
whonix-gateway-18_exec-data-duplex-root: 139.97 🟢 ( previous job: 146.68, improvement: 95.43%)
whonix-gateway-18_socket-data-duplex: 139.72 🟢 ( previous job: 142.71, improvement: 97.91%)
whonix-workstation-18_exec: 8.28 🟢 ( previous job: 8.85, improvement: 93.53%)
whonix-workstation-18_exec-root: 138.92 🟢 ( previous job: 149.84, improvement: 92.71%)
whonix-workstation-18_socket: 9.55 🔻 ( previous job: 9.12, degradation: 104.68%)
whonix-workstation-18_socket-root: 8.83 🔻 ( previous job: 8.75, degradation: 100.93%)
whonix-workstation-18_exec-data-simplex: 63.14 🟢 ( previous job: 67.02, improvement: 94.21%)
whonix-workstation-18_exec-data-duplex: 71.90 🔻 ( previous job: 69.25, degradation: 103.83%)
whonix-workstation-18_exec-data-duplex-root: 144.75 🟢 ( previous job: 146.32, improvement: 98.93%)
whonix-workstation-18_socket-data-duplex: 131.77 🟢 ( previous job: 139.15, improvement: 94.70%)
dom0_root_seq1m_q8t1_read 3:read_bandwidth_kb: 418927.00 🟢 ( previous job: 365230.00, improvement: 114.70%)
dom0_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 12113.00 🟢 ( previous job: 12000.00, improvement: 100.94%)
dom0_varlibqubes_seq1m_q8t1_write 3:write_bandwidth_kb: 115842.00 🟢 ( previous job: 103611.00, improvement: 111.80%)
dom0_varlibqubes_seq1m_q1t1_read 3:read_bandwidth_kb: 404543.00 🔻 ( previous job: 432938.00, degradation: 93.44%)
dom0_varlibqubes_seq1m_q1t1_write 3:write_bandwidth_kb: 199814.00 🟢 ( previous job: 143368.00, improvement: 139.37%)
dom0_varlibqubes_rnd4k_q32t1_read 3:read_bandwidth_kb: 107756.00 🟢 ( previous job: 103977.00, improvement: 103.63%)
dom0_varlibqubes_rnd4k_q1t1_read 3:read_bandwidth_kb: 7594.00 🔻 ( previous job: 8300.00, degradation: 91.49%)
fedora-42-xfce_root_seq1m_q8t1_read 3:read_bandwidth_kb: 397639.00 🟢 ( previous job: 346866.00, improvement: 114.64%)
fedora-42-xfce_root_seq1m_q1t1_read 3:read_bandwidth_kb: 328501.00 🔻 ( previous job: 355690.00, degradation: 92.36%)
fedora-42-xfce_root_seq1m_q1t1_write 3:write_bandwidth_kb: 64971.00 🟢 ( previous job: 26931.00, improvement: 241.25%)
fedora-42-xfce_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 84299.00 🔻 ( previous job: 85360.00, degradation: 98.76%)
fedora-42-xfce_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 8519.00 🔻 ( previous job: 8945.00, degradation: 95.24%)
fedora-42-xfce_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 1091.00 🟢 ( previous job: 457.00, improvement: 238.73%)
fedora-42-xfce_private_seq1m_q8t1_read 3:read_bandwidth_kb: 394795.00 🟢 ( previous job: 371835.00, improvement: 106.17%)
fedora-42-xfce_private_seq1m_q8t1_write 3:write_bandwidth_kb: 197532.00 🟢 ( previous job: 108858.00, improvement: 181.46%)
fedora-42-xfce_private_seq1m_q1t1_write 3:write_bandwidth_kb: 73200.00 🟢 ( previous job: 49472.00, improvement: 147.96%)
fedora-42-xfce_private_rnd4k_q32t1_read 3:read_bandwidth_kb: 85430.00 🟢 ( previous job: 75326.00, improvement: 113.41%)
fedora-42-xfce_private_rnd4k_q32t1_write 3:write_bandwidth_kb: 1970.00 🟢 ( previous job: 1909.00, improvement: 103.20%)
fedora-42-xfce_private_rnd4k_q1t1_read 3:read_bandwidth_kb: 9694.00 🟢 ( previous job: 8365.00, improvement: 115.89%)
fedora-42-xfce_private_rnd4k_q1t1_write 3:write_bandwidth_kb: 1167.00 🟢 ( previous job: 517.00, improvement: 225.73%)
fedora-42-xfce_volatile_seq1m_q8t1_read 3:read_bandwidth_kb: 364468.00 🟢 ( previous job: 361328.00, improvement: 100.87%)
fedora-42-xfce_volatile_seq1m_q1t1_read 3:read_bandwidth_kb: 325139.00 🔻 ( previous job: 349176.00, degradation: 93.12%)
fedora-42-xfce_volatile_rnd4k_q32t1_read 3:read_bandwidth_kb: 84631.00 🟢 ( previous job: 79581.00, improvement: 106.35%)
fedora-42-xfce_volatile_rnd4k_q32t1_write 3:write_bandwidth_kb: 2430.00 🟢 ( previous job: 2110.00, improvement: 115.17%)
fedora-42-xfce_volatile_rnd4k_q1t1_read 3:read_bandwidth_kb: 7014.00 🔻 ( previous job: 7708.00, degradation: 91.00%)

Oct 14 '25 22:10 qubesos-bot

system_tests: Failed (test died) # Test died: command 'curl --form [email protected]...

Test results were not uploaded.

Oct 15 '25 05:10 ben-grande

qubes-core-admin
qubes-core-admin copied to clipboard

tests: log more info on failure

OpenQA test summary

Upload failures

New failures, excluding unstable

Failed tests

Fixed failures

Unstable tests

Performance Tests

Performance degradation:

Remaining performance tests:

qubes-core-admin qubes-core-admin copied to clipboard

tests: log more info on failure

OpenQA test summary

Upload failures

New failures, excluding unstable

Failed tests

Fixed failures

Unstable tests

Performance Tests

Performance degradation:

Remaining performance tests:

qubes-core-admin
qubes-core-admin copied to clipboard