Fixes: https://github.com/QubesOS/qubes-issues/issues/10227 For: https://github.com/QubesOS/qubes-issues/issues/1512

Missing some tests.

PR is based on top of:

https://github.com/QubesOS/qubes-core-admin/pull/748

Sep 16 '25 12:09 ben-grande

CI says typo:

AttributeError: 'DispVM' object has no attribute 'is_prelaod'. Did you mean: 'is_preload'?

Sep 16 '25 21:09 marmarek

Codecov Report

:x: Patch coverage is 87.35632% with 11 lines in your changes missing coverage. Please review. :white_check_mark: Project coverage is 70.70%. Comparing base (335c908) to head (67b8fcb). :warning: Report is 12 commits behind head on main.

Files with missing lines	Patch %	Lines
qubes/vm/mix/dvmtemplate.py	88.70%	7 Missing :warning:
qubes/vm/dispvm.py	63.63%	4 Missing :warning:

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #733      +/-   ##
==========================================
+ Coverage   70.43%   70.70%   +0.26%     
==========================================
  Files          61       61              
  Lines       13755    13814      +59     
==========================================
+ Hits         9689     9767      +78     
+ Misses       4066     4047      -19

Flag	Coverage Δ
unittests	`70.70% <87.35%> (+0.26%)`	:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:

:snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sep 17 '25 05:09 codecov[bot]

Are integration tests necessary seen that coverage is high?

Sep 17 '25 17:09 ben-grande

mypy is not happy

Oct 26 '25 00:10 marmarek

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025110513-4.3&flavor=pull-requests

Test run included the following:

https://github.com/QubesOS/qubes-app-linux-usb-proxy/pull/51 (https://github.com/QubesOS/qubes-app-linux-usb-proxy/pull/51/commits/c643e601b9864517a4c4c1531721501ab961157c)
https://github.com/QubesOS/qubes-core-admin-client/pull/332 (https://github.com/QubesOS/qubes-core-admin-client/pull/332/commits/40487bcb59ff4a704248144f4783ce0b0e1532b8)
https://github.com/QubesOS/qubes-core-admin-client/pull/390 (https://github.com/QubesOS/qubes-core-admin-client/pull/390/commits/7ba9e48da005dcebc4b195b9e4c0983320d5a2d5)
https://github.com/QubesOS/qubes-core-admin-client/pull/393 (https://github.com/QubesOS/qubes-core-admin-client/pull/393/commits/1510d25a75b01dff82c50aa72f1bf7ebb83b1f07)
https://github.com/QubesOS/qubes-core-admin-client/pull/394 (https://github.com/QubesOS/qubes-core-admin-client/pull/394/commits/537080349eba19688db17292d3860d9123e89759)
https://github.com/QubesOS/qubes-core-admin/pull/733 (https://github.com/QubesOS/qubes-core-admin/pull/733/commits/67b8fcb6b7116e987c2272e93d2a9b513764b7e5)
https://github.com/QubesOS/qubes-core-admin/pull/736 (https://github.com/QubesOS/qubes-core-admin/pull/736/commits/a3fc21c156442bb42fa5e13c994c3dfb51ba5e1c)
https://github.com/QubesOS/qubes-core-admin/pull/747 (https://github.com/QubesOS/qubes-core-admin/pull/747/commits/c139c35c38603f2c7b79d914d546ff49a3b87677)
https://github.com/QubesOS/qubes-core-admin/pull/748 (https://github.com/QubesOS/qubes-core-admin/pull/748/commits/f1cbf21598178959708045125f95e261bcb3772a)
https://github.com/QubesOS/qubes-core-admin/pull/749 (https://github.com/QubesOS/qubes-core-admin/pull/749/commits/fd8dc06a59a72e5c05c82c6c42d77fd77f834cd0)
https://github.com/QubesOS/qubes-core-agent-linux/pull/604 (https://github.com/QubesOS/qubes-core-agent-linux/pull/604/commits/659e8e620ac8d0191f65a68db2058e4c6ee2a09d)
https://github.com/QubesOS/qubes-core-agent-linux/pull/620 (https://github.com/QubesOS/qubes-core-agent-linux/pull/620/commits/3d75a220a693eb8489d0e4c57c82628a158c2c20)
https://github.com/QubesOS/qubes-desktop-linux-i3-settings-qubes/pull/21 (https://github.com/QubesOS/qubes-desktop-linux-i3-settings-qubes/pull/21/commits/c2bb4f196c50fbfdd57bfe2e4ae93319341c19f6)
https://github.com/QubesOS/qubes-gui-agent-linux/pull/248 (https://github.com/QubesOS/qubes-gui-agent-linux/pull/248/commits/e50583a711e75139a07ead2eb0a06c4803fde26a)
https://github.com/QubesOS/qubes-mgmt-salt-dom0-virtual-machines/pull/86 (https://github.com/QubesOS/qubes-mgmt-salt-dom0-virtual-machines/pull/86/commits/d5806deaef3de18f561de3437a2703ccba4712e8)

Upload failures

system_tests_dispvm
- system_tests: Fail (unknown) Tests qubes.tests.integ.dispvm failed (exit code 1), details report...
- system_tests: Failed (test died) # Test died: command 'curl --form [email protected]...
system_tests_basic_vm_qrexec_gui_ext4
- system_tests: Failed (test died) # Test died: command 'curl --form [email protected] --form up...

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025081011-4.3&flavor=update

system_tests_whonix
- whonixcheck: fail (unknown) Whonixcheck for sys-whonix failed...
- whonixcheck: Failed (test died) # Test died: systemcheck failed at qubesos/tests/whonixcheck.pm lin...
system_tests_extra
- TC_00_QVCTest_whonix-gateway-18: test_010_screenshare (failure) AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...
- TC_00_QVCTest_whonix-workstation-18: test_010_screenshare (failure) AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...
system_tests_usbproxy
- TC_30_USBProxy_core3: test_010_on_qdb_change_multiple_assignments_including_full (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_011_on_qdb_change_multiple_assignments_port_vs_dev (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_012_on_qdb_change_multiple_assignments_dev (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_020_on_startup_multiple_assignments_including_full (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_021_on_startup_multiple_assignments_port_vs_dev (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_022_on_startup_multiple_assignments_dev (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_023_on_startup_already_attached (error) AttributeError: 'TestVM' object has no attribute 'uuid'
system_tests_whonix@hw7
- whonixcheck: fail (unknown) Whonixcheck for sys-whonix failed...
- whonixcheck: Failed (test died) # Test died: systemcheck failed at qubesos/tests/whonixcheck.pm lin...
system_tests_qwt_win10_seamless@hw13
- windows_install: Failed (test died) # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_qwt_win11@hw13
- windows_install: wait_serial (wait serial expected) # wait_serial expected: qr/iDVvW-\d+-/...
- windows_install: Failed (test died + timed out) # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_dispvm_perf@hw7
- TC_00_DispVMPerf_whonix-workstation-18: test_002_vm_dispvm_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_008_dom0_dispvm_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_009_dom0_dispvm_gui_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_402_dom0_dispvm_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_409_dom0_dispvm_preload_gui_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_900_reader (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf_reader.py --templ...
system_tests_guivm_vnc_gui_interactive
- clipboard_and_web: unnamed test (unknown)
- clipboard_and_web: Failed (test died) # Test died: no candidate needle with tag(s) 'personal-firefox' mat...

Failed tests

24 failures

system_tests_whonix
- whonixcheck: fail (unknown) Whonixcheck for sys-whonix failed...
- whonixcheck: Failed (test died) # Test died: systemcheck failed at qubesos/tests/whonixcheck.pm lin...
system_tests_extra
- TC_00_QVCTest_whonix-gateway-18: test_010_screenshare (failure) AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...
- TC_00_QVCTest_whonix-workstation-18: test_010_screenshare (failure) AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...
system_tests_usbproxy
- TC_30_USBProxy_core3: test_010_on_qdb_change_multiple_assignments_including_full (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_011_on_qdb_change_multiple_assignments_port_vs_dev (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_012_on_qdb_change_multiple_assignments_dev (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_020_on_startup_multiple_assignments_including_full (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_021_on_startup_multiple_assignments_port_vs_dev (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_022_on_startup_multiple_assignments_dev (error) AttributeError: 'TestVM' object has no attribute 'uuid'
- TC_30_USBProxy_core3: test_023_on_startup_already_attached (error) AttributeError: 'TestVM' object has no attribute 'uuid'
system_tests_whonix@hw7
- whonixcheck: fail (unknown) Whonixcheck for sys-whonix failed...
- whonixcheck: Failed (test died) # Test died: systemcheck failed at qubesos/tests/whonixcheck.pm lin...
system_tests_qwt_win10_seamless@hw13
- windows_install: Failed (test died) # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_qwt_win11@hw13
- windows_install: wait_serial (wait serial expected) # wait_serial expected: qr/iDVvW-\d+-/...
- windows_install: Failed (test died + timed out) # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_dispvm_perf@hw7
- TC_00_DispVMPerf_whonix-workstation-18: test_002_vm_dispvm_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_008_dom0_dispvm_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_009_dom0_dispvm_gui_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_402_dom0_dispvm_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_409_dom0_dispvm_preload_gui_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-18: test_900_reader (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf_reader.py --templ...
system_tests_guivm_vnc_gui_interactive
- clipboard_and_web: unnamed test (unknown)
- clipboard_and_web: Failed (test died) # Test died: no candidate needle with tag(s) 'personal-firefox' mat...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/149225#dependencies

81 fixed

system_tests_extra
- TC_00_QVCTest_whonix-workstation-17: test_010_screenshare (failure) AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...
system_tests_dispvm
- TC_20_DispVM_debian-13-xfce: test_012_preload_low_mem (failure) ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1 != 0
- TC_20_DispVM_debian-13-xfce: test_013_preload_gui (error) raise KeyError(key)... KeyError: 'disp3723'
- TC_20_DispVM_debian-13-xfce: test_014_preload_nogui (error + cleanup) raise TimeoutError from exc_val... TimeoutError
- TC_20_DispVM_debian-13-xfce: test_015_preload_race_more (error + cleanup) raise KeyError(key)... KeyError: 'disp1187'
- TC_20_DispVM_debian-13-xfce: test_016_preload_race_less (failure + cleanup) ^^^^^^^^^^^^^^^^^^^^^^... AssertionError
- TC_20_DispVM_debian-13-xfce: test_017_preload_autostart (error) raise KeyError(key)... KeyError: 'disp7317'
- TC_20_DispVM_debian-13-xfce: test_018_preload_global (error) raise KeyError(key)... KeyError: 'disp8572'
- TC_20_DispVM_debian-13-xfce: test_019_preload_refresh (error) raise KeyError(key)... KeyError: 'disp6425'
- TC_20_DispVM_fedora-42-xfce: test_012_preload_low_mem (failure) ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1 != 0
- TC_20_DispVM_whonix-workstation-17: test_012_preload_low_mem (failure) ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1 != 0
system_tests_kde_gui_interactive
- gui_keyboard_layout: wait_serial (wait serial expected) # wait_serial expected: "echo -e '[Layout]\nLayoutList=us,de' | sud...
- gui_keyboard_layout: Failed (test died) # Test died: command 'test "$(cd ~user;ls e1*)" = "$(qvm-run -p wor...
system_tests_audio
- system_tests: Fail (unknown) Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
- system_tests: Failed (test died) # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
- TC_20_AudioVM_Pulse_whonix-workstation-17: test_223_audio_play_hvm (error) qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_20_AudioVM_Pulse_whonix-workstation-17: test_224_audio_rec_muted_hvm (error) qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_20_AudioVM_Pulse_whonix-workstation-17: test_225_audio_rec_unmuted_hvm (error) qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_20_AudioVM_Pulse_whonix-workstation-17: test_252_audio_playback_audiovm_switch_hvm (error) qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
system_tests_audio@hw1
- system_tests: Fail (unknown) Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
- system_tests: Failed (test died) # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
- TC_20_AudioVM_Pulse_whonix-workstation-17: test_223_audio_play_hvm (error) qubes.exc.QubesVMError: Cannot connect to qrexec agent for 60 secon...
- TC_20_AudioVM_Pulse_whonix-workstation-17: test_224_audio_rec_muted_hvm (error) qubes.exc.QubesVMError: Cannot connect to qrexec agent for 60 secon...
- TC_20_AudioVM_Pulse_whonix-workstation-17: test_252_audio_playback_audiovm_switch_hvm (error) qubes.exc.QubesVMError: Cannot connect to qrexec agent for 60 secon...
system_tests_dispvm_perf@hw7
- system_tests: wait_serial (wait serial expected) # wait_serial expected: qr/D2qNh-\d+-/...
- TC_00_DispVMPerf_debian-13-xfce: test_000_dispvm (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_002_dispvm_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_006_dispvm_from_dom0 (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_008_dispvm_from_dom0_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_020_dispvm_preload (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_021_dispvm_preload_gui (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_022_dispvm_preload_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_023_dispvm_preload_gui_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_026_dispvm_from_dom0_preload (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_027_dispvm_from_dom0_preload_gui (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_028_dispvm_from_dom0_preload_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_029_dispvm_from_dom0_preload_gui_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_400_dispvm_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_402_dispvm_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_404_dispvm_preload_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_404_dispvm_preload_less_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_404_dispvm_preload_more_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_405_dispvm_preload_gui_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_406_dispvm_preload_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_407_dispvm_preload_gui_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_900_vm (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_902_vm_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_904_vm_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_debian-13-xfce: test_906_vm_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_020_dispvm_preload (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_021_dispvm_preload_gui (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_022_dispvm_preload_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_023_dispvm_preload_gui_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_026_dispvm_from_dom0_preload (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_027_dispvm_from_dom0_preload_gui (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_028_dispvm_from_dom0_preload_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_029_dispvm_from_dom0_preload_gui_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_404_dispvm_preload_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_404_dispvm_preload_less_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_404_dispvm_preload_more_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_405_dispvm_preload_gui_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_406_dispvm_preload_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_fedora-42-xfce: test_407_dispvm_preload_gui_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_020_dispvm_preload (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_021_dispvm_preload_gui (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_022_dispvm_preload_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_023_dispvm_preload_gui_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_026_dispvm_from_dom0_preload (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_027_dispvm_from_dom0_preload_gui (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_028_dispvm_from_dom0_preload_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_029_dispvm_from_dom0_preload_gui_concurrent (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_404_dispvm_preload_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_404_dispvm_preload_less_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_404_dispvm_preload_more_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_405_dispvm_preload_gui_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_406_dispvm_preload_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
- TC_00_DispVMPerf_whonix-workstation-17: test_407_dispvm_preload_gui_concurrent_api (failure) AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
system_tests_guivm_gpu_gui_interactive@hw13
- guivm_startup: wait_serial (wait serial expected) # wait_serial expected: qr/lEcbc-\d+-/...
- guivm_startup: Failed (test died + timed out) # Test died: command '! qvm-check sys-whonix || time qvm-start sys-...
system_tests_basic_vm_qrexec_gui_ext4
- system_tests: Fail (unknown) Tests qubes.tests.integ.vm_qrexec_gui failed (exit code 1), details...
- TC_20_NonAudio_whonix-gateway-17-pool: test_012_qubes_desktop_run (error + cleanup) raise TimeoutError from exc_val... TimeoutError

Unstable tests

Performance Tests

Performance degradation:

18 performance degradations

dom0_root_seq1m_q8t1_write 3:write_bandwidth_kb: 86415.00 🔻 ( previous job: 265260.00, degradation: 32.58%)
dom0_root_seq1m_q1t1_read 3:read_bandwidth_kb: 170427.00 🔻 ( previous job: 431512.00, degradation: 39.50%)
dom0_root_seq1m_q1t1_write 3:write_bandwidth_kb: 100091.00 🔻 ( previous job: 196254.00, degradation: 51.00%)
dom0_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 13637.00 🔻 ( previous job: 23940.00, degradation: 56.96%)
dom0_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 2090.00 🔻 ( previous job: 2446.00, degradation: 85.45%)
fedora-42-xfce_root_seq1m_q8t1_write 3:write_bandwidth_kb: 117773.00 🔻 ( previous job: 140215.00, degradation: 83.99%)
fedora-42-xfce_root_seq1m_q1t1_read 3:read_bandwidth_kb: 224968.00 🔻 ( previous job: 299764.00, degradation: 75.05%)
fedora-42-xfce_root_seq1m_q1t1_write 3:write_bandwidth_kb: 32680.00 🔻 ( previous job: 47575.00, degradation: 68.69%)
fedora-42-xfce_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 2496.00 🔻 ( previous job: 3020.00, degradation: 82.65%)
fedora-42-xfce_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 871.00 🔻 ( previous job: 1368.00, degradation: 63.67%)
fedora-42-xfce_private_seq1m_q8t1_write 3:write_bandwidth_kb: 79735.00 🔻 ( previous job: 136640.00, degradation: 58.35%)
fedora-42-xfce_private_seq1m_q1t1_read 3:read_bandwidth_kb: 223529.00 🔻 ( previous job: 325139.00, degradation: 68.75%)
fedora-42-xfce_private_seq1m_q1t1_write 3:write_bandwidth_kb: 64089.00 🔻 ( previous job: 79539.00, degradation: 80.58%)
fedora-42-xfce_private_rnd4k_q32t1_write 3:write_bandwidth_kb: 1946.00 🔻 ( previous job: 3765.00, degradation: 51.69%)
fedora-42-xfce_private_rnd4k_q1t1_read 3:read_bandwidth_kb: 7799.00 🔻 ( previous job: 8992.00, degradation: 86.73%)
fedora-42-xfce_private_rnd4k_q1t1_write 3:write_bandwidth_kb: 500.00 🔻 ( previous job: 1251.00, degradation: 39.97%)
fedora-42-xfce_volatile_seq1m_q8t1_read 3:read_bandwidth_kb: 343232.00 🔻 ( previous job: 383531.00, degradation: 89.49%)
fedora-42-xfce_volatile_seq1m_q1t1_write 3:write_bandwidth_kb: 45374.00 🔻 ( previous job: 64217.00, degradation: 70.66%)

Remaining performance tests:

157 tests

debian-13-xfce_exec: 8.00 🟢 ( previous job: 8.36, improvement: 95.66%)
debian-13-xfce_exec-root: 27.83 🔻 ( previous job: 27.36, degradation: 101.71%)
debian-13-xfce_socket: 8.54 🟢 ( previous job: 8.57, improvement: 99.59%)
debian-13-xfce_socket-root: 8.43 🔻 ( previous job: 8.26, degradation: 102.03%)
debian-13-xfce_exec-data-simplex: 66.03 🟢 ( previous job: 72.43, improvement: 91.17%)
debian-13-xfce_exec-data-duplex: 68.92 🟢 ( previous job: 76.65, improvement: 89.92%)
debian-13-xfce_exec-data-duplex-root: 83.49 🟢 ( previous job: 91.79, improvement: 90.96%)
debian-13-xfce_socket-data-duplex: 129.44 🟢 ( previous job: 133.45, improvement: 97.00%)
fedora-42-xfce_exec: 9.12 🔻 ( previous job: 9.06, degradation: 100.61%)
fedora-42-xfce_exec-root: 59.95 🔻 ( previous job: 58.19, degradation: 103.02%)
fedora-42-xfce_socket: 8.23 🟢 ( previous job: 8.48, improvement: 97.06%)
fedora-42-xfce_socket-root: 8.15 🟢 ( previous job: 8.18, improvement: 99.65%)
fedora-42-xfce_exec-data-simplex: 64.02 🟢 ( previous job: 78.48, improvement: 81.58%)
fedora-42-xfce_exec-data-duplex: 68.05 🔻 ( previous job: 67.92, degradation: 100.19%)
fedora-42-xfce_exec-data-duplex-root: 96.98 🔻 ( previous job: 96.36, degradation: 100.64%)
fedora-42-xfce_socket-data-duplex: 133.19 🟢 ( previous job: 142.58, improvement: 93.41%)
whonix-gateway-18_exec: 7.59
whonix-gateway-18_exec-root: 142.22
whonix-gateway-18_socket: 8.00
whonix-gateway-18_socket-root: 8.28
whonix-gateway-18_exec-data-simplex: 66.63
whonix-gateway-18_exec-data-duplex: 75.15
whonix-gateway-18_exec-data-duplex-root: 145.39
whonix-gateway-18_socket-data-duplex: 144.97
whonix-workstation-18_exec: 8.59
whonix-workstation-18_exec-root: 139.20
whonix-workstation-18_socket: 9.51
whonix-workstation-18_socket-root: 9.16
whonix-workstation-18_exec-data-simplex: 68.73
whonix-workstation-18_exec-data-duplex: 72.67
whonix-workstation-18_exec-data-duplex-root: 147.67
whonix-workstation-18_socket-data-duplex: 135.77
dom0_root_seq1m_q8t1_read 3:read_bandwidth_kb: 479020.00 🔻 ( previous job: 497426.00, degradation: 96.30%)
dom0_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 12193.00 🟢 ( previous job: 5874.00, improvement: 207.58%)
dom0_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 4439.00 🟢 ( previous job: 29.00, improvement: 15306.90%)
dom0_varlibqubes_seq1m_q8t1_read 3:read_bandwidth_kb: 445255.00 🟢 ( previous job: 292489.00, improvement: 152.23%)
dom0_varlibqubes_seq1m_q8t1_write 3:write_bandwidth_kb: 161989.00 🟢 ( previous job: 110817.00, improvement: 146.18%)
dom0_varlibqubes_seq1m_q1t1_read 3:read_bandwidth_kb: 428514.00 🟢 ( previous job: 137802.00, improvement: 310.96%)
dom0_varlibqubes_seq1m_q1t1_write 3:write_bandwidth_kb: 187964.00 🟢 ( previous job: 121719.00, improvement: 154.42%)
dom0_varlibqubes_rnd4k_q32t1_read 3:read_bandwidth_kb: 100979.00 🔻 ( previous job: 103932.00, degradation: 97.16%)
dom0_varlibqubes_rnd4k_q32t1_write 3:write_bandwidth_kb: 9198.00 🟢 ( previous job: 6356.00, improvement: 144.71%)
dom0_varlibqubes_rnd4k_q1t1_read 3:read_bandwidth_kb: 8196.00 🟢 ( previous job: 7695.00, improvement: 106.51%)
dom0_varlibqubes_rnd4k_q1t1_write 3:write_bandwidth_kb: 4867.00 🟢 ( previous job: 3925.00, improvement: 124.00%)
fedora-42-xfce_root_seq1m_q8t1_read 3:read_bandwidth_kb: 415606.00 🟢 ( previous job: 366891.00, improvement: 113.28%)
fedora-42-xfce_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 81172.00 🔻 ( previous job: 86001.00, degradation: 94.38%)
fedora-42-xfce_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 8203.00 🔻 ( previous job: 9042.00, degradation: 90.72%)
fedora-42-xfce_private_seq1m_q8t1_read 3:read_bandwidth_kb: 383672.00 🔻 ( previous job: 387500.00, degradation: 99.01%)
fedora-42-xfce_private_rnd4k_q32t1_read 3:read_bandwidth_kb: 83788.00 🔻 ( previous job: 87396.00, degradation: 95.87%)
fedora-42-xfce_volatile_seq1m_q8t1_write 3:write_bandwidth_kb: 143908.00 🔻 ( previous job: 157382.00, degradation: 91.44%)
fedora-42-xfce_volatile_seq1m_q1t1_read 3:read_bandwidth_kb: 311705.00 🟢 ( previous job: 293225.00, improvement: 106.30%)
fedora-42-xfce_volatile_rnd4k_q32t1_read 3:read_bandwidth_kb: 87922.00 🟢 ( previous job: 87141.00, improvement: 100.90%)
fedora-42-xfce_volatile_rnd4k_q32t1_write 3:write_bandwidth_kb: 3802.00 🔻 ( previous job: 4098.00, degradation: 92.78%)
fedora-42-xfce_volatile_rnd4k_q1t1_read 3:read_bandwidth_kb: 8237.00 🔻 ( previous job: 8804.00, degradation: 93.56%)
fedora-42-xfce_volatile_rnd4k_q1t1_write 3:write_bandwidth_kb: 2619.00 🟢 ( previous job: 2384.00, improvement: 109.86%)
debian-13-xfce_vm-dispvm (mean:6.595): 79.14
debian-13-xfce_vm-dispvm-gui (mean:7.213): 86.55
debian-13-xfce_vm-dispvm-concurrent (mean:3.446): 41.35
debian-13-xfce_vm-dispvm-gui-concurrent (mean:4.021): 48.25
debian-13-xfce_dom0-dispvm (mean:6.848): 82.17
debian-13-xfce_dom0-dispvm-gui (mean:7.953): 95.43
debian-13-xfce_dom0-dispvm-concurrent (mean:3.416): 41.00
debian-13-xfce_dom0-dispvm-gui-concurrent (mean:4.34): 52.08
debian-13-xfce_vm-dispvm-preload (mean:2.791): 33.50
debian-13-xfce_vm-dispvm-preload-gui (mean:3.99): 47.88
debian-13-xfce_vm-dispvm-preload-concurrent (mean:2.636): 31.63
debian-13-xfce_vm-dispvm-preload-gui-concurrent (mean:3.39): 40.68
debian-13-xfce_dom0-dispvm-preload (mean:3.55): 42.60
debian-13-xfce_dom0-dispvm-preload-gui (mean:4.406): 52.88
debian-13-xfce_dom0-dispvm-preload-concurrent (mean:3.344): 40.13
debian-13-xfce_dom0-dispvm-preload-gui-concurrent (mean:3.823): 45.88
debian-13-xfce_dom0-dispvm-api (mean:7.073): 84.88
debian-13-xfce_dom0-dispvm-gui-api (mean:8.169): 98.03
debian-13-xfce_dom0-dispvm-concurrent-api (mean:3.154): 37.85
debian-13-xfce_dom0-dispvm-gui-concurrent-api (mean:4.046): 48.56
debian-13-xfce_dom0-dispvm-preload-less-less-api (mean:3.663): 43.95
debian-13-xfce_dom0-dispvm-preload-less-api (mean:3.792): 45.50
debian-13-xfce_dom0-dispvm-preload-api (mean:3.652): 43.83
debian-13-xfce_dom0-dispvm-preload-more-api (mean:3.387): 40.65
debian-13-xfce_dom0-dispvm-preload-more-more-api (mean:3.724): 44.69
debian-13-xfce_dom0-dispvm-preload-gui-api (mean:4.51): 54.12
debian-13-xfce_dom0-dispvm-preload-concurrent-api (mean:2.876): 34.51
debian-13-xfce_dom0-dispvm-preload-gui-concurrent-api (mean:3.833): 45.99
debian-13-xfce_vm-vm (mean:0.033): 0.39
debian-13-xfce_vm-vm-gui (mean:0.033): 0.40
debian-13-xfce_vm-vm-concurrent (mean:0.019): 0.23
debian-13-xfce_vm-vm-gui-concurrent (mean:0.026): 0.31
debian-13-xfce_dom0-vm-api (mean:0.04): 0.48
debian-13-xfce_dom0-vm-gui-api (mean:0.048): 0.58
debian-13-xfce_dom0-vm-concurrent-api (mean:0.03): 0.36
debian-13-xfce_dom0-vm-gui-concurrent-api (mean:0.033): 0.40
fedora-42-xfce_vm-dispvm (mean:7.026): 84.32
fedora-42-xfce_vm-dispvm-gui (mean:8.224): 98.69
fedora-42-xfce_vm-dispvm-concurrent (mean:3.626): 43.51
fedora-42-xfce_vm-dispvm-gui-concurrent (mean:4.356): 52.28
fedora-42-xfce_dom0-dispvm (mean:7.502): 90.02
fedora-42-xfce_dom0-dispvm-gui (mean:8.736): 104.84
fedora-42-xfce_dom0-dispvm-concurrent (mean:3.756): 45.07
fedora-42-xfce_dom0-dispvm-gui-concurrent (mean:4.641): 55.69
fedora-42-xfce_vm-dispvm-preload (mean:3.082): 36.98
fedora-42-xfce_vm-dispvm-preload-gui (mean:6.558): 78.69
fedora-42-xfce_vm-dispvm-preload-concurrent (mean:2.923): 35.08
fedora-42-xfce_vm-dispvm-preload-gui-concurrent (mean:5.069): 60.83
fedora-42-xfce_dom0-dispvm-preload (mean:3.748): 44.97
fedora-42-xfce_dom0-dispvm-preload-gui (mean:5.057): 60.68
fedora-42-xfce_dom0-dispvm-preload-concurrent (mean:3.545): 42.54
fedora-42-xfce_dom0-dispvm-preload-gui-concurrent (mean:4.176): 50.11
fedora-42-xfce_dom0-dispvm-api (mean:7.673): 92.08
fedora-42-xfce_dom0-dispvm-gui-api (mean:9.083): 109.00
fedora-42-xfce_dom0-dispvm-concurrent-api (mean:3.667): 44.00
fedora-42-xfce_dom0-dispvm-gui-concurrent-api (mean:4.432): 53.19
fedora-42-xfce_dom0-dispvm-preload-less-less-api (mean:4.333): 51.99
fedora-42-xfce_dom0-dispvm-preload-less-api (mean:4.135): 49.61
fedora-42-xfce_dom0-dispvm-preload-api (mean:3.765): 45.18
fedora-42-xfce_dom0-dispvm-preload-more-api (mean:3.934): 47.21
fedora-42-xfce_dom0-dispvm-preload-more-more-api (mean:3.816): 45.79
fedora-42-xfce_dom0-dispvm-preload-gui-api (mean:4.901): 58.81
fedora-42-xfce_dom0-dispvm-preload-concurrent-api (mean:3.399): 40.79
fedora-42-xfce_dom0-dispvm-preload-gui-concurrent-api (mean:4.197): 50.37
fedora-42-xfce_vm-vm (mean:0.028): 0.33
fedora-42-xfce_vm-vm-gui (mean:0.024): 0.29
fedora-42-xfce_vm-vm-concurrent (mean:0.014): 0.17
fedora-42-xfce_vm-vm-gui-concurrent (mean:0.019): 0.23
fedora-42-xfce_dom0-vm-api (mean:0.035): 0.42
fedora-42-xfce_dom0-vm-gui-api (mean:0.04): 0.47
fedora-42-xfce_dom0-vm-concurrent-api (mean:0.03): 0.36
fedora-42-xfce_dom0-vm-gui-concurrent-api (mean:0.028): 0.34
whonix-workstation-18_vm-dispvm (mean:9.173): 110.07
whonix-workstation-18_vm-dispvm-gui (mean:10.536): 126.43
whonix-workstation-18_vm-dispvm-gui-concurrent (mean:5.664): 67.97
whonix-workstation-18_dom0-dispvm (mean:9.459): 113.51
whonix-workstation-18_dom0-dispvm-gui (mean:10.464): 125.56
whonix-workstation-18_vm-dispvm-preload (mean:4.03): 48.37
whonix-workstation-18_vm-dispvm-preload-gui (mean:5.698): 68.38
whonix-workstation-18_vm-dispvm-preload-concurrent (mean:3.905): 46.86
whonix-workstation-18_vm-dispvm-preload-gui-concurrent (mean:4.908): 58.89
whonix-workstation-18_dom0-dispvm-preload (mean:5.041): 60.49
whonix-workstation-18_dom0-dispvm-preload-gui (mean:6.076): 72.91
whonix-workstation-18_dom0-dispvm-preload-concurrent (mean:4.402): 52.83
whonix-workstation-18_dom0-dispvm-preload-gui-concurrent (mean:5.093): 61.11
whonix-workstation-18_dom0-dispvm-api (mean:9.493): 113.92
whonix-workstation-18_dom0-dispvm-gui-api (mean:10.75): 129.00
whonix-workstation-18_dom0-dispvm-gui-concurrent-api (mean:5.476): 65.71
whonix-workstation-18_dom0-dispvm-preload-less-less-api (mean:5.583): 67.00
whonix-workstation-18_dom0-dispvm-preload-less-api (mean:5.427): 65.13
whonix-workstation-18_dom0-dispvm-preload-api (mean:5.419): 65.03
whonix-workstation-18_dom0-dispvm-preload-more-api (mean:5.494): 65.93
whonix-workstation-18_dom0-dispvm-preload-more-more-api (mean:5.455): 65.47
whonix-workstation-18_dom0-dispvm-preload-concurrent-api (mean:4.696): 56.36
whonix-workstation-18_dom0-dispvm-preload-gui-concurrent-api (mean:5.39): 64.67
whonix-workstation-18_vm-vm (mean:0.046): 0.55
whonix-workstation-18_vm-vm-gui (mean:0.047): 0.57
whonix-workstation-18_vm-vm-concurrent (mean:0.025): 0.31
whonix-workstation-18_vm-vm-gui-concurrent (mean:0.029): 0.35
whonix-workstation-18_dom0-vm-api (mean:0.037): 0.44
whonix-workstation-18_dom0-vm-gui-api (mean:0.054): 0.65
whonix-workstation-18_dom0-vm-concurrent-api (mean:0.029): 0.34
whonix-workstation-18_dom0-vm-gui-concurrent-api (mean:0.025): 0.30

Oct 29 '25 04:10 qubesos-bot

Didn't identify any related failure on openqa.

Oct 29 '25 09:10 ben-grande

qubes-core-admin
qubes-core-admin copied to clipboard

Easy dependency switch if only preload is in chain

Codecov Report

OpenQA test summary

Upload failures

New failures, excluding unstable

Failed tests

Fixed failures

Unstable tests

Performance Tests

Performance degradation:

Remaining performance tests:

qubes-core-admin qubes-core-admin copied to clipboard

Easy dependency switch if only preload is in chain

Codecov Report

OpenQA test summary

Upload failures

New failures, excluding unstable

Failed tests

Fixed failures

Unstable tests

Performance Tests

Performance degradation:

Remaining performance tests:

qubes-core-admin
qubes-core-admin copied to clipboard