Qubes Air: Introduce RemoteVM

Open fepitre opened this issue 8 months ago • 2 comments

QubesOS/qubes-issues/issues/9015

Mar 18 '25 17:03 fepitre

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025041703-4.3&flavor=pull-requests

Test run included the following:

https://github.com/QubesOS/qubes-core-admin/pull/669 (https://github.com/QubesOS/qubes-core-admin/pull/669/commits/e90249b7ce51e0bbce1c9c39fc80230b4cbb856b)
https://github.com/QubesOS/qubes-manager/pull/398 (https://github.com/QubesOS/qubes-manager/pull/398/commits/679eff400bd0de4887f0bb61de34250a1f842709)
https://github.com/QubesOS/qubes-core-admin/pull/668 (https://github.com/QubesOS/qubes-core-admin/pull/668/commits/1c4366adff31e55c27a86caa692d71bb115fb9be)
https://github.com/QubesOS/qubes-core-qrexec/pull/182 (https://github.com/QubesOS/qubes-core-qrexec/pull/182/commits/e81aeaeced843e03be834bc93103330ccb7928ce)

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025031804-4.3&flavor=update

system_tests_whonix@hw7
- whonixcheck: unnamed test (unknown)
- whonixcheck: unnamed test (unknown)
system_tests_qwt_win11@hw13
- windows_install: wait_serial (wait serial expected) # wait_serial expected: qr/dcWzE-\d+-/...
- windows_install: Failed (test died + timed out) # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_whonix
- whonixcheck: unnamed test (unknown)
- whonixcheck: unnamed test (unknown)
system_tests_kde_gui_interactive
- gui_keyboard_layout: wait_serial (wait serial expected) # wait_serial expected: "echo -e '[Layout]\nLayoutList=us,de' | sud...
- gui_keyboard_layout: Failed (test died) # Test died: command 'test "$(cd ~user;ls e1*)" = "$(qvm-run -p wor...
system_tests_qwt_win10_seamless@hw13
- windows_clipboard_and_filecopy: unnamed test (unknown)
- windows_clipboard_and_filecopy: Failed (test died) # Test died: no candidate needle with tag(s) 'qubes-website' matche...

Failed tests

14 failures

system_tests_whonix@hw7
- whonixcheck: fail (unknown) Whonixcheck for anon-whonix failed...
- whonixcheck: unnamed test (unknown)
- whonixcheck: fail (unknown) Whonixcheck for sys-whonix failed...
- whonixcheck: unnamed test (unknown)
system_tests_qwt_win11@hw13
- windows_install: wait_serial (wait serial expected) # wait_serial expected: qr/dcWzE-\d+-/...
- windows_install: Failed (test died + timed out) # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_whonix
- whonixcheck: fail (unknown) Whonixcheck for anon-whonix failed...
- whonixcheck: unnamed test (unknown)
- whonixcheck: fail (unknown) Whonixcheck for whonix-gateway-17 failed...
- whonixcheck: unnamed test (unknown)
system_tests_kde_gui_interactive
- gui_keyboard_layout: wait_serial (wait serial expected) # wait_serial expected: "echo -e '[Layout]\nLayoutList=us,de' | sud...
- gui_keyboard_layout: Failed (test died) # Test died: command 'test "$(cd ~user;ls e1*)" = "$(qvm-run -p wor...
system_tests_qwt_win10_seamless@hw13
- windows_clipboard_and_filecopy: unnamed test (unknown)
- windows_clipboard_and_filecopy: Failed (test died) # Test died: no candidate needle with tag(s) 'qubes-website' matche...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/132953#dependencies

12 fixed

system_tests_whonix@hw7
- whonixcheck: unnamed test (unknown)
system_tests_whonix
- whonixcheck: unnamed test (unknown)
system_tests_basic_vm_qrexec_gui
- TC_20_NonAudio_whonix-gateway-17: test_300_bug_1028_gui_memory_pinning (failure) AssertionError: Dom0 window doesn't match VM window content, saved ...
system_tests_qrexec
- TC_00_Qrexec_fedora-41-xfce: test_081_qrexec_service_argument_allow_specific (error) subprocess.CalledProcessError: Command '/usr/lib/qubes/qrexec-clien...
system_tests_guivm_vnc_gui_interactive
- gui_filecopy: unnamed test (unknown)
- gui_filecopy: Failed (test died) # Test died: no candidate needle with tag(s) 'files-work' matched...
system_tests_audio
- TC_20_AudioVM_Pulse_whonix-workstation-17: test_252_audio_playback_audiovm_switch_hvm (failure) AssertionError: only silence detected, no useful audio data
system_tests_kde_gui_interactive
- clipboard_and_web: unnamed test (unknown)
- clipboard_and_web: Failed (test died) # Test died: no candidate needle with tag(s) 'qubes-website' matche...
- clipboard_and_web: wait_serial (wait serial expected) # wait_serial expected: "lspci; echo 2E8vz-\$?-"...
system_tests_suspend
- suspend: unnamed test (unknown)
- suspend: Failed (test died) # Test died: no candidate needle with tag(s) 'SUSPEND-FAILED' match...

Unstable tests

Performance Tests

Performance degradation:

14 performance degradations

whonix-gateway-17_exec: 7.76 :small_red_triangle_up: ( previous job: 6.82, degradation: 113.82%)
whonix-workstation-17_socket: 9.22 :small_red_triangle_up: ( previous job: 8.19, degradation: 112.46%)
dom0_root_seq1m_q8t1_read 3:read_bandwidth_kb: 358487.00 :small_red_triangle_up: ( previous job: 446963.00, degradation: 80.21%)
dom0_root_seq1m_q1t1_read 3:read_bandwidth_kb: 192268.00 :small_red_triangle_up: ( previous job: 294295.00, degradation: 65.33%)
dom0_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 4086.00 :small_red_triangle_up: ( previous job: 4826.00, degradation: 84.67%)
dom0_varlibqubes_seq1m_q8t1_write 3:write_bandwidth_kb: 92729.00 :small_red_triangle_up: ( previous job: 250795.00, degradation: 36.97%)
dom0_varlibqubes_seq1m_q1t1_write 3:write_bandwidth_kb: 164739.00 :small_red_triangle_up: ( previous job: 184752.00, degradation: 89.17%)
dom0_varlibqubes_rnd4k_q32t1_write 3:write_bandwidth_kb: 3429.00 :small_red_triangle_up: ( previous job: 6479.00, degradation: 52.92%)
dom0_varlibqubes_rnd4k_q1t1_write 3:write_bandwidth_kb: 4308.00 :small_red_triangle_up: ( previous job: 4903.00, degradation: 87.86%)
fedora-41-xfce_root_seq1m_q1t1_write 3:write_bandwidth_kb: 45565.00 :small_red_triangle_up: ( previous job: 87940.00, degradation: 51.81%)
fedora-41-xfce_private_seq1m_q1t1_read 3:read_bandwidth_kb: 295706.00 :small_red_triangle_up: ( previous job: 334687.00, degradation: 88.35%)
fedora-41-xfce_volatile_seq1m_q8t1_write 3:write_bandwidth_kb: 115682.00 :small_red_triangle_up: ( previous job: 179949.00, degradation: 64.29%)
fedora-41-xfce_volatile_rnd4k_q32t1_write 3:write_bandwidth_kb: 3590.00 :small_red_triangle_up: ( previous job: 5672.00, degradation: 63.29%)
fedora-41-xfce_volatile_rnd4k_q1t1_write 3:write_bandwidth_kb: 1316.00 :small_red_triangle_up: ( previous job: 1953.00, degradation: 67.38%)

Remaining performance tests:

58 tests

debian-12-xfce_exec: 6.66 :green_circle: ( previous job: 7.12, improvement: 93.61%)
debian-12-xfce_exec-root: 28.55 :green_circle: ( previous job: 28.65, improvement: 99.63%)
debian-12-xfce_socket: 8.85 :small_red_triangle_up: ( previous job: 8.60, degradation: 102.93%)
debian-12-xfce_socket-root: 8.31 :green_circle: ( previous job: 8.52, improvement: 97.42%)
debian-12-xfce_exec-data-simplex: 71.96 :small_red_triangle_up: ( previous job: 71.62, degradation: 100.48%)
debian-12-xfce_exec-data-duplex: 69.88 :green_circle: ( previous job: 70.34, improvement: 99.35%)
debian-12-xfce_exec-data-duplex-root: 86.04 :small_red_triangle_up: ( previous job: 82.72, degradation: 104.01%)
debian-12-xfce_socket-data-duplex: 162.58 :small_red_triangle_up: ( previous job: 156.96, degradation: 103.58%)
fedora-41-xfce_exec: 9.08 :green_circle: ( previous job: 9.27, improvement: 98.03%)
fedora-41-xfce_exec-root: 60.88 :green_circle: ( previous job: 61.51, improvement: 98.98%)
fedora-41-xfce_socket: 8.74 :small_red_triangle_up: ( previous job: 8.63, degradation: 101.34%)
fedora-41-xfce_socket-root: 8.54 :green_circle: ( previous job: 8.71, improvement: 98.11%)
fedora-41-xfce_exec-data-simplex: 64.58 :green_circle: ( previous job: 75.53, improvement: 85.50%)
fedora-41-xfce_exec-data-duplex: 73.68 :small_red_triangle_up: ( previous job: 71.56, degradation: 102.96%)
fedora-41-xfce_exec-data-duplex-root: 106.82 :green_circle: ( previous job: 109.13, improvement: 97.88%)
fedora-41-xfce_socket-data-duplex: 152.99 :small_red_triangle_up: ( previous job: 150.61, degradation: 101.58%)
whonix-gateway-17_exec-root: 38.80 :green_circle: ( previous job: 40.43, improvement: 95.97%)
whonix-gateway-17_socket: 7.26 :small_red_triangle_up: ( previous job: 7.24, degradation: 100.31%)
whonix-gateway-17_socket-root: 8.37 :small_red_triangle_up: ( previous job: 7.65, degradation: 109.45%)
whonix-gateway-17_exec-data-simplex: 73.75 :green_circle: ( previous job: 78.32, improvement: 94.16%)
whonix-gateway-17_exec-data-duplex: 77.62 :small_red_triangle_up: ( previous job: 76.65, degradation: 101.26%)
whonix-gateway-17_exec-data-duplex-root: 84.33 :green_circle: ( previous job: 88.52, improvement: 95.26%)
whonix-gateway-17_socket-data-duplex: 169.79 :green_circle: ( previous job: 171.76, improvement: 98.85%)
whonix-workstation-17_exec: 8.25 :small_red_triangle_up: ( previous job: 7.67, degradation: 107.51%)
whonix-workstation-17_exec-root: 55.89 :green_circle: ( previous job: 58.26, improvement: 95.93%)
whonix-workstation-17_socket-root: 8.78 :small_red_triangle_up: ( previous job: 8.13, degradation: 107.94%)
whonix-workstation-17_exec-data-simplex: 62.77 :green_circle: ( previous job: 74.99, improvement: 83.69%)
whonix-workstation-17_exec-data-duplex: 65.13 :green_circle: ( previous job: 72.71, improvement: 89.57%)
whonix-workstation-17_exec-data-duplex-root: 107.57 :small_red_triangle_up: ( previous job: 99.82, degradation: 107.76%)
whonix-workstation-17_socket-data-duplex: 172.94 :small_red_triangle_up: ( previous job: 169.50, degradation: 102.02%)
dom0_root_seq1m_q8t1_write 3:write_bandwidth_kb: 198376.00 :green_circle: ( previous job: 129298.00, improvement: 153.43%)
dom0_root_seq1m_q1t1_write 3:write_bandwidth_kb: 165800.00 :green_circle: ( previous job: 95454.00, improvement: 173.70%)
dom0_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 80400.00 :green_circle: ( previous job: 79803.00, improvement: 100.75%)
dom0_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 9322.00 :green_circle: ( previous job: 6149.00, improvement: 151.60%)
dom0_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 10548.00 :small_red_triangle_up: ( previous job: 10795.00, degradation: 97.71%)
dom0_varlibqubes_seq1m_q8t1_read 3:read_bandwidth_kb: 441505.00 :green_circle: ( previous job: 382273.00, improvement: 115.49%)
dom0_varlibqubes_seq1m_q1t1_read 3:read_bandwidth_kb: 409280.00 :small_red_triangle_up: ( previous job: 437636.00, degradation: 93.52%)
dom0_varlibqubes_rnd4k_q32t1_read 3:read_bandwidth_kb: 102188.00 :green_circle: ( previous job: 62195.00, improvement: 164.30%)
dom0_varlibqubes_rnd4k_q1t1_read 3:read_bandwidth_kb: 10338.00 :green_circle: ( previous job: 7669.00, improvement: 134.80%)
fedora-41-xfce_root_seq1m_q8t1_read 3:read_bandwidth_kb: 388649.00 :green_circle: ( previous job: 368309.00, improvement: 105.52%)
fedora-41-xfce_root_seq1m_q8t1_write 3:write_bandwidth_kb: 261490.00 :green_circle: ( previous job: 162081.00, improvement: 161.33%)
fedora-41-xfce_root_seq1m_q1t1_read 3:read_bandwidth_kb: 338032.00 :green_circle: ( previous job: 318716.00, improvement: 106.06%)
fedora-41-xfce_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 87316.00 :green_circle: ( previous job: 82694.00, improvement: 105.59%)
fedora-41-xfce_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 3408.00 :small_red_triangle_up: ( previous job: 3599.00, degradation: 94.69%)
fedora-41-xfce_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 8220.00 :small_red_triangle_up: ( previous job: 8485.00, degradation: 96.88%)
fedora-41-xfce_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 1304.00 :green_circle: ( previous job: 542.00, improvement: 240.59%)
fedora-41-xfce_private_seq1m_q8t1_read 3:read_bandwidth_kb: 359470.00 :small_red_triangle_up: ( previous job: 373957.00, degradation: 96.13%)
fedora-41-xfce_private_seq1m_q8t1_write 3:write_bandwidth_kb: 217908.00 :green_circle: ( previous job: 170062.00, improvement: 128.13%)
fedora-41-xfce_private_seq1m_q1t1_write 3:write_bandwidth_kb: 59104.00 :small_red_triangle_up: ( previous job: 61534.00, degradation: 96.05%)
fedora-41-xfce_private_rnd4k_q32t1_read 3:read_bandwidth_kb: 74326.00 :small_red_triangle_up: ( previous job: 80283.00, degradation: 92.58%)
fedora-41-xfce_private_rnd4k_q32t1_write 3:write_bandwidth_kb: 2851.00 :green_circle: ( previous job: 2215.00, improvement: 128.71%)
fedora-41-xfce_private_rnd4k_q1t1_read 3:read_bandwidth_kb: 8342.00 :green_circle: ( previous job: 7540.00, improvement: 110.64%)
fedora-41-xfce_private_rnd4k_q1t1_write 3:write_bandwidth_kb: 1327.00 :green_circle: ( previous job: 1130.00, improvement: 117.43%)
fedora-41-xfce_volatile_seq1m_q8t1_read 3:read_bandwidth_kb: 337814.00 :small_red_triangle_up: ( previous job: 369868.00, degradation: 91.33%)
fedora-41-xfce_volatile_seq1m_q1t1_read 3:read_bandwidth_kb: 294709.00 :small_red_triangle_up: ( previous job: 324737.00, degradation: 90.75%)
fedora-41-xfce_volatile_seq1m_q1t1_write 3:write_bandwidth_kb: 62159.00 :green_circle: ( previous job: 17567.00, improvement: 353.84%)
fedora-41-xfce_volatile_rnd4k_q32t1_read 3:read_bandwidth_kb: 79999.00 :green_circle: ( previous job: 79021.00, improvement: 101.24%)
fedora-41-xfce_volatile_rnd4k_q1t1_read 3:read_bandwidth_kb: 9072.00 :green_circle: ( previous job: 7867.00, improvement: 115.32%)

Mar 18 '25 19:03 qubesos-bot

Codecov Report

Attention: Patch coverage is 80.20833% with 19 lines in your changes missing coverage. Please review.

Project coverage is 70.37%. Comparing base (c63c185) to head (3a62a74). Report is 28 commits behind head on main.

Files with missing lines	Patch %	Lines
qubes/ext/relay.py	66.66%	10 Missing :warning:
qubes/vm/remotevm.py	80.55%	7 Missing :warning:
qubes/vm/__init__.py	84.61%	2 Missing :warning:

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #668      +/-   ##
==========================================
+ Coverage   70.12%   70.37%   +0.24%     
==========================================
  Files          59       61       +2     
  Lines       12708    12898     +190     
==========================================
+ Hits         8912     9077     +165     
- Misses       3796     3821      +25

Flag	Coverage Δ
unittests	`70.37% <80.20%> (+0.24%)`	:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:

:snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Apr 03 '25 08:04 codecov[bot]

qubes-core-admin qubes-core-admin copied to clipboard

Qubes Air: Introduce RemoteVM

OpenQA test summary

New failures, excluding unstable

Failed tests

Fixed failures

Unstable tests

Performance Tests

Performance degradation:

Remaining performance tests:

Codecov Report

qubes-core-admin
qubes-core-admin copied to clipboard