cloudstack icon indicating copy to clipboard operation
cloudstack copied to clipboard
verified publisher icon apache

smoke test: support ceph storage pools

Open weizhouapache opened this issue 2 months ago • 16 comments

Description

This PR improves and fixes some tests on ceph storage

  • enable direct download tests on ceph
  • enable over provisioning tests on ceph
  • enable volume snapshot tests on ceph
  • fix test_human_readable_logs.py by increasing timeout of restarting to 120 seconds
  • skip live vm migration for VMs with volume migration between ceph storage pools
  • skip vm snapshots for VMs on ceph
  • skip volume migration test between ceph storage pools (fixed by #12103)
  • skip volume encryption tests on ceph

Types of changes

  • [ ] Breaking change (fix or feature that would cause existing functionality to change)
  • [ ] New feature (non-breaking change which adds functionality)
  • [ ] Bug fix (non-breaking change which fixes an issue)
  • [ ] Enhancement (improves an existing feature and functionality)
  • [ ] Cleanup (Code refactoring and cleanup, that may add test cases)
  • [ ] Build/CI
  • [x] Test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

  • [ ] Major
  • [ ] Minor

Bug Severity

  • [ ] BLOCKER
  • [ ] Critical
  • [ ] Major
  • [ ] Minor
  • [ ] Trivial

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

weizhouapache avatar Oct 29 '25 14:10 weizhouapache

@blueorangutan package

weizhouapache avatar Oct 29 '25 14:10 weizhouapache

@weizhouapache a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan avatar Oct 29 '25 14:10 blueorangutan

Codecov Report

:white_check_mark: All modified and coverable lines are covered by tests. :white_check_mark: Project coverage is 17.45%. Comparing base (223fc25) to head (844de76).

Additional details and impacted files 
@@             Coverage Diff              @@
##               4.22   #11931      +/-   ##
============================================
- Coverage     17.56%   17.45%   -0.11%     
+ Complexity    15548    15513      -35     
============================================
  Files          5910     5913       +3     
  Lines        529129   529385     +256     
  Branches      64634    64677      +43     
============================================
- Hits          92942    92425     -517     
- Misses       425730   426543     +813     
+ Partials      10457    10417      -40
Flag Coverage Δ
uitests 3.58% <ø> (+<0.01%) :arrow_up:
unittests 18.51% <ø> (-0.12%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

codecov[bot] avatar Oct 29 '25 14:10 codecov[bot]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15584

blueorangutan avatar Oct 29 '25 16:10 blueorangutan

@blueorangutan test matrix

weizhouapache avatar Oct 29 '25 17:10 weizhouapache

@weizhouapache a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

blueorangutan avatar Oct 29 '25 17:10 blueorangutan

[SF] Trillian test result (tid-14741) Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8 Total time taken: 71700 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14741-kvm-ol8.zip Smoke tests completed. 147 look OK, 2 have errors, 0 did not run Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_02_migrate_VM_with_two_data_disks Error 38.80 test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown Error 288.49 test_vm_snapshots.py

blueorangutan avatar Oct 30 '25 14:10 blueorangutan

[SF] Trillian test result (tid-14742) Environment: kvm-ubuntu22 (x2), zone: Advanced Networking with Mgmt server u22 Total time taken: 87202 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14742-kvm-ubuntu22.zip Smoke tests completed. 146 look OK, 3 have errors, 0 did not run Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_02_migrate_VM_with_two_data_disks Error 38.29 test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown Error 291.59 test_vm_snapshots.py
test_hostha_enable_ha_when_host_disabled Error 3.67 test_hostha_kvm.py
test_hostha_enable_ha_when_host_in_maintenance Error 305.91 test_hostha_kvm.py

blueorangutan avatar Oct 30 '25 18:10 blueorangutan

@blueorangutan package

weizhouapache avatar Oct 30 '25 19:10 weizhouapache

@weizhouapache a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan avatar Oct 30 '25 19:10 blueorangutan

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15597

blueorangutan avatar Oct 30 '25 20:10 blueorangutan

@blueorangutan test

weizhouapache avatar Oct 30 '25 23:10 weizhouapache

@weizhouapache a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

blueorangutan avatar Oct 30 '25 23:10 blueorangutan

[SF] Trillian test result (tid-14744) Environment: xcpng82 (x2), zone: Advanced Networking with Mgmt server ol9 Total time taken: 129543 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14744-xcpng82.zip Smoke tests completed. 139 look OK, 10 have errors, 0 did not run Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_01_events_resource Error 822.70 test_events_resource.py
test_08_upgrade_kubernetes_ha_cluster Failure 3787.76 test_kubernetes_clusters.py
test_01_non_strict_host_anti_affinity Error 520.75 test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity Error 130.06 test_nonstrict_affinity_group.py
test_02_list_snapshots_with_removed_data_store Error 18.51 test_snapshots.py
test_02_list_snapshots_with_removed_data_store Error 18.52 test_snapshots.py
test_01_ssl_offloading_isolated_network Failure 949.48 test_ssl_offloading.py
test_01_vpn_usage Error 1.18 test_usage.py
test_01_scale_up_verify Failure 579.72 test_vm_autoscaling.py
test_11_destroy_vm_and_volumes Error 30.02 test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown Error 314.04 test_vm_snapshots.py
test_01_migrate_vm_strict_tags_success Error 78.07 test_vm_strict_host_tags.py

blueorangutan avatar Oct 31 '25 06:10 blueorangutan

[SF] Trillian test result (tid-14753) Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8 Total time taken: 58456 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14753-kvm-ol8.zip Smoke tests completed. 149 look OK, 0 have errors, 0 did not run Only failed and skipped tests results shown below:

Test Result Time (s) Test File

blueorangutan avatar Oct 31 '25 17:10 blueorangutan

[SF] Trillian test result (tid-14743) Environment: vmware-70u3 (x2), zone: Advanced Networking with Mgmt server ol8 Total time taken: 292096 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14743-vmware-70u3.zip Smoke tests completed. 136 look OK, 13 have errors, 0 did not run Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_08_upgrade_kubernetes_ha_cluster Failure 3693.33 test_kubernetes_clusters.py
test_list_vms_metrics_admin Error 3633.14 test_metrics_api.py
test_list_vms_metrics_history Error 25.23 test_metrics_api.py
test_list_volumes_metrics_history Error 3606.95 test_metrics_api.py
ContextSuite context=TestISOUsage>:setup Error 0.00 test_usage.py
test_01_vpn_usage Error 1.22 test_usage.py
test_01_deploy_vm_on_specific_host Error 26.64 test_vm_deployment_planner.py
test_02_deploy_vm_on_specific_cluster Error 3604.05 test_vm_deployment_planner.py
test_03_deploy_vm_on_specific_pod Error 2.66 test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster Error 4.61 test_vm_deployment_planner.py
test_05_deploy_vm_on_cluster_override_pod Error 3.61 test_vm_deployment_planner.py
test_09_expunge_vm Failure 424.88 test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown Error 299.52 test_vm_snapshots.py
test_01_migrate_vm_strict_tags_success Error 3607.74 test_vm_strict_host_tags.py
test_02_migrate_vm_strict_tags_failure Error 4.65 test_vm_strict_host_tags.py
test_01_restore_vm_strict_tags_success Error 20.56 test_vm_strict_host_tags.py
test_02_restore_vm_strict_tags_failure Error 3607.25 test_vm_strict_host_tags.py
test_01_scale_vm_strict_tags_success Error 23.20 test_vm_strict_host_tags.py
test_02_scale_vm_strict_tags_failure Error 3606.02 test_vm_strict_host_tags.py
test_01_deploy_vm_on_specific_host_without_strict_tags Error 27.80 test_vm_strict_host_tags.py
test_02_deploy_vm_on_any_host_without_strict_tags Error 3605.43 test_vm_strict_host_tags.py
test_03_deploy_vm_on_specific_host_with_strict_tags_success Error 3603.58 test_vm_strict_host_tags.py
test_04_deploy_vm_on_any_host_with_strict_tags_success Error 3608.30 test_vm_strict_host_tags.py
test_04_deploy_vnf_appliance Error 2022.66 test_vnf_templates.py
ContextSuite context=TestVnfTemplates>:teardown Error 1817.67 test_vnf_templates.py
ContextSuite context=TestCreateVolume>:teardown Error 2264.70 test_volumes.py
test_01_verify_ipv6_vpc Error 3791.85 test_vpc_ipv6.py
test_01_verify_ipv6_vpc Error 3792.19 test_vpc_ipv6.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Error 1924.77 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Error 1923.29 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Error 1819.42 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Error 1925.69 test_vpc_redundant.py
test_05_rvpc_multi_tiers Error 1915.19 test_vpc_redundant.py
test_01_VPC_nics_after_destroy Failure 5719.14 test_vpc_router_nics.py
test_01_redundant_vpc_site2site_vpn Failure 1912.43 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Error 1912.58 test_vpc_vpn.py
test_01_vpc_site2site_vpn_multiple_options Error 2564.26 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Error 1937.20 test_vpc_vpn.py

blueorangutan avatar Nov 02 '25 03:11 blueorangutan