cloudstack [WIP] VM Autoscaling with virtual router

Description

This PR extends the vm autoscaling feature to support CloudStack Virtual router as LB provider

The following changes need be considered

support cloudstack virtual routers and vpc vrs as LB provider
get network/load balancer metrics from virtual routers
UI changes to create/update/remove vm groups
support more vm properties (sshkey, affinity group, userdata networks, etc)
support main hypervisors (kvm, vmware, xenserver/xcp)

some changes are good to have but not considered for now

remove load balancing from autoscaling
support networks without load balancing (e.g. shared networks)

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[ ] Bug fix (non-breaking change which fixes an issue)
[x] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

[x] Major
[ ] Minor

Bug Severity

[ ] BLOCKER
[ ] Critical
[ ] Major
[ ] Minor
[ ] Trivial

Screenshots (if appropriate):

How Has This Been Tested?

Jul 26 '22 13:07 weizhouapache

Found UI changes, kicking a new UI QA build @blueorangutan ui

Jul 26 '22 13:07 acs-robot

@acs-robot a Jenkins job has been kicked to build UI QA env. I'll keep you posted as I make progress.

Jul 26 '22 13:07 blueorangutan

UI build: :heavy_check_mark: Live QA URL: http://qa.cloudstack.cloud:8080/client/pr/6571 (SL-JID-2004)

Jul 26 '22 13:07 blueorangutan

@blueorangutan package

Jul 26 '22 13:07 weizhouapache

@weizhouapache a Jenkins job has been kicked to build packages. It will be bundled with

SystemVM template(s). I'll keep you posted as I make progress.

Jul 26 '22 13:07 blueorangutan

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 3829

Jul 26 '22 14:07 blueorangutan

@blueorangutan test matrix

Jul 26 '22 14:07 weizhouapache

@weizhouapache a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

Jul 26 '22 14:07 blueorangutan

Found UI changes, kicking a new UI QA build @blueorangutan ui

Jul 26 '22 15:07 acs-robot

@acs-robot a Jenkins job has been kicked to build UI QA env. I'll keep you posted as I make progress.

Jul 26 '22 15:07 blueorangutan

Found UI changes, kicking a new UI QA build @blueorangutan ui

Jul 26 '22 15:07 acs-robot

@acs-robot a Jenkins job has been kicked to build UI QA env. I'll keep you posted as I make progress.

Jul 26 '22 15:07 blueorangutan

UI build: :heavy_check_mark: Live QA URL: http://qa.cloudstack.cloud:8080/client/pr/6571 (SL-JID-2005)

Jul 26 '22 15:07 blueorangutan

UI build: :heavy_check_mark: Live QA URL: http://qa.cloudstack.cloud:8080/client/pr/6571 (SL-JID-2006)

Jul 26 '22 15:07 blueorangutan

Trillian test result (tid-4547) Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7 Total time taken: 39752 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr6571-t4547-kvm-centos7.zip Smoke tests completed. 81 look OK, 19 have errors Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_deployVMInSharedNetwork	`Error`	63.87	test_network.py
test_03_destroySharedNetwork	`Failure`	1.06	test_network.py
ContextSuite context=TestSharedNetwork>:teardown	`Error`	2.15	test_network.py
test_01_ISO_usage	`Error`	1.08	test_usage.py
test_01_lb_usage	`Error`	4.19	test_usage.py
test_01_nat_usage	`Error`	6.27	test_usage.py
test_01_public_ip_usage	`Error`	1.17	test_usage.py
test_01_snapshot_usage	`Error`	53.23	test_usage.py
test_01_template_usage	`Error`	16.52	test_usage.py
test_01_vm_usage	`Error`	135.00	test_usage.py
test_01_volume_usage	`Error`	126.93	test_usage.py
test_01_vpn_usage	`Error`	8.37	test_usage.py
test_01_snapshot_root_disk	`Error`	4.25	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	`Error`	8.50	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	`Error`	8.50	test_snapshots.py
test_query_async_job_result	`Error`	82.89	test_async_job.py
test_revoke_certificate	`Error`	0.01	test_certauthority_root.py
test_01_add_primary_storage_disabled_host	`Error`	0.59	test_primary_storage.py
test_01_primary_storage_nfs	`Error`	0.12	test_primary_storage.py
ContextSuite context=TestStorageTags>:setup	`Error`	0.20	test_primary_storage.py
test_role_account_acls_multiple_mgmt_servers	`Error`	2.00	test_dynamicroles.py
login_test_saml_user	`Error`	2.44	test_login.py
test_01_positive_tests_usage	`Error`	7.89	test_usage_events.py
test_01_vpc_privategw_acl	`Error`	97.81	test_privategw_acl.py
test_02_vpc_privategw_static_routes	`Error`	291.36	test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup	`Error`	294.70	test_privategw_acl.py
test_04_rvpc_privategw_static_routes	`Error`	526.37	test_privategw_acl.py
test_01_vpc_privategw_acl	`Error`	0.02	test_privategw_acl_ovs_gre.py
test_03_vpc_privategw_restart_vpc_cleanup	`Error`	0.02	test_privategw_acl_ovs_gre.py
test_05_vpc_privategw_check_interface	`Error`	0.01	test_privategw_acl_ovs_gre.py
test_oobm_issue_power_cycle	`Error`	2.38	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_off	`Error`	3.25	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_on	`Error`	3.25	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_reset	`Error`	3.25	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_soft	`Error`	3.24	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_status	`Error`	2.17	test_outofbandmanagement_nestedplugin.py
test_01_invalid_upgrade_kubernetes_cluster	`Failure`	213.71	test_kubernetes_clusters.py
test_02_upgrade_kubernetes_cluster	`Failure`	40.26	test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster	`Failure`	40.27	test_kubernetes_clusters.py
test_04_autoscale_kubernetes_cluster	`Failure`	3.21	test_kubernetes_clusters.py
test_05_basic_lifecycle_kubernetes_cluster	`Failure`	4.22	test_kubernetes_clusters.py
test_06_delete_kubernetes_cluster	`Failure`	4.23	test_kubernetes_clusters.py
test_07_deploy_kubernetes_ha_cluster	`Failure`	4.32	test_kubernetes_clusters.py
test_08_upgrade_kubernetes_ha_cluster	`Failure`	3.19	test_kubernetes_clusters.py
test_09_delete_kubernetes_ha_cluster	`Failure`	4.22	test_kubernetes_clusters.py
ContextSuite context=TestKubernetesCluster>:teardown	`Error`	96.37	test_kubernetes_clusters.py
test_01_add_delete_kubernetes_supported_version	`Error`	0.24	test_kubernetes_supported_versions.py
test_configure_ha_provider_invalid	`Error`	0.01	test_hostha_simulator.py
test_configure_ha_provider_valid	`Error`	0.01	test_hostha_simulator.py
test_ha_configure_enabledisable_across_clusterzones	`Error`	0.01	test_hostha_simulator.py
test_ha_disable_feature_invalid	`Error`	0.01	test_hostha_simulator.py
test_ha_enable_feature_invalid	`Error`	0.01	test_hostha_simulator.py
test_ha_list_providers	`Error`	0.01	test_hostha_simulator.py
test_ha_multiple_mgmt_server_ownership	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_available	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_degraded	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_fenced	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_recovering	`Error`	0.01	test_hostha_simulator.py
test_hostha_configure_default_driver	`Error`	0.01	test_hostha_simulator.py
test_hostha_configure_invalid_provider	`Error`	0.01	test_hostha_simulator.py
test_hostha_disable_feature_valid	`Error`	0.01	test_hostha_simulator.py
test_hostha_enable_feature_valid	`Error`	0.01	test_hostha_simulator.py
test_hostha_enable_feature_without_setting_provider	`Error`	0.01	test_hostha_simulator.py
test_list_ha_for_host	`Error`	0.01	test_hostha_simulator.py
test_list_ha_for_host_invalid	`Error`	0.01	test_hostha_simulator.py
test_list_ha_for_host_valid	`Error`	0.01	test_hostha_simulator.py
test_CreateTemplateWithDuplicateName	`Error`	25.87	test_templates.py
test_01_register_template_direct_download_flag	`Error`	0.11	test_templates.py
test_01_secure_vm_migration	`Error`	153.12	test_vm_life_cycle.py
test_02_unsecure_vm_migration	`Error`	269.88	test_vm_life_cycle.py
test_03_secured_to_nonsecured_vm_migration	`Error`	141.74	test_vm_life_cycle.py
test_08_migrate_vm	`Error`	41.76	test_vm_life_cycle.py
test_oobm_background_powerstate_sync	`Failure`	20.59	test_outofbandmanagement.py
test_oobm_background_powerstate_sync	`Error`	20.59	test_outofbandmanagement.py
test_oobm_configure_default_driver	`Error`	0.05	test_outofbandmanagement.py
test_oobm_configure_invalid_driver	`Error`	0.05	test_outofbandmanagement.py
test_oobm_disable_feature_invalid	`Error`	0.06	test_outofbandmanagement.py
test_oobm_disable_feature_valid	`Error`	1.12	test_outofbandmanagement.py
test_oobm_enable_feature_invalid	`Error`	0.06	test_outofbandmanagement.py
test_oobm_enable_feature_valid	`Error`	0.09	test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones	`Error`	9.68	test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones	`Error`	9.68	test_outofbandmanagement.py
test_oobm_issue_power_cycle	`Error`	2.26	test_outofbandmanagement.py
test_oobm_issue_power_cycle	`Error`	2.26	test_outofbandmanagement.py
test_oobm_issue_power_off	`Error`	4.30	test_outofbandmanagement.py
test_oobm_issue_power_off	`Error`	4.30	test_outofbandmanagement.py
test_oobm_issue_power_on	`Error`	4.29	test_outofbandmanagement.py
test_oobm_issue_power_on	`Error`	4.29	test_outofbandmanagement.py
test_oobm_issue_power_reset	`Error`	2.28	test_outofbandmanagement.py
test_oobm_issue_power_reset	`Error`	2.28	test_outofbandmanagement.py
test_oobm_issue_power_soft	`Error`	4.41	test_outofbandmanagement.py
test_oobm_issue_power_soft	`Error`	4.41	test_outofbandmanagement.py
test_oobm_issue_power_status	`Error`	3.30	test_outofbandmanagement.py
test_oobm_issue_power_status	`Error`	3.30	test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership	`Error`	1.13	test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership	`Error`	1.13	test_outofbandmanagement.py
test_oobm_zchange_password	`Error`	0.14	test_outofbandmanagement.py
test_oobm_zchange_password	`Error`	0.14	test_outofbandmanagement.py
test_disable_oobm_ha_state_ineligible	`Error`	0.05	test_hostha_kvm.py
test_hostha_configure_default_driver	`Error`	0.04	test_hostha_kvm.py
test_hostha_enable_ha_when_host_disabled	`Error`	0.04	test_hostha_kvm.py
test_hostha_enable_ha_when_host_disconected	`Error`	0.03	test_hostha_kvm.py
test_hostha_enable_ha_when_host_in_maintenance	`Error`	0.04	test_hostha_kvm.py
test_hostha_kvm_host_degraded	`Error`	0.04	test_hostha_kvm.py
test_hostha_kvm_host_fencing	`Error`	0.04	test_hostha_kvm.py
test_hostha_kvm_host_recovering	`Error`	0.03	test_hostha_kvm.py
test_remove_ha_provider_not_possible	`Error`	0.04	test_hostha_kvm.py

Jul 27 '22 01:07 blueorangutan

Trillian test result (tid-4546) Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7 Total time taken: 40715 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr6571-t4546-xenserver-71.zip Smoke tests completed. 83 look OK, 17 have errors Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_deployVMInSharedNetwork	`Error`	71.95	test_network.py
test_03_destroySharedNetwork	`Failure`	1.06	test_network.py
ContextSuite context=TestSharedNetwork>:teardown	`Error`	1.15	test_network.py
test_01_ISO_usage	`Error`	1.07	test_usage.py
test_01_lb_usage	`Error`	5.21	test_usage.py
test_01_nat_usage	`Error`	8.26	test_usage.py
test_01_public_ip_usage	`Error`	1.06	test_usage.py
test_01_snapshot_usage	`Error`	11.39	test_usage.py
test_01_template_usage	`Error`	9.40	test_usage.py
test_01_vm_usage	`Error`	15.42	test_usage.py
test_01_volume_usage	`Error`	8.53	test_usage.py
test_01_vpn_usage	`Error`	12.52	test_usage.py
test_01_snapshot_root_disk	`Error`	10.38	test_snapshots.py
test_query_async_job_result	`Error`	106.50	test_async_job.py
test_revoke_certificate	`Error`	0.02	test_certauthority_root.py
test_02_edit_primary_storage_tags	`Error`	0.02	test_primary_storage.py
test_role_account_acls_multiple_mgmt_servers	`Error`	1.95	test_dynamicroles.py
login_test_saml_user	`Error`	2.46	test_login.py
test_01_positive_tests_usage	`Error`	7.71	test_usage_events.py
test_01_vpc_privategw_acl	`Error`	103.83	test_privategw_acl.py
test_02_vpc_privategw_static_routes	`Error`	335.69	test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup	`Error`	332.53	test_privategw_acl.py
test_04_rvpc_privategw_static_routes	`Error`	561.93	test_privategw_acl.py
test_01_vpc_privategw_acl	`Error`	0.02	test_privategw_acl_ovs_gre.py
test_03_vpc_privategw_restart_vpc_cleanup	`Error`	0.01	test_privategw_acl_ovs_gre.py
test_05_vpc_privategw_check_interface	`Error`	0.01	test_privategw_acl_ovs_gre.py
test_oobm_issue_power_cycle	`Error`	2.22	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_off	`Error`	2.23	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_on	`Error`	3.23	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_reset	`Error`	2.22	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_soft	`Error`	2.22	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_status	`Error`	2.17	test_outofbandmanagement_nestedplugin.py
test_01_invalid_upgrade_kubernetes_cluster	`Failure`	251.14	test_kubernetes_clusters.py
test_02_upgrade_kubernetes_cluster	`Failure`	215.82	test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster	`Failure`	0.05	test_kubernetes_clusters.py
test_04_autoscale_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_05_basic_lifecycle_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_06_delete_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_07_deploy_kubernetes_ha_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_08_upgrade_kubernetes_ha_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_09_delete_kubernetes_ha_cluster	`Failure`	0.04	test_kubernetes_clusters.py
ContextSuite context=TestKubernetesCluster>:teardown	`Error`	92.57	test_kubernetes_clusters.py
test_01_add_delete_kubernetes_supported_version	`Error`	0.24	test_kubernetes_supported_versions.py
test_configure_ha_provider_invalid	`Error`	0.01	test_hostha_simulator.py
test_configure_ha_provider_valid	`Error`	0.01	test_hostha_simulator.py
test_ha_configure_enabledisable_across_clusterzones	`Error`	0.01	test_hostha_simulator.py
test_ha_disable_feature_invalid	`Error`	0.01	test_hostha_simulator.py
test_ha_enable_feature_invalid	`Error`	0.01	test_hostha_simulator.py
test_ha_list_providers	`Error`	0.01	test_hostha_simulator.py
test_ha_multiple_mgmt_server_ownership	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_available	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_degraded	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_fenced	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_recovering	`Error`	0.01	test_hostha_simulator.py
test_hostha_configure_default_driver	`Error`	0.01	test_hostha_simulator.py
test_hostha_configure_invalid_provider	`Error`	0.01	test_hostha_simulator.py
test_hostha_disable_feature_valid	`Error`	0.01	test_hostha_simulator.py
test_hostha_enable_feature_valid	`Error`	0.01	test_hostha_simulator.py
test_hostha_enable_feature_without_setting_provider	`Error`	0.01	test_hostha_simulator.py
test_list_ha_for_host	`Error`	0.01	test_hostha_simulator.py
test_list_ha_for_host_invalid	`Error`	0.01	test_hostha_simulator.py
test_list_ha_for_host_valid	`Error`	0.01	test_hostha_simulator.py
test_CreateTemplateWithDuplicateName	`Error`	40.16	test_templates.py
test_oobm_background_powerstate_sync	`Failure`	21.58	test_outofbandmanagement.py
test_oobm_background_powerstate_sync	`Error`	21.58	test_outofbandmanagement.py
test_oobm_configure_default_driver	`Error`	0.05	test_outofbandmanagement.py
test_oobm_configure_invalid_driver	`Error`	0.04	test_outofbandmanagement.py
test_oobm_disable_feature_invalid	`Error`	0.06	test_outofbandmanagement.py
test_oobm_disable_feature_valid	`Error`	1.13	test_outofbandmanagement.py
test_oobm_enable_feature_invalid	`Error`	0.07	test_outofbandmanagement.py
test_oobm_enable_feature_valid	`Error`	1.10	test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones	`Error`	5.86	test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones	`Error`	5.86	test_outofbandmanagement.py
test_oobm_issue_power_cycle	`Error`	1.24	test_outofbandmanagement.py
test_oobm_issue_power_cycle	`Error`	1.24	test_outofbandmanagement.py
test_oobm_issue_power_off	`Error`	3.31	test_outofbandmanagement.py
test_oobm_issue_power_off	`Error`	3.31	test_outofbandmanagement.py
test_oobm_issue_power_on	`Error`	3.29	test_outofbandmanagement.py
test_oobm_issue_power_on	`Error`	3.29	test_outofbandmanagement.py
test_oobm_issue_power_reset	`Error`	3.36	test_outofbandmanagement.py
test_oobm_issue_power_reset	`Error`	3.36	test_outofbandmanagement.py
test_oobm_issue_power_soft	`Error`	1.24	test_outofbandmanagement.py
test_oobm_issue_power_soft	`Error`	1.24	test_outofbandmanagement.py
test_oobm_issue_power_status	`Error`	3.25	test_outofbandmanagement.py
test_oobm_issue_power_status	`Error`	3.25	test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership	`Error`	1.12	test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership	`Error`	1.12	test_outofbandmanagement.py
test_oobm_zchange_password	`Error`	0.15	test_outofbandmanagement.py
test_oobm_zchange_password	`Error`	0.15	test_outofbandmanagement.py

Jul 27 '22 02:07 blueorangutan

Trillian test result (tid-4548) Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7 Total time taken: 43789 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr6571-t4548-vmware-65u2.zip Smoke tests completed. 81 look OK, 19 have errors Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_deployVMInSharedNetwork	`Error`	80.15	test_network.py
test_03_destroySharedNetwork	`Failure`	1.07	test_network.py
ContextSuite context=TestSharedNetwork>:teardown	`Error`	2.16	test_network.py
test_01_ISO_usage	`Error`	1.07	test_usage.py
test_01_lb_usage	`Error`	3.19	test_usage.py
test_01_nat_usage	`Error`	6.32	test_usage.py
test_01_public_ip_usage	`Error`	1.07	test_usage.py
test_01_snapshot_usage	`Error`	111.42	test_usage.py
test_01_template_usage	`Error`	60.48	test_usage.py
test_01_vm_usage	`Error`	12.36	test_usage.py
test_01_volume_usage	`Error`	11.96	test_usage.py
test_01_vpn_usage	`Error`	8.41	test_usage.py
test_01_snapshot_root_disk	`Error`	8.30	test_snapshots.py
test_query_async_job_result	`Error`	116.67	test_async_job.py
test_revoke_certificate	`Error`	0.01	test_certauthority_root.py
test_02_edit_primary_storage_tags	`Error`	0.02	test_primary_storage.py
test_role_account_acls_multiple_mgmt_servers	`Error`	2.04	test_dynamicroles.py
login_test_saml_user	`Error`	2.49	test_login.py
test_01_positive_tests_usage	`Error`	5.72	test_usage_events.py
test_3d_gpu_support	`Error`	209.82	test_deploy_vgpu_enabled_vm.py
test_01_vpc_privategw_acl	`Error`	115.40	test_privategw_acl.py
test_02_vpc_privategw_static_routes	`Error`	378.13	test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup	`Error`	351.03	test_privategw_acl.py
test_04_rvpc_privategw_static_routes	`Error`	606.12	test_privategw_acl.py
test_01_vpc_privategw_acl	`Error`	0.02	test_privategw_acl_ovs_gre.py
test_03_vpc_privategw_restart_vpc_cleanup	`Error`	0.02	test_privategw_acl_ovs_gre.py
test_05_vpc_privategw_check_interface	`Error`	0.01	test_privategw_acl_ovs_gre.py
test_oobm_issue_power_cycle	`Error`	2.29	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_off	`Error`	3.29	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_on	`Error`	3.27	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_reset	`Error`	2.36	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_soft	`Error`	3.34	test_outofbandmanagement_nestedplugin.py
test_oobm_issue_power_status	`Error`	2.22	test_outofbandmanagement_nestedplugin.py
test_01_invalid_upgrade_kubernetes_cluster	`Failure`	276.22	test_kubernetes_clusters.py
test_02_upgrade_kubernetes_cluster	`Failure`	223.24	test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_04_autoscale_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_05_basic_lifecycle_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_06_delete_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_07_deploy_kubernetes_ha_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_08_upgrade_kubernetes_ha_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_09_delete_kubernetes_ha_cluster	`Failure`	0.03	test_kubernetes_clusters.py
ContextSuite context=TestKubernetesCluster>:teardown	`Error`	42.85	test_kubernetes_clusters.py
test_01_add_delete_kubernetes_supported_version	`Error`	0.22	test_kubernetes_supported_versions.py
test_01_isolated_persistent_network	`Error`	62.51	test_persistent_network.py
test_02_L2_persistent_network	`Error`	1.40	test_persistent_network.py
test_03_deploy_and_destroy_VM_and_verify_network_resources_persist	`Failure`	49.96	test_persistent_network.py
test_configure_ha_provider_invalid	`Error`	0.01	test_hostha_simulator.py
test_configure_ha_provider_valid	`Error`	0.01	test_hostha_simulator.py
test_ha_configure_enabledisable_across_clusterzones	`Error`	0.01	test_hostha_simulator.py
test_ha_disable_feature_invalid	`Error`	0.01	test_hostha_simulator.py
test_ha_enable_feature_invalid	`Error`	0.01	test_hostha_simulator.py
test_ha_list_providers	`Error`	0.01	test_hostha_simulator.py
test_ha_multiple_mgmt_server_ownership	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_available	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_degraded	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_fenced	`Error`	0.01	test_hostha_simulator.py
test_ha_verify_fsm_recovering	`Error`	0.01	test_hostha_simulator.py
test_hostha_configure_default_driver	`Error`	0.01	test_hostha_simulator.py
test_hostha_configure_invalid_provider	`Error`	0.01	test_hostha_simulator.py
test_hostha_disable_feature_valid	`Error`	0.01	test_hostha_simulator.py
test_hostha_enable_feature_valid	`Error`	0.01	test_hostha_simulator.py
test_hostha_enable_feature_without_setting_provider	`Error`	0.01	test_hostha_simulator.py
test_list_ha_for_host	`Error`	0.01	test_hostha_simulator.py
test_list_ha_for_host_invalid	`Error`	0.01	test_hostha_simulator.py
test_list_ha_for_host_valid	`Error`	0.01	test_hostha_simulator.py
test_CreateTemplateWithDuplicateName	`Error`	107.75	test_templates.py
test_oobm_background_powerstate_sync	`Failure`	21.55	test_outofbandmanagement.py
test_oobm_background_powerstate_sync	`Error`	21.56	test_outofbandmanagement.py
test_oobm_configure_default_driver	`Error`	0.05	test_outofbandmanagement.py
test_oobm_configure_invalid_driver	`Error`	0.05	test_outofbandmanagement.py
test_oobm_disable_feature_invalid	`Error`	0.06	test_outofbandmanagement.py
test_oobm_disable_feature_valid	`Error`	0.11	test_outofbandmanagement.py
test_oobm_enable_feature_invalid	`Error`	0.07	test_outofbandmanagement.py
test_oobm_enable_feature_valid	`Error`	0.09	test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones	`Error`	9.67	test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones	`Error`	9.67	test_outofbandmanagement.py
test_oobm_issue_power_cycle	`Error`	3.30	test_outofbandmanagement.py
test_oobm_issue_power_cycle	`Error`	3.31	test_outofbandmanagement.py
test_oobm_issue_power_off	`Error`	2.31	test_outofbandmanagement.py
test_oobm_issue_power_off	`Error`	2.31	test_outofbandmanagement.py
test_oobm_issue_power_on	`Error`	1.23	test_outofbandmanagement.py
test_oobm_issue_power_on	`Error`	1.23	test_outofbandmanagement.py
test_oobm_issue_power_reset	`Error`	1.34	test_outofbandmanagement.py
test_oobm_issue_power_reset	`Error`	1.34	test_outofbandmanagement.py
test_oobm_issue_power_soft	`Error`	2.33	test_outofbandmanagement.py
test_oobm_issue_power_soft	`Error`	2.33	test_outofbandmanagement.py
test_oobm_issue_power_status	`Error`	4.30	test_outofbandmanagement.py
test_oobm_issue_power_status	`Error`	4.30	test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership	`Error`	0.12	test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership	`Error`	0.12	test_outofbandmanagement.py
test_oobm_zchange_password	`Error`	2.18	test_outofbandmanagement.py
test_oobm_zchange_password	`Error`	2.18	test_outofbandmanagement.py

Jul 27 '22 02:07 blueorangutan

Found UI changes, kicking a new UI QA build @blueorangutan ui

Jul 27 '22 07:07 acs-robot

@acs-robot a Jenkins job has been kicked to build UI QA env. I'll keep you posted as I make progress.

Jul 27 '22 07:07 blueorangutan

UI build: :heavy_check_mark: Live QA URL: http://qa.cloudstack.cloud:8080/client/pr/6571 (SL-JID-2010)

Jul 27 '22 07:07 blueorangutan

@blueorangutan package

Jul 27 '22 10:07 weizhouapache

@weizhouapache a Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Jul 27 '22 10:07 blueorangutan

Found UI changes, kicking a new UI QA build @blueorangutan ui

Jul 27 '22 10:07 acs-robot

@acs-robot a Jenkins job has been kicked to build UI QA env. I'll keep you posted as I make progress.

Jul 27 '22 10:07 blueorangutan

UI build: :heavy_check_mark: Live QA URL: http://qa.cloudstack.cloud:8080/client/pr/6571 (SL-JID-2011)

Jul 27 '22 10:07 blueorangutan

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 3837

Jul 27 '22 10:07 blueorangutan

@blueorangutan test

Jul 27 '22 11:07 weizhouapache

@weizhouapache a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Jul 27 '22 11:07 blueorangutan

Trillian test result (tid-4552) Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7 Total time taken: 42083 seconds Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr6571-t4552-kvm-centos7.zip Smoke tests completed. 100 look OK, 0 have errors Only failed tests results shown below:

Test	Result	Time (s)	Test File

Jul 27 '22 23:07 blueorangutan

Found UI changes, kicking a new UI QA build @blueorangutan ui

Aug 02 '22 12:08 acs-robot