Description


Main release stage issue	https://github.com/wazuh/wazuh/issues/23405
Version	4.8.0
Release stage	RC 2
Wazuh QA: Tag	https://github.com/wazuh/wazuh-qa/tree/v4.8.0-rc2
Wazuh QA: Branch	`v4.8.0-rc2`
Wazuh: Tag	https://github.com/wazuh/wazuh/tree/v4.8.0-rc2
Wazuh: Branch	`v4.8.0-rc2`

The tests will be performed in Jenkins using centOS as the manager OS. As for the agents, Linux, Windows, Solaris, and macOS will be used as required.

Build

Build: https://ci.wazuh.info/job/Test_integration_launcher/253/

Results of the integration tests

Color Details

:green_circle: The pipeline has been executed successfully

:red_circle: The pipeline has failed or it has errors

Color	Details
:green_circle:	The pipeline has been executed successfully
:red_circle:	The pipeline has failed or it has errors

Test suite	Target	CentOS	Ubuntu	Windows	macOS	Solaris
active_response	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
active_response	Agent	:green_circle: Download evidence	N/A	:green_circle: Download evidence	N/A	N/A
agentd	Agent	:green_circle: Download evidence	N/A	:red_circle: Download evidence	N/A	N/A
analysisd	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
api	Manager	:red_circle: Download evidence	N/A	N/A	N/A	N/A
authd	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
enrollment	Agent	:green_circle: Download evidence	N/A	:green_circle: Download evidence	N/A	N/A
fim	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
fim	Agent	:green_circle: Download evidence	N/A	:green_circle: Download evidence	N/A	N/A
fim	Agent	N/A	N/A	N/A	:green_circle:	:green_circle:
gcloud	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
github	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
github	Agent	:green_circle: Download evidence	N/A	N/A	N/A	N/A
logcollector	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
logcollector	Agent	:green_circle: Download evidence	N/A	:red_circle: Download evidence	:green_circle: Download evidence	:green_circle: Download evidence
logtest	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
office_365	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
office_365	Agent	:green_circle: Download evidence	N/A	N/A	N/A	N/A
remoted	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
rids	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
rootcheck	Manager	:red_circle: Download evidence	N/A	N/A	N/A	N/A
wazuh_db	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
syscollector	Manager	:green_circle: Download evidence	N/A	N/A	N/A	N/A
syscollector	Agent	:green_circle: Couldn't get evidence. Check the pipeline.	N/A	:red_circle: Couldn't get evidence. Check the pipeline.	:green_circle: Couldn't get evidence. Check the pipeline.	N/A

Conclusion :red_circle:

New Issues

https://github.com/wazuh/wazuh/issues/23465

Known issues

https://github.com/wazuh/wazuh-qa/issues/5096
https://github.com/wazuh/wazuh-qa/issues/4840
https://github.com/wazuh/wazuh-qa/issues/5034
#22495
https://github.com/wazuh/wazuh/issues/22058
https://github.com/wazuh/wazuh-qa/issues/4230

May 15 '24 09:05 Rebits

GA IT

List of GA

API:
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-api-tier-0-1.yml
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-api-tier-2.yml
Analysisd
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-analysisd-tier-0-1.yml
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-analysisd-tier-2.yml
Execd:
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-execd-tier-0-1-lin.yml
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-execd-tier-0-1-win.yml
Github
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-github-tier-0-1-lin.yml
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-github-tier-0-1-win.yml
Office365
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-office365-tier-0-1-lin.yml
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-office365-tier-0-1-win.yml
MSGraph
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-msgraph-tier-0-1-lin.yml
Vulnerability Detection (Disabled)
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-vulnerability_detector-tier-0-1.yml
- https://github.com/wazuh/wazuh/actions/workflows/integration-tests-vulnerability_detector-tier-2.yml

May 15 '24 16:05 Rebits

GA Executions

API :green_circle:

https://github.com/wazuh/wazuh/actions/runs/9099696421
https://github.com/wazuh/wazuh/actions/runs/9099718436

Analysisd :green_circle:

https://github.com/wazuh/wazuh/actions/runs/9099727142
https://github.com/wazuh/wazuh/actions/runs/9099732719

Execd :green_circle:

https://github.com/wazuh/wazuh/actions/runs/9099738391
https://github.com/wazuh/wazuh/actions/runs/9099743610

Github :green_circle:

https://github.com/wazuh/wazuh/actions/runs/9099758667
https://github.com/wazuh/wazuh/actions/runs/9099763896

Office365 :green_circle:

https://github.com/wazuh/wazuh/actions/runs/9099772613
https://github.com/wazuh/wazuh/actions/runs/9099779649

MSGraph :green_circle:

https://github.com/wazuh/wazuh/actions/runs/9099785809

May 15 '24 16:05 Rebits

Results of IT from Jenkins Build

Syscollector :yellow_circle:

Failure during deployment of instances. Known issue. Reported https://github.com/wazuh/wazuh-jenkins/issues/5539 Rerun in https://ci.wazuh.info/job/Test_integration/47302

Tests fail due to a known issue: https://github.com/wazuh/wazuh-qa/issues/4230

Error trace

11:42:04  Command: ["import", "/var/root/.vagrant.d/boxes/development-VAGRANTSLASH-macos-catalina/0/virtualbox/box.ovf", "--vsys", "0", "--vmname", "new_box_macos_fim_test_1582644530271_78262_1715769345026_74264", "--vsys", "0", "--unit", "12", "--disk", "/Users/jenkins/VirtualBox VMs/new_box_macos_fim_test_1582644530271_78262_1715769345026_74264/box-disk001.vmdk"]
11:42:04  
11:42:04  Stderr: 0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%

Rootcheck :yellow_circle:

Known issue: https://github.com/wazuh/wazuh/issues/22058 Already migrated to GHA: https://github.com/wazuh/wazuh/issues/22058.

Rootcheck ITs were integrated in analysisd, which was migrated to GHA. Unmarking it from the launcher https://github.com/wazuh/wazuh/issues/23434#issuecomment-2114647012

Logcollector :yellow_circle:

Failure during teardonwn in test_logcollector/test_location/test_win_location_wildcards.py::test_win_location_wildcards[test_mixed_wildcards-]::teardown:

E           OSError: [WinError 145] The directory is not empty: 'c:\\testfolder\\subfolder'

Logcollector IT has already been migrated ti GHA. However, these tests are not present in 4.8.0 branch

Known issue: https://github.com/wazuh/wazuh-qa/issues/5096

Fim specials :green_circle:

Failure during deployment of instances. Known issue. Reported https://github.com/wazuh/wazuh-jenkins/issues/5539 Rerun in https://ci.wazuh.info/job/Test_integration/47303/

Error trace

11:42:04  Command: ["import", "/var/root/.vagrant.d/boxes/development-VAGRANTSLASH-macos-catalina/0/virtualbox/box.ovf", "--vsys", "0", "--vmname", "new_box_macos_fim_test_1582644530271_78262_1715769345026_74264", "--vsys", "0", "--unit", "12", "--disk", "/Users/jenkins/VirtualBox VMs/new_box_macos_fim_test_1582644530271_78262_1715769345026_74264/box-disk001.vmdk"]
11:42:04  
11:42:04  Stderr: 0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%

FIM tests passed after solving deployment error. Marking as :green_circle:

API :yellow_circle:

Already migrated to GHA. I suggest removing them from the launcher. Known issue #22495 Unmarking it from the launcher https://github.com/wazuh/wazuh/issues/23434#issuecomment-2114647012

Agentd Windows :red_circle:

Unexpected failure in Windows agentd test test_agentd/test_agentd_reconnection.py::test_agentd_reconection_enrollment_no_keys_file[tcp]

                    self.stop()
                    if error_message:
                        logger.error(error_message)
                        logger.error(f"Results accumulated: "
                                     f"{len(result) if isinstance(result, list) else 0}")
                        logger.error(f"Results expected: {accum_results}")
>                   raise TimeoutError(error_message)
E                   TimeoutError: Agent never enrolled for the first time.

Agentd IT seems to have already been migrated. However, these are not present for the 4.8.0 branch. For this reason a manual review is required. Reported in https://github.com/wazuh/wazuh/issues/23465

May 15 '24 17:05 Rebits

I have disabled by default from the IT launcher the following IT modules:

API
Analysisd
Github
Office
Rootcheck

All these modules have been migrated in 4.7 and 4.8 to GHA, so there is no need to run these tests in Jenkins

Approved by

[x] @juliamagan

May 16 '24 09:05 Rebits

LGTM

May 16 '24 15:05 MARCOSD4

LGTM

May 17 '24 11:05 juliamagan

Release 4.8.0 - RC 2 - Integration tests

Description

Build

Results of the integration tests

Conclusion :red_circle:

GA IT

List of GA

GA Executions

API :green_circle:

Analysisd :green_circle:

Execd :green_circle:

Github :green_circle:

Office365 :green_circle:

MSGraph :green_circle:

Results of IT from Jenkins Build

Syscollector :yellow_circle:

Rootcheck :yellow_circle:

Logcollector :yellow_circle:

Fim specials :green_circle:

API :yellow_circle:

Agentd Windows :red_circle: