arista.eos icon indicating copy to clipboard operation
arista.eos copied to clipboard

Add integration tests for eAPI with SSL

Open ClausHolbechArista opened this issue 2 years ago • 7 comments

Depends-on: https://github.com/ansible-collections/ansible.netcommon/pull/494

SUMMARY

Add integration tests for eAPI with SSL

There is no coverage for SSL with eAPI, which would have shown the SSL Cipher issue introduced with Python 3.10. In Python 3.10 the default ciphers are no longer compatible with current Arista EOS versions, so eAPI connection fail with [SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:997).

The issue can be worked around by supplying ciphers manually. Support for this went into ansible-core 2.14 and is being implemented in ansible.netcommon in https://github.com/ansible-collections/ansible.netcommon/pull/494.

This PR add test cases for regular eos_command via eAPI with SSL. The test case is expected to fail with Python3.10 with the error message mentioned above. For ansible-core >= 2.14 another test will run setting the ansible_httpapi_ciphers as introduced in the ansible.netcommon PR referenced above.

This PR will not pass CI until https://github.com/ansible-collections/ansible.netcommon/pull/494 has been merged, so it will be left in draft until then.

ISSUE TYPE
  • Feature Pull Request
COMPONENT NAME

Integration Tests

ADDITIONAL INFORMATION

ClausHolbechArista avatar Dec 19 '22 09:12 ClausHolbechArista

Build succeeded.

:heavy_check_mark: ansible-ee-integration-arista-eos-latest SUCCESS in 1h 06m 48s :heavy_check_mark: ansible-ee-integration-arista-eos-stable-2.9 SUCCESS in 59m 19s :heavy_check_mark: ansible-ee-integration-arista-eos-stable-2.11 SUCCESS in 1h 09m 12s :heavy_check_mark: ansible-ee-integration-arista-eos-stable-2.12 SUCCESS in 1h 06m 09s :heavy_check_mark: ansible-ee-integration-arista-eos-httpapi-latest SUCCESS in 43m 04s :heavy_check_mark: ansible-ee-integration-arista-eos-httpapi-stable-2.9 SUCCESS in 39m 17s :heavy_check_mark: ansible-ee-integration-arista-eos-httpapi-stable-2.11 SUCCESS in 40m 13s :heavy_check_mark: ansible-ee-integration-arista-eos-httpapi-stable-2.12 SUCCESS in 49m 13s :heavy_check_mark: ansible-ee-integration-arista-eos-libssh-latest SUCCESS in 1h 12m 59s :heavy_check_mark: ansible-ee-integration-arista-eos-libssh-stable-2.9 SUCCESS in 1h 04m 40s :heavy_check_mark: ansible-ee-integration-arista-eos-libssh-stable-2.11 SUCCESS in 1h 14m 39s :heavy_check_mark: ansible-ee-integration-arista-eos-libssh-stable-2.12 SUCCESS in 1h 09m 41s :heavy_check_mark: build-ansible-collection SUCCESS in 4m 03s :heavy_check_mark: ansible-tox-linters SUCCESS in 5m 05s :heavy_check_mark: ansible-galaxy-importer SUCCESS in 3m 59s

recheck

Qalthos avatar Feb 10 '23 19:02 Qalthos

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/460a0d91c290491e94e9a26137abadb9

:heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable214 SUCCESS in 39m 11s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable213 SUCCESS in 36m 05s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable212 SUCCESS in 35m 45s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable211 SUCCESS in 35m 21s :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable214-scenario01 SUCCESS in 32m 39s (non-voting) :x: ansible-test-network-integration-eos-network_cli-python39-stable214-scenario02 FAILURE in 32m 29s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable214-scenario01 SUCCESS in 36m 06s (non-voting) :x: ansible-test-network-integration-eos-network_cli-libssh-python39-stable214-scenario02 FAILURE in 32m 56s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable213-scenario01 SUCCESS in 32m 21s (non-voting) :x: ansible-test-network-integration-eos-network_cli-python39-stable213-scenario02 FAILURE in 37m 39s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable213-scenario01 SUCCESS in 34m 34s (non-voting) :x: ansible-test-network-integration-eos-network_cli-libssh-python39-stable213-scenario02 FAILURE in 31m 36s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable212-scenario01 SUCCESS in 30m 57s (non-voting) :x: ansible-test-network-integration-eos-network_cli-python39-stable212-scenario02 FAILURE in 38m 46s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable212-scenario01 SUCCESS in 35m 26s (non-voting) :x: ansible-test-network-integration-eos-network_cli-libssh-python39-stable212-scenario02 FAILURE in 36m 37s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable211-scenario01 SUCCESS in 35m 32s (non-voting) :x: ansible-test-network-integration-eos-network_cli-python39-stable211-scenario02 FAILURE in 36m 16s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable211-scenario01 SUCCESS in 31m 33s (non-voting) :x: ansible-test-network-integration-eos-network_cli-libssh-python39-stable211-scenario02 FAILURE in 37m 01s (non-voting) :heavy_check_mark: build-ansible-collection SUCCESS in 8m 33s :heavy_check_mark: ansible-tox-linters SUCCESS in 10m 17s :x: ansible-galaxy-importer RETRY_LIMIT in 15s

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/ed806d754a7249fd9f7a4d8b0bd00304

:heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable214 SUCCESS in 45m 01s :x: ansible-test-network-integration-eos-httpapi-python39-stable213 RETRY_LIMIT in 1m 29s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable212 SUCCESS in 40m 42s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable211 SUCCESS in 39m 11s :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable214-scenario01 SUCCESS in 32m 05s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable214-scenario02 SUCCESS in 34m 06s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable214-scenario01 SUCCESS in 35m 36s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable214-scenario02 SUCCESS in 37m 06s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable213-scenario01 SUCCESS in 35m 11s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable213-scenario02 SUCCESS in 38m 03s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable213-scenario01 SUCCESS in 35m 45s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable213-scenario02 SUCCESS in 38m 26s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable212-scenario01 SUCCESS in 35m 49s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable212-scenario02 SUCCESS in 36m 42s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable212-scenario01 SUCCESS in 36m 31s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable212-scenario02 SUCCESS in 32m 54s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable211-scenario01 SUCCESS in 33m 45s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable211-scenario02 SUCCESS in 36m 47s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable211-scenario01 SUCCESS in 33m 23s (non-voting) :x: ansible-test-network-integration-eos-network_cli-libssh-python39-stable211-scenario02 RETRY_LIMIT in 4m 19s (non-voting) :heavy_check_mark: build-ansible-collection SUCCESS in 8m 47s :heavy_check_mark: ansible-tox-linters SUCCESS in 10m 56s :heavy_check_mark: ansible-galaxy-importer SUCCESS in 4m 51s

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/74338890c79948ffaa56d982abdd5d04

:heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable214 SUCCESS in 43m 41s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable213 SUCCESS in 39m 46s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable212 SUCCESS in 39m 24s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable211 SUCCESS in 39m 29s :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable214-scenario01 SUCCESS in 36m 24s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable214-scenario02 SUCCESS in 37m 02s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable214-scenario01 SUCCESS in 32m 19s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable214-scenario02 SUCCESS in 38m 06s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable213-scenario01 SUCCESS in 31m 05s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable213-scenario02 SUCCESS in 37m 01s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable213-scenario01 SUCCESS in 32m 23s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable213-scenario02 SUCCESS in 38m 30s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable212-scenario01 SUCCESS in 31m 59s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable212-scenario02 SUCCESS in 36m 34s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable212-scenario01 SUCCESS in 31m 01s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable212-scenario02 SUCCESS in 37m 05s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable211-scenario01 SUCCESS in 32m 09s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable211-scenario02 SUCCESS in 40m 41s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable211-scenario01 SUCCESS in 30m 38s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable211-scenario02 SUCCESS in 37m 26s (non-voting) :heavy_check_mark: build-ansible-collection SUCCESS in 8m 47s :x: ansible-tox-linters FAILURE in 10m 42s :heavy_check_mark: ansible-galaxy-importer SUCCESS in 4m 29s

recheck

ClausHolbechArista avatar Aug 14 '23 07:08 ClausHolbechArista

Build succeeded. https://ansible.softwarefactory-project.io/zuul/buildset/4951d6fe2bb74688909814bd24b768d4

:heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable214 SUCCESS in 44m 02s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable213 SUCCESS in 43m 41s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable212 SUCCESS in 42m 31s :heavy_check_mark: ansible-test-network-integration-eos-httpapi-python39-stable211 SUCCESS in 43m 23s :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable214-scenario01 SUCCESS in 38m 13s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable214-scenario02 SUCCESS in 40m 51s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable214-scenario01 SUCCESS in 37m 47s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable214-scenario02 SUCCESS in 32m 58s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable213-scenario01 SUCCESS in 37m 42s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable213-scenario02 SUCCESS in 39m 45s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable213-scenario01 SUCCESS in 31m 59s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable213-scenario02 SUCCESS in 38m 13s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable212-scenario01 SUCCESS in 31m 05s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable212-scenario02 SUCCESS in 38m 53s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable212-scenario01 SUCCESS in 34m 13s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable212-scenario02 SUCCESS in 39m 04s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable211-scenario01 SUCCESS in 31m 10s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-python39-stable211-scenario02 SUCCESS in 37m 25s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable211-scenario01 SUCCESS in 31m 29s (non-voting) :heavy_check_mark: ansible-test-network-integration-eos-network_cli-libssh-python39-stable211-scenario02 SUCCESS in 37m 31s (non-voting) :heavy_check_mark: build-ansible-collection SUCCESS in 8m 45s :heavy_check_mark: ansible-tox-linters SUCCESS in 10m 44s :heavy_check_mark: ansible-galaxy-importer SUCCESS in 5m 17s