sonic-swss icon indicating copy to clipboard operation
sonic-swss copied to clipboard

Fixed DPB system test cases to bring stability

Open samaity opened this issue 3 years ago • 7 comments

Signed-off-by: Sangita Maity [email protected]

What I did Fixed DPB system test cases to bring stability. Used setup_db for all dvs database and checked route interface only during Test.

Why I did it to bring stability to test cases. How I verified it

Details if related

samaity avatar Jun 21 '21 18:06 samaity

This pull request introduces 1 alert when merging 962d4f02ee1c0bb315034a6d42f74948ebd38afe into c37cc1c56336d242fdcc3e728f8e86be992dd382 - view on LGTM.com

new alerts:

  • 1 for Unused import

lgtm-com[bot] avatar Jun 24 '21 05:06 lgtm-com[bot]

This pull request introduces 1 alert when merging 2021663b3a6ed84a9f6d9692e5739697509bb5f2 into c37cc1c56336d242fdcc3e728f8e86be992dd382 - view on LGTM.com

new alerts:

  • 1 for Unused local variable

lgtm-com[bot] avatar Jun 24 '21 16:06 lgtm-com[bot]

@samaity , almost all DPB tests started failing. Can you please take a look asap as this is failing on all PR builds

2021-06-24T22:07:50.0197995Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x50G0] FAILED [ 67%]
2021-06-24T22:08:05.3273736Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-4x25G[10G]0] FAILED [ 67%]
2021-06-24T22:08:20.6140091Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x50G1] FAILED [ 67%]
2021-06-24T22:08:35.8926637Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x25G(2)+1x50G(2)0] FAILED [ 67%]
2021-06-24T22:08:51.0852718Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x50G2] FAILED [ 67%]
2021-06-24T22:09:06.2607801Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x50G(2)+2x25G(2)0] FAILED [ 68%]
2021-06-24T22:09:21.4498592Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x50G3] FAILED [ 68%]
2021-06-24T22:09:23.7821494Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x100G[40G]0] PASSED [ 68%]
2021-06-24T22:09:38.9699459Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-4x25G[10G]1] FAILED [ 68%]
2021-06-24T22:09:54.1440221Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x25G(2)+1x50G(2)1] FAILED [ 68%]
2021-06-24T22:10:09.3171950Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-4x25G[10G]2] FAILED [ 69%]
2021-06-24T22:10:24.5489410Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x50G(2)+2x25G(2)1] FAILED [ 69%]
2021-06-24T22:10:39.7542097Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-4x25G[10G]3] FAILED [ 69%]
2021-06-24T22:10:42.1104153Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x100G[40G]1] PASSED [ 69%]
2021-06-24T22:10:57.3573963Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x25G(2)+1x50G(2)2] FAILED [ 70%]
2021-06-24T22:11:12.5922279Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x50G(2)+2x25G(2)2] FAILED [ 70%]
2021-06-24T22:11:27.8374098Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x25G(2)+1x50G(2)3] FAILED [ 70%]
2021-06-24T22:11:30.1850031Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x100G[40G]2] PASSED [ 70%]
2021-06-24T22:11:45.4409483Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x50G(2)+2x25G(2)3] FAILED [ 70%]
2021-06-24T22:11:47.7903891Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x100G[40G]3] PASSED [ 71%]
2021-06-24T22:12:03.0414342Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_with_vlan FAILED [ 71%]

prsunny avatar Jun 25 '21 05:06 prsunny

@samaity , almost all DPB tests started failing. Can you please take a look asap as this is failing on all PR builds

2021-06-24T22:07:50.0197995Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x50G0] FAILED [ 67%]
2021-06-24T22:08:05.3273736Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-4x25G[10G]0] FAILED [ 67%]
2021-06-24T22:08:20.6140091Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x50G1] FAILED [ 67%]
2021-06-24T22:08:35.8926637Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x25G(2)+1x50G(2)0] FAILED [ 67%]
2021-06-24T22:08:51.0852718Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x50G2] FAILED [ 67%]
2021-06-24T22:09:06.2607801Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x50G(2)+2x25G(2)0] FAILED [ 68%]
2021-06-24T22:09:21.4498592Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x50G3] FAILED [ 68%]
2021-06-24T22:09:23.7821494Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x100G[40G]0] PASSED [ 68%]
2021-06-24T22:09:38.9699459Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-4x25G[10G]1] FAILED [ 68%]
2021-06-24T22:09:54.1440221Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x25G(2)+1x50G(2)1] FAILED [ 68%]
2021-06-24T22:10:09.3171950Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-4x25G[10G]2] FAILED [ 69%]
2021-06-24T22:10:24.5489410Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x50G(2)+2x25G(2)1] FAILED [ 69%]
2021-06-24T22:10:39.7542097Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-4x25G[10G]3] FAILED [ 69%]
2021-06-24T22:10:42.1104153Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x100G[40G]1] PASSED [ 69%]
2021-06-24T22:10:57.3573963Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x25G(2)+1x50G(2)2] FAILED [ 70%]
2021-06-24T22:11:12.5922279Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x50G(2)+2x25G(2)2] FAILED [ 70%]
2021-06-24T22:11:27.8374098Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-2x25G(2)+1x50G(2)3] FAILED [ 70%]
2021-06-24T22:11:30.1850031Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x100G[40G]2] PASSED [ 70%]
2021-06-24T22:11:45.4409483Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x50G(2)+2x25G(2)3] FAILED [ 70%]
2021-06-24T22:11:47.7903891Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_simple[Ethernet0-1x100G[40G]3] PASSED [ 71%]
2021-06-24T22:12:03.0414342Z test_port_dpb_system.py::TestPortDPBSystem::test_port_breakout_with_vlan FAILED [ 71%]

@prsunny, this is strange. It was perfectly fine a few days back. I am looking into this. We didn't make any change in the test file in recent times. I believe, some changes in the building code are failing these test cases as DPB is a highly dispersed topic. will get back soon with my findings. Thanks!

samaity avatar Jun 25 '21 22:06 samaity

@samaity , i agree we dint have recent changes related to DPB and this looks strange that many tests started failing. Could you check the logs (syslogs/swss.rec) from the build pipeline and see if there is any issue. You can get the logs from here. Look for log@1/log/test_port_dpb https://dev.azure.com/mssonic/build/_build/results?buildId=21345&view=artifacts&pathAsName=false&type=publishedArtifacts

prsunny avatar Jun 26 '21 00:06 prsunny

/azp run

samaity avatar Jul 19 '21 20:07 samaity

Commenter does not have sufficient privileges for PR 1795 in repo Azure/sonic-swss

azure-pipelines[bot] avatar Jul 19 '21 20:07 azure-pipelines[bot]