featureprofiles icon indicating copy to clipboard operation
featureprofiles copied to clipboard

OTG: Move ConfigureATE before ConfigureDUT

Open ANISH-GOTTAPU opened this issue 1 year ago • 2 comments

A vendor has indicated that when we execute TE 3.5 and then TE 6.2 one after the other, a problem arises where the test fails to resolve the ARP. The underlying reason for this issue is that the OTG system retains configurations from TE 3.5, causing the DUT to attempt a GARP for an IP that was recently configured on the interface.

This was jointly discussed with the vendor where this failure was seen, Configuring the ATE before the DUT resolves the issue. The same is applicable for most of the tests, we are doing the same for multiple tests in this PR

resolves #743 resolves #574 resolves #733 resolves #577 resolves #573 resolves #596 resolves #572 resolves #560 resolves #563 resolves #564 resolves #1452 resolves #570 resolves #571 Resolves #796 Resolves #1077 Resolves #1102 Resolves #1149 Resolves #982 Resolves #1209 Resolves #1328 Resolves #1150 Resolves #589 Resolves #620 Resolves #725 Resolves #633 Resolves #895 Resolves #881 Resolves #1004 Resolves #893 Resolves #909 Resolves #814 Resolves #1445 Resolves #1700 Resolves #894 Resolves #588 Resolves #1329 Resolves #1193

ANISH-GOTTAPU avatar Aug 14 '23 06:08 ANISH-GOTTAPU

Pull Request Functional Test Report for #2012 / 5457d4f9f00d2332bfc9dca058358609ddce8fcb

Virtual Devices

Device Test Test Documentation Job Raw Log
Arista cEOS status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Cisco 8000E status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Cisco XRd status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Juniper ncPTX status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Nokia SR Linux status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Openconfig Lemming status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection

Hardware Devices

Device Test Test Documentation Raw Log
Arista 7808 status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Cisco 8808 status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Juniper PTX10008 status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Nokia 7250 IXR-10e status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection

Help

OpenConfigBot avatar Aug 14 '23 06:08 OpenConfigBot

Pull Request Test Coverage Report for Build 9321626806

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 55.5%

Totals Coverage Status
Change from base Build 9313491262: 0.0%
Covered Lines: 1983
Relevant Lines: 3573

💛 - Coveralls

coveralls avatar Aug 23 '23 01:08 coveralls