featureprofiles icon indicating copy to clipboard operation
featureprofiles copied to clipboard

transceiver 5 delay

Open hmod2001 opened this issue 3 months ago • 6 comments

The Test400ZRTunableFrequency and related optical channel tests are experiencing intermittent failures with two main failure patterns: Statistical Validation Failures Optical-Channel: carrier-frequency-offset min: -1 greater than carrier-frequency-offset avg: -13 This error occurs when telemetry statistical values (min/max/avg) are inconsistent, due to:

Race conditions during telemetry collection Stale/cached telemetry data being used for validation Device updating statistical values non-atomically

Interface Timeout Failures context deadline exceeded This occurs when optical interfaces take longer than the configured timeout to come up after configuration changes. Root Causes:

The test collects telemetry immediately after configuration, but optical modules need time to stabilize their statistical measurements Insufficient Stabilization Time: 90-second timeout and 80-second stabilization delays are insufficient for optical channel convergence Floating-point precision issues in statistical comparisons

This PR implements a targeted fix addressing the specific failure patterns:

Enhanced Telemetry Stabilization

Increased timeout from 90 seconds to 3 minutes for optical interface convergence Increased stabilization delays after configuration changes (from 80s to 100s before validation) Extended telemetry wait time to allow statistical measurements to stabilize

Sample Flushing for Fresh Data

Flushes old/stale samples from telemetry streams before validation Validates data sanity before using telemetry for statistical comparisons Retry logic for telemetry collection with up to 3 attempts

Robust Statistical Validation

Proper floating-point handling with rounding to 1 decimal place Statistical tolerance (±0.1) for min/max/avg comparisons

hmod2001 avatar Sep 25 '25 21:09 hmod2001

Pull Request Test Coverage Report for Build 18042594472

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 11.869%

Totals Coverage Status
Change from base Build 18040415933: 0.0%
Covered Lines: 2113
Relevant Lines: 17802

💛 - Coveralls

coveralls avatar Sep 27 '25 00:09 coveralls

@rezachit will need to review and approve first, then I can give final approval, thanks.

dplore avatar Sep 29 '25 19:09 dplore

logs-t5.txt

hmod2001 avatar Oct 16 '25 23:10 hmod2001

@hmod2001 Can the changes be added to ZRP as well?

AmrNJ avatar Nov 07 '25 13:11 AmrNJ