gateway icon indicating copy to clipboard operation
gateway copied to clipboard

feat: configure new route propagation benchmark tests

Open missBerg opened this issue 6 months ago • 8 comments

What type of PR is this?

test: enhance benchmark suite with route propagation timing metrics

What this PR does / why we need it:

This PR enhances the Envoy Gateway benchmark testing suite by introducing route propagation timing measurements, providing critical visibility into configuration deployment performance.

Key Enhancements:

🔍 Route Propagation Timing Framework

  • New timing metrics: Measures control plane time (route creation → RouteConditionAccepted=True), data plane time (acceptance → traffic flowing), and end-to-end deployment time
  • Performance visibility: Provides operational insights into how quickly configuration changes take effect in production environments
  • Scale correlation: Tracks timing vs route count for capacity planning and performance regression detection

📊 Enhanced Reporting

  • Integrated timing tables: Benchmark reports now include dedicated route propagation metrics sections
  • Comprehensive documentation: Added detailed ROUTE_PROPAGATION_METRICS.md with usage instructions, troubleshooting, and CI/CD integration examples
  • Better test organization: Refactored benchmark suite architecture with improved type definitions and modular structure

🎯 Operational Value

  • Configuration velocity insights: Understanding deployment timing for operational planning
  • Performance baseline establishment: Foundation for monitoring control plane performance characteristics
  • Troubleshooting support: Detailed timing breakdowns help identify bottlenecks in route propagation

Why We Need This:

  1. Operational visibility: Understand how long configuration changes take to propagate, especially at scale
  2. Performance monitoring: Establishes baseline metrics for detecting regressions in control plane performance
  3. Capacity planning: Route count vs timing correlation helps with infrastructure sizing decisions

Which issue(s) this PR fixes: N/A

Release Notes: Yes

missBerg avatar Jun 17 '25 14:06 missBerg

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 70.69%. Comparing base (e78e268) to head (ab05193). Report is 3 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #6334      +/-   ##
==========================================
+ Coverage   70.67%   70.69%   +0.01%     
==========================================
  Files         220      220              
  Lines       37003    37003              
==========================================
+ Hits        26153    26160       +7     
+ Misses       9312     9306       -6     
+ Partials     1538     1537       -1     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

codecov[bot] avatar Jun 17 '25 14:06 codecov[bot]

/retest

missBerg avatar Jun 17 '25 17:06 missBerg

thanks @missBerg !

hey @shawnh2 ptal

arkodg avatar Jun 17 '25 17:06 arkodg

/retest

missBerg avatar Jun 18 '25 00:06 missBerg

/retest

missBerg avatar Jun 18 '25 02:06 missBerg

/retest

missBerg avatar Jun 18 '25 04:06 missBerg

/retest

missBerg avatar Jun 18 '25 13:06 missBerg

/retest

missBerg avatar Jun 18 '25 21:06 missBerg