vector-demos icon indicating copy to clipboard operation
vector-demos copied to clipboard

EKS aggregator demo with AWS load balancers and Vector source/sink

Open spencergilbert opened this issue 4 years ago • 0 comments

Recapping a discussion with @jszwedko on modeling Vector as-an-aggregator for multiple EKS clusters.

  • Each "leaf" EKS would have a Vector aggregating per cluster
  • Each leaf aggregator forwards to an ALB which balances for the "central" aggregator/s with the vector sink/source

This limits the required in/out bound traffic to just Vector and a single port. Also allows for transformations/filtering at either the distributed or centralized layer.

Alternative:

  • Agents in each leaf cluster forward directly to the central aggregator/s with their needed sources, and reduces configuration maintenance (but may be more complicated load balancer wise).

spencergilbert avatar Aug 27 '21 19:08 spencergilbert