xds-relay icon indicating copy to clipboard operation
xds-relay copied to clipboard

Handle potential thundering herd problem on cache evict

Open jessicayuen opened this issue 4 years ago • 0 comments

On cache evict, orchestrator currently closes upstream and all downstream watches for the key that's getting evicted. This could be problematic if there's a lot of downstream connections for the same aggregated key. This will cause a "thundering herd" problem where all downstreams attempt to re-establish a connection with xds-relay. We need to evaluate how to handle this.

jessicayuen avatar Apr 25 '20 00:04 jessicayuen