groupcache icon indicating copy to clipboard operation
groupcache copied to clipboard

Published 20 hours ago • verified publisher icon mailgun

Support batching multiple `Get()` requests in a single HTTP request

Open thrawn01 opened this issue 5 years ago • 3 comments

This would work just like mailgun/gubernators PeerClient which would wait a few microseconds and batch requests together in a single request. This technique has dramatically improved throughput of gubernator, I imagine groupcache would also benefit. In production we have seen batch sizes of 1k in a single request when queueing for only 500 Microseconds.

thrawn01 avatar Jun 04 '19 22:06 thrawn01

Is this feature complete?

haifeiWu avatar Feb 24 '21 06:02 haifeiWu

No this work was never done.

thrawn01 avatar Mar 02 '21 17:03 thrawn01

If I want to implement this feature, what issues should I pay attention to?

haifeiWu avatar Mar 03 '21 02:03 haifeiWu