gRPC-multiprocessing icon indicating copy to clipboard operation
gRPC-multiprocessing copied to clipboard

Request distribution

Open internetstaff opened this issue 3 years ago • 1 comments

Thanks for this example - it was very helpful.

I have a very similar use case with CPU intensive requests. Multiprocessing works well with one limitation: I see requests frequently being accepted by a process that's already busy and having to wait - while other processes are idle.

Did you encounter this? If so, did you find a work-around?

internetstaff avatar Feb 13 '22 19:02 internetstaff

I did encounter this issue sometimes too. Unfortunately, I couldn't understand why my requests were routed towards busy process at what seems to be random intervals. Most of the times the "load balancing" worked, but I have no insights on how to adjust for those cases where the request is routed to a busy process.

fpaupier avatar Feb 20 '22 12:02 fpaupier