bigqueue icon indicating copy to clipboard operation
bigqueue copied to clipboard

Concurrent requests/reply IPC

Open alexec opened this issue 4 years ago • 2 comments

I'm trying to improve the throughput of an app I'm building. Essentially, it currently uses Unix Domain Sockets to transfer messages between two processes. This is because they are well supported in many programming languages, and easy to use for request/reply.

But combining the two process into a single process I get 10x the TPS. So I know there is up-to 10x potential improvement.

My questions is, can mmap do this, give some constraints:

  • Request/reply (like HTTP).
  • Concurrent, multiple request/replies in flight.

alexec avatar Oct 12 '21 21:10 alexec

You should totally give it a try though I don't think bigqueue would be a right fit across processes given the current state of things. We do plan to improve bigqueue to work across processes but that is not the case today.

aman-arista avatar Oct 21 '21 19:10 aman-arista

Thank you for your reply.

I'd like to do request/reply between two processes, but faster than Unix Domain Socket.

Just wondered if you'd had some ideas.

alexec avatar Oct 21 '21 22:10 alexec