electric-sql
Slow to respond concurrent requests for new shapes
When multiple concurrent requests for new shapes come in, requests and responses are all routed through the ShapeCache causing delays and flooding of the process mailbox. Requests can instead be routed to individual shape worker processes to handle their needs, like waiting for snapshots and requesting a log etc.
The goal is to move stuff off of the critical path of the requests and enable quick responses, even if the responses are 429s because of e.g. pool connection resource limitations.
https://github.com/electric-sql/electric/pull/1787 should address sending requests directly to the shape workers
There's more work that's easily done to remove responsibilities from ShapeCache, but I'd rather do it after merging the above PR.