tlsn icon indicating copy to clipboard operation
tlsn copied to clipboard

Implement concurrency limit for notary server

Open yuroitaki opened this issue 4 months ago • 0 comments

Notarization is a resource consuming operation — to prevent being swamped by too many concurrent notarization requests, notary server should limit the number of notarizations that it will process at any point of time. Any notarization request beyond the limit will be put on hold, and served when there is available 'slot'.

One should look into the pros and cons of implementing this in the notary server application code itself or in a reverse proxy — factoring in UX and the fact that some notary server might run multiple versions in the same machine (e.g. PSE's). Also, we might need a queue system to decide which put-on-hold request to serve first.

Alternatively, horizontal scaling can be used to achieve the same objective.

yuroitaki avatar Oct 16 '24 07:10 yuroitaki