Number of threads

[tmds]

Currently we are explicitly setting the nr of threads. We need the implementation to control this.

It could be heuristic based on ProcessorCount and nr of accepted sockets. We can fine-tune it based on benchmarks.

Additional threads could also be spun up based on load. I think this may not work well with TE benchmarks. I believe each connection is established before they are used. So that means probably there is little reason to create additional threads when connections are created (low load), causing there to be a single thread that handles all connections.

cc @adamsitnik @antonfirsov

[antonfirsov]

I guess we should base the heuristic on numbers/graphs from Citrine runs.