perf: dynamic worker scaling based on available workers for multiproofs

[yongkangc]

Implement adaptive worker pool scaling for parallel proof workers. Currently workers are statically allocated (see #19700), causing over-provisioning during low load and under-provisioning during spikes (e.g., Xen storage node bursts).

We should dynamically spawn/shutdown workers on demand based on avaliable workers, scaling between configurable min/max bounds to reduce thrashing.

This requires benchmarks and testing.

Proposal

• worker avaliability: if its >= 85% usage scale up, once back to 70% we can scale down back to normal
• pending multiproofs: if pending multiproof > 200 (scale up by 20%)

Additional context

[0xKarl98]

Can I ?

[yongkangc]

Can I ?

Hey feel free to give it a shot but this requires benchmark and some testing to find out what is the best range of workers @0xKarl98