text-runner
text-runner copied to clipboard
check external links using a global worker queue
trafficstars
When running Text-Runner in parallel over many code bases I want that external links are checked using a worker queue So that Text-Runner does not not overload the operating system with too many network calls and crashes.
- external links are checked in a global worker queue that applies to all Text-Runner instantiations in the current Node instance
use https://github.com/sindresorhus/p-limit
or https://github.com/sindresorhus/p-queue