spidr
spidr copied to clipboard
Switch to using async-http
Switch from using Ruby's net/http
to using async-http. This would allow for easy connection pooling and concurrent requests, without the overhead of threads and mutexes.
This might be temporarily blocked by socketry/async-http#35. The test suite depends heavily on WebMock.