scrapex
scrapex copied to clipboard
True asynchronously requests
Right now, even though Mod.parse/2 can return a (list of) GenSpider.Request, GenSpider still await for it, thus blocking the callee. Need to handle the response message separately when it comes and merge it with the data.