CrawlerX
CrawlerX copied to clipboard
dlutwuwei
A crawler can use different strategy to different url pattern
how to reproduce： the page encoding is gb2312，the code is like: crawler.request("pageUrl",{decode:"gb2312",deep:3,concurrency:4}, function(err, $, body,url,resp){ $.spider(); //start recursive crawl }); when the page include Chinese, then I got garbled body...
how to reproduce： the page encoding is gb2312，the code is like: ``` crawler.request("pageUrl",{decode:"gb2312",deep:3,concurrency:4}, function(err, $, body,url,resp){ $.spider(); //start recursive crawl }); ``` when the page include Chinese, then I got...