vscrawler icon indicating copy to clipboard operation
vscrawler copied to clipboard

Published 20 hours ago • verified publisher icon virjar

如何在爬虫框架中开启ip 代理

Open gitama2016 opened this issue 6 years ago • 2 comments

gitama2016 avatar Nov 28 '18 08:11 gitama2016

有很多中方案， 1.实现 com.virjar.vscrawler.core.net.proxy.strategy.ProxyPlanner 2. 提供com.virjar.vscrawler.core.net.proxy.IPPool的实现，然后设置com.virjar.vscrawler.core.net.proxy.strategy.ProxyStrategy 3. 实现 com.virjar.vscrawler.core.event.systemevent.SessionCreateEvent，然后在这里设置代理： crawlerSession.setExtInfo(VSCRAWLER_AVPROXY_KEY, proxy);

virjar avatar Nov 30 '18 08:11 virjar

有很多中方案， 1.实现 com.virjar.vscrawler.core.net.proxy.strategy.ProxyPlanner 2. 提供com.virjar.vscrawler.core.net.proxy.IPPool的实现，然后设置com.virjar.vscrawler.core.net.proxy.strategy.ProxyStrategy 3. 实现 com.virjar.vscrawler.core.event.systemevent.SessionCreateEvent，然后在这里设置代理： crawlerSession.setExtInfo(VSCRAWLER_AVPROXY_KEY, proxy);

哦哦 多谢

gitama2016 avatar Nov 30 '18 08:11 gitama2016