djwang comments

Repositories
Issues
Comments

Results 2 comments of


                                             djwang

getting empty data

> I manage to find the problem with this issue. So first u have to go to the function get_data in 'Scweet\utils.py' and change all instances of > > find_element_by_xpath('...')...

定义一个时间段，执行多次，永远只能爬取最后一天的数据，这是什么情况呢？感谢作者提供的代码！

> 我也是，请问这个怎么解决啊 BOT_NAME = 'weibo' SPIDER_MODULES = ['weibo.spiders'] NEWSPIDER_MODULE = 'weibo.spiders' COOKIES_ENABLED = False TELNETCONSOLE_ENABLED = False LOG_LEVEL = 'ERROR' # 访问完一个页面再访问下一个时需要等待的时间，默认为10秒 DOWNLOAD_DELAY = 15 DEFAULT_REQUEST_HEADERS = { 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8',...