weibo-search
weibo-search copied to clipboard
运行中断提示TypeError: expected string or bytes-like object
2021-12-06 00:16:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://s.weibo.com/weibo?q=%E8%80%81%E6%97%A7%E5%B0%8F%E5%8C%BA&typeall=1&su
ball=1×cope=custom:2021-04-18-0:2021-04-19-0&page=1&sudaref=s.weibo.com&display=0&retcode=6102> (referer: https://s.weibo.com/weibo?q=%E8%80%81%E6%97%
A7%E5%B0%8F%E5%8C%BA&typeall=1&suball=1×cope=custom:2021-01-01-0:2021-07-01-0)
Traceback (most recent call last):
File "d:\软件安装\python\lib\site-packages\scrapy\utils\defer.py", line 120, in iter_errback
yield next(it)
File "d:\软件安装\python\lib\site-packages\scrapy\utils\python.py", line 353, in next
return next(self.data)
File "d:\软件安装\python\lib\site-packages\scrapy\utils\python.py", line 353, in next
return next(self.data)
File "d:\软件安装\python\lib\site-packages\scrapy\core\spidermw.py", line 56, in _evaluate_iterable
for r in iterable:
File "d:\软件安装\python\lib\site-packages\scrapy\spidermiddlewares\offsite.py", line 29, in process_spider_output
for x in result:
File "d:\软件安装\python\lib\site-packages\scrapy\core\spidermw.py", line 56, in _evaluate_iterable
for r in iterable:
File "d:\软件安装\python\lib\site-packages\scrapy\spidermiddlewares\referer.py", line 342, in
Duplicate of #133
同该问题,请点击微博导航栏的 ”回到新版“,按F12获取Cookies.
我也是这个问题,换了cookies也不行怎么办
@Heisenberggggggg 可能还是cookie不正确吧,我现在没法调式,不确定。
重新爬要把crawls文件夹删掉,好像光删里面的search还是会报错