weibo-crawler icon indicating copy to clipboard operation
weibo-crawler copied to clipboard

运行报错,请问如何修改呢

Open xiaosunlai opened this issue 5 months ago • 6 comments

error.log显示 2025-07-03 00:41:01,012 - ERROR - weibo.py[:2221] - 'NoneType' object has no attribute 'encoding' Traceback (most recent call last): File "C:\Users\Administrator\Desktop\weibo-crawler-master\weibo.py", line 2183, in get_pages if self.get_user_info() != 0: ~~~~~~~~~~~~~~~~~~^^ File "C:\Users\Administrator\Desktop\weibo-crawler-master\weibo.py", line 546, in get_user_info self.user = self.standardize_info(user_info) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ File "C:\Users\Administrator\Desktop\weibo-crawler-master\weibo.py", line 959, in standardize_info .encode(sys.stdout.encoding, "ignore") ^^^^^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'encoding'

all.log显示 2025-07-03 00:41:01,012 - ERROR - 'NoneType' object has no attribute 'encoding' Traceback (most recent call last): File "C:\Users\Administrator\Desktop\weibo-crawler-master\weibo.py", line 2183, in get_pages if self.get_user_info() != 0: ~~~~~~~~~~~~~~~~~~^^ File "C:\Users\Administrator\Desktop\weibo-crawler-master\weibo.py", line 546, in get_user_info self.user = self.standardize_info(user_info) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ File "C:\Users\Administrator\Desktop\weibo-crawler-master\weibo.py", line 959, in standardize_info .encode(sys.stdout.encoding, "ignore") ^^^^^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'encoding' 2025-07-03 00:41:01,014 - INFO - 信息抓取完毕 2025-07-03 00:41:01,015 - INFO - ****************************************************************************************************

xiaosunlai avatar Jul 02 '25 16:07 xiaosunlai

有可能和cmd工具有关,换个软件看看。

dataabc avatar Jul 03 '25 06:07 dataabc

之前程序可以抓取成功的,最近在抓取数据,出现如下错误。 @dataabc 博主回答的换个软件是什么意思。我在eclipse中运行。 Expecting value: line 1 column 1 (char 0) Traceback (most recent call last): File "D:\EclipseAI\workspace\weibo-crawler-master\weibo.py", line 1966, in get_pages if self.get_user_info() != 0: File "D:\EclipseAI\workspace\weibo-crawler-master\weibo.py", line 370, in get_user_info js, status_code = self.get_json(params) File "D:\EclipseAI\workspace\weibo-crawler-master\weibo.py", line 232, in get_json return r.json(), r.status_code File "C:\ProgramData\Anaconda3\lib\site-packages\requests\models.py", line 898, in json return complexjson.loads(self.text, **kwargs) File "C:\ProgramData\Anaconda3\lib\json_init_.py", line 357, in loads return _default_decoder.decode(s) File "C:\ProgramData\Anaconda3\lib\json\decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "C:\ProgramData\Anaconda3\lib\json\decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) 信息抓取完毕


annekqiu avatar Jul 07 '25 03:07 annekqiu

@annekqiu 我用的是cmder,有可能是编码问题,也有可能之前爬的太多,被暂时限制了,不确定。

dataabc avatar Jul 07 '25 07:07 dataabc

@annekqiu 两点需要修改 1.ua 变了 key 有变化 不能识别了,自己检查修改下;2. 添加 refer 为微博的域名,否则会 403。

atanxin avatar Jul 07 '25 07:07 atanxin

@annekqiu 两点需要修改 1.ua 变了 key 有变化 不能识别了,自己检查修改下;2. 添加 refer 为微博的域名,否则会 403。

感谢回复,改了UA,没有效果。程序里面有url的网址是https://m.weibo.cn。

annekqiu avatar Jul 07 '25 10:07 annekqiu

@annekqiu 我用的是cmder,有可能是编码问题,也有可能之前爬的太多,被暂时限制了,不确定。

重新下载了博主当前的新程序,不存在这个问题。可运行。

annekqiu avatar Jul 07 '25 10:07 annekqiu