MediaCrawler icon indicating copy to clipboard operation
MediaCrawler copied to clipboard

Published 20 hours ago • verified publisher icon NanmiCoder

微博评论数据爬取失败

Open ly1327 opened this issue 1 year ago • 4 comments

评论数据爬取失败，是什么问题呢？以下是日志输出内容： MediaCrawler ERROR [WeiboCrawler.get_note_comments] may be been blocked, err:Expecting value: line 1 column

ly1327 avatar Mar 08 '24 09:03 ly1327

微博平台的话可能IP被暂时封禁了，过一会尝试一下还报错吗

NanmiCoder avatar Mar 08 '24 14:03 NanmiCoder

一直都没成功过，我这几天尝试很多遍了

ly1327 avatar Mar 09 '24 00:03 ly1327

为啥我将request的header设置为空后评论就爬取成功了？之前的加上header信息就报错？求解！

ly1327 avatar Mar 11 '24 14:03 ly1327

@NanmiCoder

ly1327 avatar Mar 11 '24 14:03 ly1327