MediaCrawler icon indicating copy to clipboard operation
MediaCrawler copied to clipboard

微博的爬取评论功能

Open Websteroo opened this issue 1 year ago • 0 comments

微博的爬取评论功能出现了问题 使用cookie,detail,文章id 这是报错 2024-01-26 17:53:42 MediaCrawler INFO [WeiboCrawler.launch_browser] Begin create browser context ... 2024-01-26 17:53:44 MediaCrawler INFO [WeiboCrawler.create_weibo_client] Begin create weibo API client ... 2024-01-26 17:53:44 MediaCrawler INFO [WeiboClient.pong] Begin pong weibo... 2024-01-26 17:53:44 MediaCrawler ERROR [WeiboClient.pong] Pong weibo failed: TLS/SSL connection has been closed (EOF) (_ssl.c:1129), and try to login again... 2024-01-26 17:53:47 MediaCrawler INFO [WeiboLogin.begin] Begin login weibo ... 2024-01-26 17:53:47 MediaCrawler INFO [WeiboLogin.login_by_qrcode] Begin login weibo by cookie ... 2024-01-26 17:53:47 MediaCrawler INFO [WeiboCrawler.start] redirect weibo mobile homepage and update cookies on mobile platform 2024-01-26 17:53:50 MediaCrawler ERROR [WeiboCrawler.get_note_info_task] Get note detail error: get weibo detail err:
2024-01-26 17:53:50 MediaCrawler INFO [WeiboCrawler.batch_get_notes_comments] note ids:['4982041758140155'] 2024-01-26 17:53:50 MediaCrawler INFO [WeiboCrawler.get_note_comments] begin get note_id: 4982041758140155 comments ... 2024-01-26 17:53:51 MediaCrawler ERROR [WeiboCrawler.get_note_comments] may be been blocked, err:TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-01-26 17:53:51 MediaCrawler INFO [WeiboCrawler.start] Bilibili Crawler finished ...

进程已结束,退出代码0

Websteroo avatar Jan 26 '24 09:01 Websteroo