MediaCrawler icon indicating copy to clipboard operation
MediaCrawler copied to clipboard

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 百度贴吧评论回复爬虫 | 知乎问答文章|评论爬虫

Results 248 MediaCrawler issues
Sort by recently updated
recently updated
newest added

2024-04-14 23:45:21 MediaCrawler ERROR [DouYinCrawler.get_aweme_detail] Get aweme detail error: Expecting value: line 1 column 1 (char 0), 2024-04-14 23:45:21 MediaCrawler ERROR [DouYinCrawler.get_aweme_detail] Get aweme detail error: Expecting value: line 1...

执行python main.py --platform xhs --lt qrcode --type search报错: E:\vscode\notes\notes\项目\MediaCrawler\MediaCrawler-main\MediaCrawler-main\main.py:68: DeprecationWarning: There is no current event loop asyncio.get_event_loop().run_until_complete(main()) 2024-04-15 21:16:47 MediaCrawler INFO [XiaoHongShuCrawler.launch_browser] Begin create browser context ... 2024-04-15 21:16:49 MediaCrawler...

参照readme爬取小红书的两个命令都ok,爬取抖音命令扫码后报错: ``` (d2l) D:\file\file\Win10Share\md\python\code\MediaCrawler>python main.py 2024-04-16 17:37:09 MediaCrawler INFO [DouYinLogin.login_by_qrcode] Begin login douyin by qrcode... 2024-04-16 17:37:17 MediaCrawler INFO [DouYinLogin.begin] login finished then check login state ... 2024-04-16 17:37:37 MediaCrawler...

新增id,解决同一天内的不同查询写入同一个文件的问题,方便提取新的查询结果。

一直显示 cookie may be invalid and again login... ![image](https://github.com/NanmiCoder/MediaCrawler/assets/75710285/ae1f2a77-553b-4d79-be20-68f853d17591) 无法获取评论 无法通过某个微博id获取微博信息 大佬这是咋回事呀

bug

`python main.py --platform xhs --lt qrcode --type detail` 和 `python main.py --platform xhs --lt qrcode --type creator` 都不会下载图片,只有 metadata

execjs._exceptions.ProgramError: TypeError: Cannot read property 'JS_MD5_NO_COMMON_JS' of null

RT, 感谢大佬开源, 不知道有没有自动登录之后发微博的接口。