weibo-crawler icon indicating copy to clipboard operation
weibo-crawler copied to clipboard

只能爬取200页微博是怎么回事?

Open twilight1024 opened this issue 2 years ago • 10 comments

twilight1024 avatar Apr 02 '23 10:04 twilight1024

添加cookie看看。

dataabc avatar Apr 02 '23 16:04 dataabc

您好,您的邮件我已经收到!若有其他问题我将通过邮件或电话等方式联系您!

twilight1024 avatar Apr 02 '23 16:04 twilight1024

添加了之后还是不行

twilight1024 avatar Apr 02 '23 17:04 twilight1024

添加cookie看看。

可以了可以了

twilight1024 avatar Apr 02 '23 17:04 twilight1024

添加cookie看看。

stat: path should be string, bytes, os.PathLike or integer, not NoneType Traceback (most recent call last): File "D:\weibo-crawler-master4\weibo-crawler-master\weibo.py", line 1883, in get_pages self.write_data(wrote_count) File "D:\weibo-crawler-master4\weibo-crawler-master\weibo.py", line 1836, in write_data self.write_csv(wrote_count) File "D:\weibo-crawler-master4\weibo-crawler-master\weibo.py", line 1293, in write_csv self.csv_helper(result_headers, result_data, file_path) File "D:\weibo-crawler-master4\weibo-crawler-master\weibo.py", line 1297, in csv_helper if not os.path.isfile(file_path): File "D:\anaconda\lib\genericpath.py", line 30, in isfile st = os.stat(path) TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType 信息抓取完毕


这是怎么回事呀?

twilight1024 avatar Apr 02 '23 17:04 twilight1024

同问,添加了cookie之后还是不行

UniversalRedBlue avatar Nov 29 '23 06:11 UniversalRedBlue

您好,您的邮件我已经收到!若有其他问题我将通过邮件或电话等方式联系您!

twilight1024 avatar Nov 29 '23 06:11 twilight1024

是不是运行时删除了某些文件夹?

dataabc avatar Nov 29 '23 17:11 dataabc

是不是运行时删除了某些文件夹?

使用weiboSpider就没问题了,感谢

UniversalRedBlue avatar Dec 05 '23 16:12 UniversalRedBlue

使用weiboSpider解决问题了,感谢您

------------------ 原始邮件 ------------------ 发件人: "Chen @.>; 发送时间: 2023年11月30日(星期四) 凌晨1:39 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [dataabc/weibo-crawler] 只能爬取200页微博是怎么回事? (Issue #357)

是不是运行时删除了某些文件夹?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

UniversalRedBlue avatar Dec 05 '23 16:12 UniversalRedBlue