weibo-search

weibo-search copied to clipboard

博主你好请教您个问题，ValueError: day is out of range for month

1

PS F:\weibo-search-master\weibo> scrapy crawl search -s JOBDIR=crawls/search Traceback (most recent call last): File "F:\software\python3.7\lib\runpy.py", line 193, in _run_module_as_main "__main__", mod_spec) File "F:\software\python3.7\lib\runpy.py", line 85, in _run_code exec(code, run_globals) File "F:\software\python3.7\Scripts\scrapy.exe\__main__.py",...

liwenhi

运行问题

1

大家都能成功运行吗，我按照说明来的，还是运行不成功，输入运行命令后没有结果，就卡住了

komixe

小白一个，想问下那个关键词参数设置具体要改哪一行代码呢

2

class SearchSpider(scrapy.Spider): name = 'search' allowed_domains = ['weibo.com'] settings = get_project_settings() keyword_list = settings.get('KEYWORD_LIST') if not isinstance(keyword_list, list): if not os.path.isabs(keyword_list): keyword_list = os.getcwd() + os.sep + keyword_list if not...

WJK1688

用户年龄

1

Hello，请问能爬取到用户年龄吗或者是某个年龄段发的关键词？

BillZhang078

会卡住，需要按ctrl+c一次后，才会继续执行

3

直接运行scrapy crawl search，在爬取的过程中，隔段时间会卡住，然后需要按ctrl+c一次，就会继续print数据，这是因为什么呢？scrapy的线程卡住？还是输入到csv中卡住了？

Seven750

repost问题

1

通过浏览下载的数据，发现最后一列“repost”数据为空值，这样好像就无法知道该条微博是否是转发的微博，该怎么解决这个问题呢？谢谢！！！！

JunchengGuo

运行命令后提示：“ERROR: Loading "scrapy.core.downloader.handlers.http.HTTPDownloadHandler" for scheme "http"”

4

changxiaxia030

A small problem

2

Please ask God, if you only need to output the number of current keyword searches, how should you set it?

CURIOUDOG

代码运行，不报错，立马结束了，也没有结果，懵逼了。。

9

wowowoadada

爬取4小时后爬不动并出现struct.error

6

开发者您好，我在爬取数据4小时后发现程序terminal端自动停止，于是用control+c保存断点再爬，但开始遇到各种错误，现在遇到的是Unhandled Error Traceback (most recent call last): File "/Users/cindys/enter/lib/python3.9/site-packages/scrapy/commands/crawl.py", line 31, in run self.crawler_process.start() File "/Users/cindys/enter/lib/python3.9/site-packages/scrapy/crawler.py", line 383, in start reactor.run(installSignalHandlers=False) # blocking call File "/Users/cindys/enter/lib/python3.9/site-packages/twisted/internet/base.py", line 1318, in run...

pxaklbe