OSpider

OSpider copied to clipboard

from POISpider import BaiduPOISpider keylist=['PMLZOZz6vGSaX4oYIYdWOcKYgSFH76Ep','OTLl9wZMVFTh22Wy7Kie908sSMyu5HNF'] spider=BaiduPOISpider() spider.set_key(keylist,thread_protect=3) #批量抓取POI spider.getPOI_byBatch('Demo/book1.csv') 运行结果： 动POI抓取批处理... ----------OSpider----------------------------------------- 自定义文件抓取任务：(幼儿园,教育培训,https://geo.datav.aliyun.com/areas_v2/bound/330200.json)启动： 读取抓取区域中... 抓取区域读取完毕... 开启多线程POI抓取任务... 正在执行切片分析... 分析切片中，队列剩余：14 Key:OTLl9wZMVFTh22Wy7Kie908sSMyu5HNF失效 Key:PMLZOZz6vGSaX4oYIYdWOcKYgSFH76Ep失效 分析切片中，队列剩余：14 分析切片中，队列剩余：14 分析切片中，队列剩余：14

jacbson

AOI

1

请问可以爬取AOI数据吗

wwww666

show_analysis需添加一个判断

1

`def show_analysis(self):` `while (not self.qAnalysis.empty()) and (not self.qKey.empty()): ` 判断key是否为空

Nemodontcry

Bumps [requests](https://github.com/psf/requests) from 2.24.0 to 2.31.0. Release notes Sourced from requests's releases. v2.31.0 2.31.0 (2023-05-22) Security Versions of Requests between v2.3.0 and v2.30.0 are vulnerable to potential forwarding of Proxy-Authorization...

dependabot[bot]

ShiChenglong-0423