WebMonitor
WebMonitor copied to clipboard
爬取网站报错 SSLError(MaxRetryError('HTTPSConnectionPool
目标网站地址
https://b2b.10086.cn/b2b/main/listVendorNotice.html?noticeType=2
css selector / xpath 内容
tittle{//[@id="searchResult"]/table/tbody/tr/td[3]/a/text()} danwei{//[@id="searchResult"]/table/tbody/tr/td[1]/text()} xuqiu{//[@id="searchResult"]/table/tbody/tr/td[2]/text()} date{//[@id="searchResult"]/table/tbody/tr/td[4]/text()}
实际发生了什么?
运行时提示: SSLError(MaxRetryError('HTTPSConnectionPool(host='b2b.10086.cn', port=443): Max retries exceeded
部署相关信息
docker
Env | Value |
---|---|
OS | |
phantomjs version | |
if Docker, version |
已排除原因
- [x] 尝试使用无头浏览器抓取 已使用
- [ ] 网站反爬
额外信息(日志、报错等)
已安装requests的依赖安装包: pip install cryptography pip install pyOpenSSL pip install certifi
https://blog.csdn.net/Ghjkku/article/details/122265541?spm=1001.2101.3001.6661.1&utm_medium=distribute.pc_relevant_t0.none-task-blog-2%7Edefault%7ECTRLIST%7Edefault-1.pc_relevant_default&depth_1-utm_source=distribute.pc_relevant_t0.none-task-blog-2%7Edefault%7ECTRLIST%7Edefault-1.pc_relevant_default&utm_relevant_index=1
我也是这种报错,之前推送成功2次后,后面的都没成功,应该是网站反爬了,我设置定时间隔1小时看看
requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='www.manhuagui.com', port=443): Max retries exceeded with url: /user/book/shelf (Caused by ConnectTimeoutError(<urllib3.connection.VerifiedHTTPSConnection object at 0x7fce9ca3a358>, 'Connection to www.manhuagui.com timed out. (connect timeout=10)'))
成功了3次,现在又报错了