WebMonitor icon indicating copy to clipboard operation
WebMonitor copied to clipboard

爬取网站报错 SSLError(MaxRetryError('HTTPSConnectionPool

Open mucstudio opened this issue 2 years ago • 2 comments

目标网站地址

https://b2b.10086.cn/b2b/main/listVendorNotice.html?noticeType=2

css selector / xpath 内容

tittle{//[@id="searchResult"]/table/tbody/tr/td[3]/a/text()} danwei{//[@id="searchResult"]/table/tbody/tr/td[1]/text()} xuqiu{//[@id="searchResult"]/table/tbody/tr/td[2]/text()} date{//[@id="searchResult"]/table/tbody/tr/td[4]/text()}

实际发生了什么?

运行时提示: SSLError(MaxRetryError('HTTPSConnectionPool(host='b2b.10086.cn', port=443): Max retries exceeded

部署相关信息

docker

Env Value
OS
phantomjs version
if Docker, version

已排除原因

  • [x] 尝试使用无头浏览器抓取 已使用
  • [ ] 网站反爬

额外信息(日志、报错等)

已安装requests的依赖安装包: pip install cryptography pip install pyOpenSSL pip install certifi

https://blog.csdn.net/Ghjkku/article/details/122265541?spm=1001.2101.3001.6661.1&utm_medium=distribute.pc_relevant_t0.none-task-blog-2%7Edefault%7ECTRLIST%7Edefault-1.pc_relevant_default&depth_1-utm_source=distribute.pc_relevant_t0.none-task-blog-2%7Edefault%7ECTRLIST%7Edefault-1.pc_relevant_default&utm_relevant_index=1

mucstudio avatar May 02 '22 13:05 mucstudio

我也是这种报错,之前推送成功2次后,后面的都没成功,应该是网站反爬了,我设置定时间隔1小时看看

Dlian-Zero avatar Aug 22 '22 03:08 Dlian-Zero

requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='www.manhuagui.com', port=443): Max retries exceeded with url: /user/book/shelf (Caused by ConnectTimeoutError(<urllib3.connection.VerifiedHTTPSConnection object at 0x7fce9ca3a358>, 'Connection to www.manhuagui.com timed out. (connect timeout=10)'))

成功了3次,现在又报错了 image

Dlian-Zero avatar Aug 22 '22 07:08 Dlian-Zero