haipproxy

haipproxy copied to clipboard

python crawler_booter.py --usage crawler  报错

1

python3 crawler_booter.py --usage crawler :0: UserWarning: You do not have a working installation of the service_identity module: 'cannot import name 'verify_ip_address''. Please install it from and make sure all of...

myrainbowandsky

部分规则已失效

2

基本上都是些国内提供商.. - `mogumiao.com`：已更换为 `http://www.moguproxy.com/` 并不在提供免费 IP - `xdaili.cn`：不再提供免费 IP - `kxdaili.com`：404 - `nianshao.me`：无法访问 - `httpsdaili.com`：已经不是提供代理 IP 的站点 - `ip181.com`：403/404 - `iphai.com`：500 - `yundaili.com`：已经不是提供代理 IP 的站点 - `coderbusy.com`：无法访问 以下仅作备注 - ~~`gatherproxy`：墙内不可访问~~...

chawyehsu

2020-11-10 17:49:16 [cralwer] WARNING: spider task –usage is an invalid task, the allowed tasks are ['common', 'ajax', 'gfw', 'ajax_gfw'] 2020-11-10 17:49:16 [cralwer] WARNING: spider task crawler is an invalid task,...

h-yw

在本地mac上部署了，本地可以访问3128端口。 但是好像没有代理地址可用，使用burp配置上socket5代理，发送fuzz，一个response都没有。 log里也没有任何信息，应该如何debug？

samshuai

客户端是java语言怎么用

1

bao17634

macos中docker运行时crawler.log中报错，请帮忙看下原因。谢谢。 Traceback (most recent call last): File "crawler_booter.py", line 23, in crawler_start() File "/usr/lib/python3.6/site-packages/click/core.py", line 722, in __call__ return self.main(*args, **kwargs) File "/usr/lib/python3.6/site-packages/click/core.py", line 697, in main rv = self.invoke(ctx)...

sunnypandas

树莓派docker-compose运行报错standard_init_linux.go:211: exec user process caused "exec format error"

2

pi@raspberrypi:~/haipproxy $ sudo docker-compose up Building haipproxy Step 1/11 : FROM vaeum/alpine-python3-pip3 ---> 63a9d299ea3f Step 2/11 : LABEL mantainer="ResolveWang " ---> Using cache ---> 438e90370bc1 Step 3/11 : ENV LC_ALL...

AcademicDog

python3 crawler_booter.py --usage crawler 执行后卡死

2

在ubuntu18.04上部署服务端，python版本为3.6.8 执行python3 crawler_booter.py --usage crawler后终端卡死 

littlektl

爬取的是什么网站？

septfish

我的docker compose大概长下面这样： version: "2.0" services: redis: image: redis ports: - "6379:6379" command: > --requirepass xxxx splash: image: scrapinghub/splash ports: - "8050:8050" haipproxy: image: xxx/haipproxy command: sh /haipproxy/run.sh volumes: - .:/haipproxy...

T-baby