spider icon indicating copy to clipboard operation
spider copied to clipboard

Published 20 hours ago • verified publisher icon JFanZhao
→

Metadata

使用java+httpclient+httpcleaner，多线程、分布式爬去电商网站商品信息，数据存储在hbase上，并使用solr对商品建立索引，使用redis队列存储一个共享的url仓库；使用zookeeper对爬虫节点生命周期进行监视等。

Results 2 spider issues
Sort by recently updated
recently updated
newest added

Bump junit from 4.12 to 4.13.1 in /target/classes/META-INF/maven/Spider/spider

Bumps [junit](https://github.com/junit-team/junit4) from 4.12 to 4.13.1. Release notes Sourced from junit's releases. JUnit 4.13.1 Please refer to the release notes for details. JUnit 4.13 Please refer to the release notes...

dependabot[bot] avatar dependabot[bot]

dependencies

支持多用户登录，多用户携带cookie并且请求？

支持多用户登录，多用户携带cookie并且请求？

chunfytseng avatar chunfytseng

← Metadata

223
Stars
154
Forks
Watchers

Owner

verified publisher icon JFanZhao

Metadata

使用java+httpclient+httpcleaner，多线程、分布式爬去电商网站商品信息，数据存储在hbase上，并使用solr对商品建立索引，使用redis队列存储一个共享的url仓库；使用zookeeper对爬虫节点生命周期进行监视等。

Back