Elise icon indicating copy to clipboard operation
Elise copied to clipboard

:hand: A simple, extensible, and support for a distributed crawler framework.一个简单的,高度可扩展的,并且支持分布式的爬虫框架

Results 2 Elise issues
Sort by recently updated
recently updated
newest added
trafficstars

Bumps [htmlunit](https://github.com/HtmlUnit/htmlunit) from 2.30 to 2.37.0. Release notes Sourced from htmlunit's releases. HtmlUnit-2.37.0 Bugfixes many js improvements done in Rhino CHROME 79 FF52 removed FF68 added HtmlUnit-2.36.0 Bugfixes many js...

dependencies

由Elise-core模块提供全部的单机爬虫功能导致代码极度膨胀臃肿很费心里去做分布式和单机不同场景下的兼容问题,并且容易让某些特性无法发挥,比如:单机运行状态时,可以直接查询dom而不是必须的使用提供的response api。 模块重构迁移计划: 1. 拆分Elise-core模块,用于提供通用的功能并提供先关的扩展接口,本身不再是一个完整的爬虫 2. 分离出Elise-client模块,用于单机运行,在提供response api的同时能够提供直接可编程处理dom查询、saver存储等更多的编程可定制场景

enhancement