sparkler icon indicating copy to clipboard operation
sparkler copied to clipboard

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

Results 56 sparkler issues
Sort by recently updated
recently updated
newest added

Can you make the video dashboard fixing .I tried by studying the wiki doc but unable to fix dashboard unable to succeed.Please make a video on it.Thanks

Hi there, I wanted to crawl whole content of a website. When I run the command below, crawling process does not start. What is wrong? bin/sparkler.sh crawl -id 1 -i...

Hi folks, I know we discussed this in NYC but I'm gonna bring it up again. You folks need to figure out what the stop point for a release is...

#### Issue Description Please describe our issue, along with: - encountered behavior: After I execute the command: `docker run -v elastic:/elasticsearch-7.17.0/data ghcr.io/uscdatascience/sparkler/sparkler:main inject -id myid -su 'https://www.nature.com/articles/s41586-022-04983-9'` I see the...

Bumps [minimist](https://github.com/minimistjs/minimist), [mkdirp](https://github.com/isaacs/node-mkdirp), [loader-fs-cache](https://github.com/viankakrisna/loader-fs-cache) and [handlebars](https://github.com/wycats/handlebars.js). These dependencies needed to be updated together. Updates `minimist` from 1.2.0 to 1.2.8 Changelog Sourced from minimist's changelog. v1.2.8 - 2023-02-09 Merged [Fix] Fix...

dependencies
javascript

Bumps [werkzeug](https://github.com/pallets/werkzeug) from 0.16.1 to 2.2.3. Release notes Sourced from werkzeug's releases. 2.2.3 This is a fix release for the 2.2.x release branch. Changes: https://werkzeug.palletsprojects.com/en/2.2.x/changes/#version-2-2-3 Milestone: https://github.com/pallets/werkzeug/milestone/26?closed=1 This release contains...

dependencies
python

Bumps [ua-parser-js](https://github.com/faisalman/ua-parser-js) from 0.7.19 to 0.7.33. Changelog Sourced from ua-parser-js's changelog. Version 0.7.33 / 1.0.33 Add new browser : Cobalt Identify Macintosh as an Apple device Fix ReDoS vulnerability Version...

dependencies
javascript