algolia-webcrawler
algolia-webcrawler copied to clipboard
DeuxHuitHuit
Simple node worker that crawls sitemaps in order to keep an algolia index up-to-date
Bumps [chalk](https://github.com/chalk/chalk) from 3.0.0 to 4.1.2. Release notes Sourced from chalk's releases. v4.1.2 Readme updates v4.1.1 Readme updates https://github.com/chalk/chalk/commit/89e9e3a5b0601f4eda4c3a92acd887ec836d0175 v4.1.0 Support template literals for nested calls (#392) 09ddbad https://github.com/chalk/chalk/compare/v4.0.0...v4.1.0 v4.0.0...
![dependabot-preview[bot] avatar](https://avatars.githubusercontent.com/in/2141?v=4 "dependabot-preview[bot] avatar"){kind=avatar}
If the crawler tries to request a url that has non encoded characters, it will simply stop there and giv an error. To fix this, url is first decoded to...
Bumps [tape](https://github.com/substack/tape) from 4.13.0 to 5.3.0. Commits 91ac45e v5.3.0 9d3c5b4 [eslint] fully enable @ljharb eslint config 8a0ab53 [Refactor] avoid reassigning arguments da45ae6 [Refactor] remove unused line, unneeded var initialization; add...
Bumps [algoliasearch](https://github.com/algolia/algoliasearch-client-javascript) from 3.35.1 to 4.10.3. Release notes Sourced from algoliasearch's releases. 4.10.3 v4.10.3 fix(answers): omit original hits in response (#1293) (fb62b15), closes #1293 fix(facetOrdering): facetOrdering.facets, not .facet (d931976) 4.10.2...
_Dependabot Preview will be shut down on August 3rd, 2021. In order to keep getting Dependabot updates, please merge this PR and migrate to GitHub-native Dependabot before then._ Dependabot has...
Bumps [cheerio](https://github.com/cheeriojs/cheerio) from 1.0.0-rc.3 to 1.0.0-rc.10. Release notes Sourced from cheerio's releases. v1.0.0-rc.10 Fixes: .html(node) now moves passed nodes (#1923, fixes #940) 258b26b Boolean attributes are no longer special in...
Bumps [trim](https://github.com/Trott/trim) from 0.0.1 to 0.0.3. Changelog Sourced from trim's changelog. 0.0.3 / 2020-11-04 fix: bump component.json 0.0.2 / 2020-11-04 Fix possible regex dos vulnerability (Patrick Way) Commits a0fe826 0.0.3...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [trim](https://github.com/Trott/trim) from 0.0.1 to 1.0.1. Changelog Sourced from trim's changelog. 1.0.1 / 2021-04-01 chore: update repository URL in package.json 1.0.0 / 2020-11-12 chore: add license to package.json 0.0.3 /...
Bumps [lodash](https://github.com/lodash/lodash) from 4.17.15 to 4.17.21. Commits f299b52 Bump to v4.17.21 c4847eb Improve performance of toNumber, trim and trimEnd on large input strings 3469357 Prevent command injection through _.template's variable...
Bumps [html-entities](https://github.com/mdevils/html-entities) from 1.2.1 to 2.3.2. Release notes Sourced from html-entities's releases. v2.3.2 Minimize data files, remove unnecessary files. v2.3.1 Improve performance of encode(), decode() and decodeEntity() by using function...
Metadata
Owner
Metadata
Simple node worker that crawls sitemaps in order to keep an algolia index up-to-date