Crawling-Infrastructure
Crawling-Infrastructure copied to clipboard
NikolaiT
Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.
Any ideas? Something about the mongoose types dependencies is conflicting with something else.. ``` C:\Projects\Crawling-Infrastructure\master\src\models\crawltask.model.js:24 var CrawlTaskSchema = new mongoose_1["default"].Schema({ ^ TypeError: Cannot read property 'Schema' of undefined at Object....
Would love to know (and contribute to) the future roadmap for this repository :) What other features and capabilities do you think could be added? How can we continue improving...
I think adding support for a CAPTCHA solver web service API would be a good idea, here is one website that provides such dirt cheap service for a fixed monthly...
Bumps [bl](https://github.com/rvagg/bl) from 2.2.0 to 2.2.1. Release notes Sourced from bl's releases. v2.2.1 Fix unintialized memory access Commits 8cb93f4 Bumped v2.2.1 dacc4ac Fix unintialized memory access See full diff in...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
``` $ tsc ../lib/node_modules/@types/mongoose/index.d.ts:78:1 - error TS6200: Definitions of the following identifiers conflict with those in another file: Omit, DocumentDefinition, MongooseFilterQuery, FilterQuery, MongooseUpdateQuery, UpdateQuery, NativeBuffer, NativeDate, NativeError, Mongoose, CastError, ConnectionBase,...
Bumps [flat](https://github.com/hughsk/flat) to 5.0.2 and updates ancestor dependency [mocha](https://github.com/mochajs/mocha). These dependencies need to be updated together. Updates `flat` from 4.1.0 to 5.0.2 Commits e5ffd66 Release 5.0.2 fdb79d5 Update dependencies, refresh...
Bumps [express](https://github.com/expressjs/express) from 4.17.1 to 4.17.3. Release notes Sourced from express's releases. 4.17.3 deps: accepts@~1.3.8 deps: mime-types@~2.1.34 deps: [email protected] deps: [email protected] deps: [email protected] deps: [email protected] deps: [email protected] deps: [email protected] deps:...
Bumps [qs](https://github.com/ljharb/qs) to 6.11.0 and updates ancestor dependencies [qs](https://github.com/ljharb/qs), [body-parser](https://github.com/expressjs/body-parser) and [express](https://github.com/expressjs/express). These dependencies need to be updated together. Updates `qs` from 6.7.0 to 6.11.0 Changelog Sourced from qs's changelog....