frontera icon indicating copy to clipboard operation
frontera copied to clipboard
verified publisher icon scrapinghub

[WIP] Mongo db backend updated

Open sibiryakov opened this issue 10 years ago • 4 comments

Based on a solution made by @bbotella at https://github.com/scrapinghub/crawl-frontier/pull/6

sibiryakov avatar Mar 16 '15 10:03 sibiryakov

@plafl @kalessin please have a look.

sibiryakov avatar Apr 10 '15 17:04 sibiryakov

Looks OK to me

plafl avatar Apr 13 '15 07:04 plafl

Great, I think I'll do some docs and tests.

sibiryakov avatar Apr 13 '15 08:04 sibiryakov

@bbotella Honestly, I don't think people will be using MongoDB backend because of performance, instead because of ease of development and schemaless concept. Therefore, I would stay with most transparent MongoDb item possible.

sibiryakov avatar May 22 '15 16:05 sibiryakov