Alexander Sibiryakov
Alexander Sibiryakov
Yes, these are outdated @anjackson.
In HBaseBackend and message bus protocol we use MsgPack, and I would recommend to move in that direction.
@vedantrathore that wouldn't work, I believe. And you're able to check this by running tests.
Try looking into implementation of PickleType in sqla somehow it uses Python native dump/load methods. So you would need to create a similar interface. A. > 24 февр. 2017 г.,...
hey @jpbalarini thanks for the contribution, will try to respond quicker next time. It seems this wasn't covered with the test, can you add them?
Hi, which backend have yo used @coolarun ?
This will not work with memory db, because there is nowhere to store the seeds/queue, etc. https://frontera.readthedocs.io/en/latest/topics/quick-start-single.html#inject-the-seed-urls Check also quick start distributed, if you're doing distributed setup.
By using the crawling strategy. There is the whole guide about it https://frontera.readthedocs.io/en/latest/topics/custom_crawling_strategy.html The idea is that your crawling strategy has a logic of adding the seeds. If you describe...
Hi, have you tested it @clarksun ? Is DBW with --no-incoming option working?
Hi @ShT3ch > But default implementation of self.spider_feed_producer.get_offset(Producer.get_offset) is There is no default message bus, I assume you've got this from ZeroMQ message bus. It's not clear from the issue...