Alexander Sibiryakov

@dingld the only cons is that will not survive process restart, but for some applications this isn't necessary. For a general purpose solution I would extend SQLA backend with the...

Thank you for the report. Could track down where the problem is, and submit a PR?

Hi, is sqlite file created, is anything written there?

Hi Jan, It's just a warning, it should work fine. Fix is in progress https://github.com/scrapinghub/frontera/pull/257 On Wed, Mar 8, 2017 at 11:36 AM, Jan Burda wrote: > Hello, I followed...

If you want me to help debugging it, I need all your configs and spider code. Here's what you can do yourself: You need to debug the communication between DBW,...

I did the same, just to make sure and it works for me. Yes, it floods stdout with warnings, but works. If you don't want to see warnings you could...

I need someone who will share some reproducible example with me @desprit, @Bundas @bresmith-wayfair . Unfortunately this software stack (Scrapy, Frontera) allows for too much customization, and even tiny detail...

@kmike I'm not sure the code using that method is executed https://github.com/scrapinghub/frontera/blob/d91e05631688815f7255ae29f2bfe095621f9540/frontera/contrib/scrapy/schedulers/frontier.py#L92 and honestly I don't see much sense in all this. As I can see this check is executed...

Good finding, actually. This could happen because of redirects. When redirect happens, Frontera will get a response object with last (already redirected) URL and will not match it with record...

This is again a good finding, @RajatGoyal! We could solve that by handling exceptions in spider middleware, and propagating them to backend. If you could make a PR, that would...