Paweł Miech
Paweł Miech
This is a matter of adding your code sample here in resources https://github.com/scrapinghub/scrapyrt/blob/master/scrapyrt/resources.py and then adding it in config https://github.com/scrapinghub/scrapyrt/blob/master/scrapyrt/conf/default_settings.py#L23 To check health it would be good to perform some...
may be related to #62
Sorry for late response. Sure create PR if still needed.
updated after discussions
#### TODO - [ ] docs something else?
It sounds interesting, I think some sort of batch processing would be good here, in your example it will be difficult to know which spider should crawl which url, but...
Thank you for this contribution @serhii73. I really appreciate it! The idea behind this feature is to limit number of items in output. With current implementation it doesn't really do...
related to https://github.com/scrapinghub/scrapyrt/issues/10
that is a bug, yeah I can confirm it doesn't work as expected.
indeed that doesn't work, I'm going to fix it. edit: it only happens when you set start_requests: True and provide request object with meta. In this case meta is not...