spidermon
spidermon copied to clipboard
I was trying to compare spider result on scrapyinghub and failed
I got two problems:
1 . Get SpidermonHistory Validation/Expected number of items extracted... ERROR.
( already config STATS_CLASS on hub)
spider = self.data["spider"]
print(spider.stats_history)
- I try to use job object to filter item. It should have worked but return
400 Client Error: Bad Request for url
job_obj = self.data.job
filters = [("domain","=",["abc.com"])]
result = job_obj.items.list(filter=filters)
How can I fix it ?
[update]
About first, I always get deque([], maxlen=10)
[update]
About first, I always get deque([], maxlen=10)