Voith
Voith
commenting lines : # 'frontera.contrib.scrapy.middlewares.schedulers.SchedulerSpiderMiddleware': 1000, and # SCHEDULER = 'frontera.contrib.scrapy.schedulers.frontier. FronteraScheduler' is a good as using plain scrapy without frontera `Also what is this scheduler and why do I...
submit a PR. we can discuss there if you think there's something wrong with frontera
[Here's](https://github.com/scrapinghub/frontera/blob/master/frontera/contrib/backends/sqlalchemy/models.py#L74) the code for the model. just override the fingerprint in mixin class. ```python class CustomQueueModelMixin(QueueModelMixin): fingerprint = Column(String(40), nullable=False, unique=True) class CustomQueueModel(CustomQueueModelMixin, DeclarativeBase): __tablename__ = 'queue' @classmethod def query(cls,...
Oops @isra17 answered before I did. However, @isra17 I have a question for you. Won't simply inserting give duplicate key error? Isn't an insert ignore statement needed while inserting?
also look at https://github.com/scrapinghub/frontera/issues/211
This is still not fixed. Here's the build https://travis-ci.org/scrapinghub/frontera/jobs/183837818