dingld

Customize schemes for download handlers.

1

**scrapy.core.downloader.handlers.DownloadHandlers** gets the handler via scheme parsed from request.url. def download_request(self, request, spider): scheme = urlparse_cached(request).scheme handler = self._get_handler(scheme) For schemes that are present **directly** in request.url, it is quite...

SQLAlchemyBackend does not go with scrapy_splash

5

Args for splash is dumped with json in SplashMiddleware. ``` body = json.dumps(args, ensure_ascii=False, sort_keys=True, indent=4) ``` However, the QueueModel used by sqlalchemy backend does not record the field about...