Using Crawlera with Scrapy-Selenium

[jlim782]

Hello,

I am trying to use scrapy-selenium with Crawlera but haven't had any luck. Requests are sent, and responses come back, but the Crawlera dashboard doesn't show the requests as received.

Is it possible to use SeleniumRequest with Crawlera? I'm not sure if changing the orders of DOWNLOADER_MIDDLEWARES would help. Here's my configuration

DOWNLOADER_MIDDLEWARES = {
    'scrapy_crawlera.CrawleraMiddleware': 610,
    'scraper.middlewares.ScraperDownloaderMiddleware': 620,
    'scrapy_selenium.SeleniumMiddleware': 800
}

For my project, using Scrapy-Splash is not an option.

Here are the versions of the related software packages

    - scrapy==1.5.1
    - scrapy-crawlera==1.4.0

Thanks a lot in advance