shivaprsd
doqment unable to get PDFs from certain sites?
It seems lately doqment is unable to get PDFs from ResearchGate and Sci-Hub.
Sci-Hub:
Oddly it works fine if I don't use the sci-hub "wrapper" and goes directly to the pdf file URL instead (the 2024.sci-hub.st one)
As for ResearchGate I get a 403 forbidden, however if I disable doqment the site downloads the pdf instead so I think researchgate has forced the pdf file to be downloaded and not opened.
Hi @MagicalDrizzle, sorry for the (very) delayed response, but I am not able to reproduce the issue. In Firefox 140.0b3 on macOS 15.4, I'm able to view the PDF both in the Sci-Hub wrapper and direct URL. In my case, I see a second request after one gets blocked (see screenshot).
Also with ResearchGate I don't hit a 403. I was able to view the same paper mentioned above.
May be the issue is related to the inherent nature of those websites? For every PDF, doqment has to make two (consecutive) requests (one is made by Firefox and then one by doqment during the redirect). May be their servers block frequent requests when coming from particular regions. For instance, I got a 429 (Too Many Requests) with ResearchGate in the second or third try.
There is also a small possibility that this is related to #44, that happens when PDF access is behind an authentication wall. But since Sci-Hub is entirely open access, I don't really see how it could be.
