linkcheck icon indicating copy to clipboard operation
linkcheck copied to clipboard

Linkcheck reports cf-challenge protected pages as missing

Open wom-bat opened this issue 2 years ago • 1 comments

We run a website that has links to publications. Any publication hosted on a site protected by cloudflare challenges reports 403 instead of something useful.

For instance, a link to https://royalsocietypublishing.org/doi/10.1098/rsta.2015.0401 reports as 403 instead of passing.

I don't know what to do about this; I want to check that the links are valid, but the 403 response prevents this.

wom-bat avatar May 08 '23 03:05 wom-bat

Unfortunately, I don't think there's anything an automated tool can do about this. If a website provides the wrong HTTP code, that's that. I've seen this happen with YouTube (I think) and github and other major websites.

filiph avatar May 10 '23 12:05 filiph