markdown-link-check icon indicating copy to clipboard operation
markdown-link-check copied to clipboard

link check returns 403 for Intel websites

Open wermos opened this issue 1 year ago • 0 comments

When I used markdown-link-check for Intel websites, it returns a 403:

❯ docker run -v ${PWD}:/tmp:ro --rm -i ghcr.io/tcort/markdown-link-check:stable /tmp/README.md

FILE: /tmp/README.md

  ERROR: 3 dead links found!
  [✖] https://ark.intel.com/content/www/us/en/ark/products/132228/intel-core-i712700h-processor-24m-cache-up-to-4-70-ghz.html
  [✖] https://ark.intel.com/content/www/us/en/ark/products/208658/intel-core-i51135g7-processor-8m-cache-up-to-4-20-ghz.html
  [✖] https://www.intel.com/content/www/us/en/products/sku/97456/intel-core-i57300hq-processor-6m-cache-up-to-3-50-ghz/specifications.html

  3 links checked.
  [✖] https://ark.intel.com/content/www/us/en/ark/products/132228/intel-core-i712700h-processor-24m-cache-up-to-4-70-ghz.html → Status: 403
  [✖] https://ark.intel.com/content/www/us/en/ark/products/208658/intel-core-i51135g7-processor-8m-cache-up-to-4-20-ghz.html → Status: 403
  [✖] https://www.intel.com/content/www/us/en/products/sku/97456/intel-core-i57300hq-processor-6m-cache-up-to-3-50-ghz/specifications.html → Status: 403

But curl works as expected:

❯ curl https://ark.intel.com/content/www/us/en/ark/products/132228/intel-core-i712700h-processor-24m-cache-up-to-4-70-ghz.html -o /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  224k    0  224k    0     0  1482k      0 --:--:-- --:--:-- --:--:-- 1484k
❯ curl https://ark.intel.com/content/www/us/en/ark/products/208658/intel-core-i51135g7-processor-8m-cache-up-to-4-20-ghz.html -o /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  218k    0  218k    0     0  1311k      0 --:--:-- --:--:-- --:--:-- 1317k
❯ curl https://www.intel.com/content/www/us/en/products/sku/97456/intel-core-i57300hq-processor-6m-cache-up-to-3-50-ghz/specifications.html -o /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  358k    0  358k    0     0  1855k      0 --:--:-- --:--:-- --:--:-- 1859k

This could be due to DDoS protection as mentioned in #109, but I'm not 100% sure.

wermos avatar Dec 07 '23 08:12 wermos