Getting 404 for links that certainly work

[ZdenekM]

I checked the log and have no idea why does it happen. Also tried to re-run the check but the result was the same. Please see https://github.com/robofit/arcor2/pull/438/checks?check_run_id=1861222777. Many thanks for any tips.

[gaurav-nelson]

Thanks @ZdenekM Most of the times websites block requests if too many requests are coming from a bot.

Currently, you can handle such URL's that you know are working by using the config-file option and providing a configuration file with the following:

{
  "ignorePatterns": [
    {
      "pattern": "^https://github.com"
    }
  ]
}

Doing this ignores the 404s and let's your checks pass.

[ZdenekM]

Unfortunately, most of the links in my READMEs are within GitHub. Would it be a solution to insert some (configurable) delay between requests? I don't care much how long the check lasts...

[ZdenekM]

Could it be that the problem is in links containing %2 as this one? It seems that other links within the repo are ok. See the report https://github.com/robofit/arcor2/runs/2030470582?check_suite_focus=true.