dataportals.org icon indicating copy to clipboard operation
dataportals.org copied to clipboard

Verify link health automatically and update table

Open augusto-herrmann opened this issue 2 years ago • 1 comments

Build a script to automatically and periodically (with Github Actions) verify link health and update the table accordingly.

augusto-herrmann avatar Mar 03 '22 18:03 augusto-herrmann

Be warned that many sites may be behind things like Cloudflare and will be very good at blocking bots. You'll probably get a lot of false positives.

I'd suggest to start with just setting up something that made a report that a human can then check.

jarofgreen avatar Mar 04 '22 09:03 jarofgreen