learn-x-by-doing-y icon indicating copy to clipboard operation
learn-x-by-doing-y copied to clipboard

Filter dead links

Open nandi95 opened this issue 4 years ago • 3 comments

It would be nice if there was a method devised that automatically removes dead links...

example link: https://github.com/aquadzn/learn-x-by-doing-y/blob/main/projects.csv#L125 returns the status code 410

Perhaps an action ran every (day/week) and remove lines from the csv file if a request to the endpoint fails?

nandi95 avatar Jan 13 '21 10:01 nandi95

Maybe it would be better to include a link to the latest internet archive snapshot as most of the links are mosly text-only

Tau5 avatar Jan 13 '21 11:01 Tau5

It would be nice if there was a method devised that automatically removes dead links...

example link: https://github.com/aquadzn/learn-x-by-doing-y/blob/main/projects.csv#L125 returns the status code 410

Perhaps an action ran every (day/week) and remove lines from the csv file if a request to the endpoint fails?

https://medium.com/we-are-orb/linear-regression-in-python-without-scikit-learn-50aef4b8d122 is working for me personally

I will try to add a script that checks the response code of the different links.

aquadzn avatar Jan 13 '21 11:01 aquadzn

Maybe it would be better to include a link to the latest internet archive snapshot as most of the links are mosly text-only

Indeed, so it could be if the link's dead try the archive, if not just remove.

nandi95 avatar Jan 13 '21 12:01 nandi95