Broken-Link-Crawler
Broken-Link-Crawler copied to clipboard
:robot: Python bot that crawls your website looking for dead stuff
Currently missing anchor in URLs are not reported as broken links. Fixing this will involve checking the HTML to see if the HTML anchor exists on the targeted page.
hy, only two stupid fix if you have an url without domain now (with this fix) it presume it is an url of the analyzed site, and if is'nt valid...
For successful requests the time it took to get the `HEAD` request will now be printed in verbose mode. For example: `200 - https://github.com/ - 187.58 ms`
You can now ignore links by their prefix. Like me you might not want to check "mailto:...." links as they can't be checked through this crawler. Therefore, you can now...