Avoid checking same link multiple times?

[JackDunnNZ]

Right now, every link in the document is checked but in theory each unique URL only needs to be checked once. It's not a big concern, but I have seen some flaky servers that timeout a small fraction of the time, and so checking the link more than once gives more chance of timeout and also means more time waiting for these slow servers