Worker should check the last time a page was crawled

[alexmuller]

If the crawler discovers a page it should first verify the last time the page was crawled before adding it to the queue. We don't need to re-crawl pages very often and this will help keep the queue size down.