Alexander Azarov

Results 12 comments of Alexander Azarov

Hi, the idea of the card is a bit different, I was thinking of packaging Google crawler User-Agents into few lists just like Google presents them on [this page](https://developers.google.com/search/docs/crawling-indexing/verifying-googlebot). I...

Though I have to add that I am against making pre-fetching the IP ranges list the default behaviour. Currently implemented DNS-based approach is superior, because it relies on the DNS...