ArchiveBot icon indicating copy to clipboard operation
ArchiveBot copied to clipboard

Published 20 hours ago • verified publisher icon ArchiveTeam

Search engine user agents (e.g. Googlebot)

Open JustAnotherArchivist opened this issue 6 years ago • 1 comments

https://techpatterns.com/forums/about304.html has a decent list of such user agents. (Thanks Rotxer)

JustAnotherArchivist avatar Jul 29 '19 11:07 JustAnotherArchivist

I can take care of this. PR will be opened in a day or two.

tomodachi94 avatar May 30 '23 17:05 tomodachi94