WCF
WCF copied to clipboard
WoltLab
Add and update several web spiders
Uptime-Kuma is a self-hosted monitoring tool like "Uptime Robot". See: https://github.com/louislam/uptime-kuma
User-Agent: Uptime-Kuma/{VERSION} Example: Uptime-Kuma/1.18.0
See: https://github.com/louislam/uptime-kuma/blob/1.18.0/server/model/monitor.js#L258
I've added another entry that has been appearing on a curated site for a few months. I didn't specify the URL because it's just a placeholder (can't "verify" if its the origin) and probably only used for emails (edit: not even that). It's probably connected to seoscanners.net, which is also not available, so i just left it out.
User-Agent: SEO Scanner/1.2.4 (SEO Crawler; seoscanners.info; [email protected])
Sorry for adding so much to this PR after you've already reviewed the changes. I noticed that most of the current entries no longer exist, some even for many years. I didn't remove those entries because it doesn't really matter and who knows, maybe some pre-2000 bots will come back at some point :) But I thought it would be useful to at least add a whole bunch of new entries to the list where it is actually likely that they will hit a website.
Rest assured I'm done now :)
Thank you for taking your time to check the items on the list. I can imagine that a significant portion of the spiders are no longer active, but this is sometimes quite hard to verify.
