nginx-ultimate-bad-bot-blocker
nginx-ultimate-bad-bot-blocker copied to clipboard
[User-Agent] (AI Search Crawlers)
Paste the full User-Agent String here
Amazonbot
Applebot
PerplexityBot
YouBot
Amazonbot
Is this for Addition / Removal?
- [ ] Addition
- [ ] Removal
- [x] Keep a watch on this one
Did the User-Agent request robots.txt first?
- [ ] Yes
- [ ] No
Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)
Post log excerpt here (paste in between the ``` ``` markers)
Additional information
They should be watched, but they cite websites so may be okay for now
See also https://darkvisitors.com/agents
Will scan some logs for these