nginx-ultimate-bad-bot-blocker icon indicating copy to clipboard operation
nginx-ultimate-bad-bot-blocker copied to clipboard

[User-Agent] (AI Search Crawlers)

Open jlarmstrongiv opened this issue 1 year ago • 3 comments

Paste the full User-Agent String here

Amazonbot
Applebot
PerplexityBot
YouBot
Amazonbot

Is this for Addition / Removal?

  • [ ] Addition
  • [ ] Removal
  • [x] Keep a watch on this one

Did the User-Agent request robots.txt first?

  • [ ] Yes
  • [ ] No

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)


Post log excerpt here (paste in between the ```     ``` markers)

Additional information

They should be watched, but they cite websites so may be okay for now

See also https://darkvisitors.com/agents

jlarmstrongiv avatar Jan 25 '24 06:01 jlarmstrongiv

Will scan some logs for these

mitchellkrogza avatar Mar 30 '24 04:03 mitchellkrogza