nginx-ultimate-bad-bot-blocker icon indicating copy to clipboard operation
nginx-ultimate-bad-bot-blocker copied to clipboard

[User-Agent] Spider_Bot/3.0

Open gabrieleolmi opened this issue 1 year ago • 2 comments

Spider_Bot/3.0

Is this for Addition / Removal?

  • [ ] Addition
  • [ ] Removal
  • [x] Keep a watch on this one

Did the User-Agent request robots.txt first?

  • [ ] Yes
  • [x] No

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)

[11/Dec/2023:22:05:01 +0000] ip:"45.79.42.132" remote_user:"-" request:"HEAD / HTTP/1.1" status:"301" body_bytes_sent:"0" http_referer:"-" http_user_agent:"Spider_Bot/3.0"
[11/Dec/2023:22:05:02 +0000] ip:"45.79.42.132" remote_user:"-" request:"HEAD / HTTP/1.1" status:"200" body_bytes_sent:"0" http_referer:"-" http_user_agent:"Spider_Bot/3.0"

Additional information

Add any other context about the problem here.

gabrieleolmi avatar Dec 11 '23 22:12 gabrieleolmi

@GabrieleOlmi any updates from your monitoring on this one ?

mitchellkrogza avatar Mar 30 '24 04:03 mitchellkrogza

I no longer detected requests coming from this bot. This is the information I found about Spider_Bot:

udger.com
useragent string/User-Agent Client Hints and/or IP address analyze->Spider_Bot/3.0 - Spider_Bot/3.0
GitHub
SpiderBot: Web Utilities . Contribute to acaldero/SpiderBot development by creating an account on GitHub.

gabrieleolmi avatar Apr 19 '24 13:04 gabrieleolmi