Crawler-Detect

Crawler-Detect copied to clipboard

getting this error while installing Your requirements could not be resolved to an installable set of packages. Problem 1 - laravel/sail is locked to version v1.25.0 and an update of...

Imdad-cr7

https://www.reddit.com/r/flask/comments/161fqml/what_to_do_about_bytespider/

stdex

See https://aka.ms/MicrosoftPreview

luukbox

Empty user agent

2

I see that my web-server-provider has a statistics section about bots and that they also identify visits with empty user-agent as bots. Is it worth checking for this before running...

SoranDK

Some Google bots are not identified

1

Hi, it seems some Google Bot from cloud are not identified as it. Example: IP = 104.199.13.48 | Referer = | Lang = | Host = 48.13.199.104.bc.googleusercontent.com | Nav =...

anemone-clown

Agent with '+http...' almost always a bot.

1

Any time you find a user agent with '+http' it is almost always a bot. So for example, '+https://help.something.com' will probably be a bot. The 'good' bots almost always have...

bartonlp

Could we add lscache_runner as user agent?

4

**lscache_runner** is a user agent for cache warmers for LSCache from Litespeed servers. Currently if our project uses Crawler-Detect those hits are not treated as bots. **lscache_runner iPhone** is another...

therampagerado

Added Zapier.com (RSS) crawler.

Bjornftw

My first commit and PR. Hopefully I've done it right! :)

therampagerado

Addition of Litespeed LSCache crawler (desktop). Only desktop UA is added.

therampagerado