Crawler-Detect
Crawler-Detect copied to clipboard
Match for Anthill and facebookexternalhit BOTS User-agents
There are EXACTLY like this user agents:
Anthill
and
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
Just to understand my scenario where your package is very util:
- bots enters our website (that uses laravel) and they create a bunch of session data into
sessions
table - we added a middleware with your package that solved a lof of the problem (thanks), but still has these crawlers creating session data
can you check that?