Crawler-Detect icon indicating copy to clipboard operation
Crawler-Detect copied to clipboard

Match for Anthill and facebookexternalhit BOTS User-agents

Open terremoth opened this issue 3 years ago • 1 comments

There are EXACTLY like this user agents:

Anthill

and

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

image

terremoth avatar Mar 04 '21 19:03 terremoth

Just to understand my scenario where your package is very util:

  • bots enters our website (that uses laravel) and they create a bunch of session data into sessions table
  • we added a middleware with your package that solved a lof of the problem (thanks), but still has these crawlers creating session data

can you check that?

terremoth avatar Mar 04 '21 19:03 terremoth