hub icon indicating copy to clipboard operation
hub copied to clipboard

http-bad-user-agent is not detecting Netcraft

Open ne20002 opened this issue 3 years ago • 0 comments

I tested with a testfile with two lines fd:0:0:40::144 - - [03/Nov/2022:15:32:32 +0100] "GET /network HTTP/1.1" 200 13667 "-" "Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; [email protected])" "fd:0:0:40::144" fd:0:0:40::144 - - [03/Nov/2022:15:32:32 +0100] "GET /network HTTP/1.1" 200 13667 "-" "Mozilla/5.0 (compatible; zgrab)" "fd:0:0:40::144" Second line is detected, first one in not. As far as I see, Netcraft is part of bad user agents lists.

ne20002 avatar Nov 03 '22 16:11 ne20002