htpw icon indicating copy to clipboard operation
htpw copied to clipboard

New User Agents to Block

Open vxsh4d0w opened this issue 3 years ago • 9 comments

Added new rule rules to block nikto user agent and sql injections attempts

vxsh4d0w avatar Mar 03 '21 15:03 vxsh4d0w

So, the new UAs to block would be:

libwww-perl
wget
python
nikto
curl
scan
java
winhttp
HTTrack
clshttp
archiver
loader
email
harvest
extract
grab
miner

Thanks for this very interesting list. But I don't think I want to block them all.

For example "curl" or "wget" are often used to invoke wp-cron.php and update WP Core, Themes or Plugin.

What software uses "email", "harvest", "archiver" as user agent? I find nothing potentially malicious...

drego85 avatar Mar 24 '21 14:03 drego85

A website that use wget to run wp-cron deserve to be blocked as there are better ways to do it in a more performant way without using a call to a webserver 😂

The wp-cron file can be executed with php from cli or with wp-cli https://developer.wordpress.org/cli/commands/cron/event/run/

Mte90 avatar Mar 24 '21 14:03 Mte90

@Mte90 you are absolutely right!

But the project was born with the intention of not being invasive; I don't want to risk interrupting the update processes of some installations.

drego85 avatar Mar 24 '21 14:03 drego85

Maybe you can do 2 sets of rules like basic and advanced

Mte90 avatar Mar 24 '21 14:03 Mte90

Good point!

drego85 avatar Mar 24 '21 14:03 drego85

We may select other user agents of interest from: https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker

drego85 avatar Mar 25 '21 15:03 drego85

We may select other user agents of interest from: https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker

Here too: https://perishablepress.com/ultimate-htaccess-blacklist/

stramargio avatar Mar 25 '21 15:03 stramargio

Other user agent I would like to add:

Nuclei - Open-source project (github.com/projectdiscovery/nuclei)

drego85 avatar Apr 07 '21 15:04 drego85

Another UA likely to be blocked:

ltx71

drego85 avatar May 10 '21 15:05 drego85