AdGuardHome
AdGuardHome copied to clipboard
AdguardTeam
Vetted blocklists thread
AdGuard Home lets the user choose from a list of vetted blocklists.
If you have in mind any lists that can be added there, please leave a comment in this thread, we'll consider it.
Previous task with a relevant comments thread: https://github.com/AdguardTeam/AdGuardHome/issues/1325
Requirements
- Maintained
- Clear purpose
- We prefer (mostly) original lists to compilations (like Energized or oisd.nl). Maybe we should add a special section for compilations (?)
StevenBlack's one would be nice to have, along with the Energized lists.
As I recall, there were some people against Energized: https://github.com/AdguardTeam/AdGuardHome/issues/1325#issuecomment-575005823
@DandelionSprout Since the Energized lists are compiled almost entirely from other lists (except for ~20,000 of the entries that come from Energized Core), I personally would have chose to prioritise adding the best ones among the source lists instead.
Can we just include the Energized Core?
Sadly not, because of https://github.com/AdroitAdorKhan/EnergizedProtection/issues/60.
Weird stuff, so adding Energized means that the whitelist should be added as well
We should consider adding Luminati and Avast to the list of "Services", see the lists here: https://github.com/durablenapkin/block
Hungarian list: https://github.com/hufilter/hufilter/blob/master/hufilter-dns.txt
it will be good if you replace Spam404 link from https://raw.githubusercontent.com/Spam404/lists/master/main-blacklist.txt to https://raw.githubusercontent.com/Spam404/lists/master/adblock-list.txt
@YBS-PC the "adblock-list" is supposed to be used by traditional adblockers and not in host-level blockers and there's a risk that at some point there will be added some unsupported modifiers like $third-party or $document. That's why I'd better keep simple hosts list for now.
URLhaus Malicious URL Blocklist - https://gitlab.com/curben/urlhaus-filter#urlhaus-malicious-url-blocklist
This list is being used by ublock origin to replace Malware domains list. The author also has an AGH specific list https://gitlab.com/curben/urlhaus-filter#domain-based-adguard-home
It is now pretty safe to assume that anything Energized-related is ruled out entirely, since the lead dev is too often absent that the possibility of creating a Core + Whitelist combo for AGH probably wouldn't be worth the effort to suggest and hope for.
On the other hand, I'm currently testing out Block List Project: Ads, with good results so far.
This list is being used by ublock origin to replace Malware domains list. The author also has an AGH specific list https://gitlab.com/curben/urlhaus-filter#domain-based-adguard-home
Based on my experience I would suggest using the "Lite version" of the URLhaus list, that version contains the current online domains/IPs only.
The full list results in false positives as it contains entries that once contained malware but may have been fixed 6 months or a year ago, but are still included in the list as historic.
One more interesting list - WindowsSpyBlocker - Hosts spy rules by @crazy-max
https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt
It is now reasonably safe to assume that no projects or lists made by Energized Protection should ever be included in AdGuard Home or any other AdGuard project, due to long-term negligence of reported problems by its one actual maintainer: https://github.com/EnergizedProtection/block/issues/562
Edit: Okay, so in my eagerness to point this out, I forgot I had essentially pointed out the same thing near-verbatim a month ago, although without a proper conclusive source at the time. My fault. 😅
@ameshkov
One more interesting list -
WindowsSpyBlocker - Hosts spy rulesby @crazy-max https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt
Feel free to get back to me if you use this list.
These are a must have https://abp.oisd.nl/ https://phishing.army/download/phishing_army_blocklist_extended.txt https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-domains.txt
To block DoH https://raw.githubusercontent.com/thiagocrepaldi/doh_servers/master/dohservers.txt https://raw.githubusercontent.com/thiagocrepaldi/doh_servers/master/dohservers2.txt https://heuristicsecurity.com/dohservers.txt (it doesn't work now)
This list is nice for blocking trackers. https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-blocklist.txt
Have a nice day
Developer Dan's Ads & Tracking
A programmatically expanded list of hosts used for advertisements and tracking. This is my primary list and I recommend using it. This list was last updated on December 18, 2020.
Website: https://www.github.developerdan.com/hosts/ List: https://www.github.developerdan.com/hosts/lists/ads-and-tracking-extended.txt
The Malware Domain List vetted by AGH no longer appears to be valid.
https://www.malwaredomainlist.com/hostslist/hosts.txt
The Malware Domain List vetted by AGH no longer appears to be valid.
@ZeroClover An effective replacement is URLhaus, they have a "Lite version" which contains current online domains/IPs only.
There is a project that is already automatically building the list in a suitable format twice per day.
@josephbu
It appears that this list is designed for AGH, but I'm not quite sure what the point of adding IP filter entries to a DNS-based filter list is.
AdGuard Home is capable of blocking domains by the IP addresses of their CNAME responses. This results in IP entries and even CIDR entries being accepted by AGH.
Anudeep's Blacklist
A well-maintained and curated host file containing domains that serve ads, tracking scripts and malware. Each domain is tested and verified before adding to the list. Any reported false positives will be removed as soon as possible.
Website: https://github.com/anudeepND/blacklist List: https://hosts.anudeep.me/mirror/adservers.txt
It is highly recommended to use the mirror link as it provides Last-Modified header which ensures that you are getting the latest version.
Same author of the well-known Whitelist.
This results in IP entries and even CIDR entries being accepted by AGH.
If CIDR entries work then should we add Spamhaus DROP list? Not all internet infrastructure abides by these rules so blocking them could be beneficial. https://www.spamhaus.org/drop/drop.txt https://www.spamhaus.org/drop/dropv6.txt
Less infrastructure follows the EDROP list, so it's more likely to provide actual benefit. https://www.spamhaus.org/drop/edrop.txt
Indonesian and Malaysian block list https://raw.githubusercontent.com/ABPindo/indonesianadblockrules/master/subscriptions/abpindo.txt
Some of the lists mentioned were added in https://github.com/AdguardTeam/AdGuardHome/issues/2638
One more suggestion from https://github.com/AdguardTeam/FiltersRegistry/issues/430 - https://github.com/FutaGuard/FutaFilter
This results in IP entries and even CIDR entries being accepted by AGH.
If CIDR entries work then should we add Spamhaus DROP list? Not all internet infrastructure abides by these rules so blocking them could be beneficial. https://www.spamhaus.org/drop/drop.txt https://www.spamhaus.org/drop/dropv6.txt
Less infrastructure follows the EDROP list, so it's more likely to provide actual benefit. https://www.spamhaus.org/drop/edrop.txt
I created this for that; https://oisd.nl/edropRegexed.php
Ontopic; "oisd full": https://abp.oisd.nl/
While being a combination of blocklists, it has "their problems" fixed in them. This will be the blocklist that (even though it's size) causes the least issues.
False positives are dealt with within 24 hours. Anonymously if wanted (via website , no registration required) or publicly on reddit
I dare people to find an report false positives.
Blokada 5 uses the (basic) list as the default blocklist. AHAdns and Adhole use it as their blocklist ;)
Homepage; https://oisd.nl
I'll be reviewing the thread before v0.106 release #2644
Regarding OISD, I suggest adding the basic version to the "General" section.
The full version deserves a separate category ("compilations"), but that would lead to adding other compilations as well (Energized for one), and I am still afraid of people that simply check all the available boxes and then suffer from false positives.
Regional Blocklist: TUR: nurcan Türk ad-list (https://raw.githubusercontent.com/xorcan/hosts/master/xhosts.txt) Results in 404. Maybe remove?