LuLu icon indicating copy to clipboard operation
LuLu copied to clipboard

Blocklist not working

Open pier611-pm-me opened this issue 3 years ago • 21 comments

As a follow up to issue #291 and to assist in recreating the problem

Example of blocklist not blocking is - hotelscombined.com.au

It is on blockyoulist.txt, which is installed per instructions and site immediately loads (screenshots attached).

Screen Shot 2021-01-15 at 8 37 13 am Screen Shot 2021-01-15 at 8 53 06 am Screen Shot 2021-01-15 at 8 36 25 am

pier611-pm-me avatar Jan 14 '21 21:01 pier611-pm-me

I can also reproduce this. Currently the block list is non functional for me. But maybe I just misconfigured it some how? Would love to get this to work! image

What I also tried:

  • Restart LuLu
  • Restart OSX
  • Custom (Local) Blocklist
  • Completely reinstalled LuLu (and installed with brew)
  • Verified I am on Version 2.1.0

Update:

  • It works in Safari ✅ but not in Chrome ❌

ArgonQQ avatar Jan 15 '21 07:01 ArgonQQ

Thanks for the bug report and helpful repo steps!

I'm continuing to dig, but did find one issue in the code ...the block list isn't captured/saved if you close the window after copy & pasting in the block list (local or remote, i.e. https://ceadd.ca/blockyouxlist.txt). Obviously this is a bug in LuLu 😅

I've fixed this locally in code and will shortly be releasing a new version ...but if you want a workaround for now, (re)enter a block list, (i.e. https://ceadd.ca/blockyouxlist.txt) and then hit "Enter" to trigger it being captured/saved.

Once its captured/saved, blocking appears to work (e.g, http://hotelscombined.com.au ...in Safari): image

objective-see avatar Jan 15 '21 08:01 objective-see

Patrick Thanks for your efforts.

While the workaround is effective for Safari and Firefox - it is necessary to repeat it at each login. However blocklist sites remain accesible in Brave, Vivaldi or Tor (I don't have Chrome installed).

pier611-pm-me avatar Jan 15 '21 11:01 pier611-pm-me

I believe I figured out why items on the blocklist remain accessible in Brave (and maybe Chrome, yet to be tested)

Apple's documentation notes:

/*!
 * @property URL
 * @discussion The flow's HTTP request URL. Will be nil if the flow did not originate from WebKit.
 */
@property (readonly, nullable) NSURL *URL;

Confirmed in Brave that the reported flow (that passes thru the firewall) only has the ip address, and the URL is nil. ...which means URL-based items in block list (e.g. hotelscombined.com.au) are ineffective, as the the host/URL never is seen by the firewall.

Will dig more to see if there is workaround, but this might just be an OS-limitation, that we have to live with :(

objective-see avatar Jan 16 '21 02:01 objective-see

Just pushed v2.2.0 which has the the discussed fixes ...specifically block list is always captured when entered, and now correctly (re)loaded. on reboot.

Also confirmed that to limitations of macOS, blocking via host name is only applicable to (as Apple notes) "Network.framework or NSURLSession connections".

As such, for browsers (such as Chrome), that do not leverage these frameworks, only ip address based blocking is supported. ...as Safari and Firefox leverage such frameworks, they are not subject to this limitation.

If you wanted to download/give v2.2.0 a test, that'd be great!

Grab from: https://github.com/objective-see/LuLu/releases/tag/v2.2.0 or https://bitbucket.org/objective-see/deploy/downloads/LuLu_2.2.0.dmg

objective-see avatar Jan 17 '21 07:01 objective-see

It is effective in Safari but not Firefox. To further check I have tried both ceadd file and local file. I have also added URLs to the local file with the same outcome (blocked in Safari but not Firefox).

Screen Shot 2021-01-17 at 8 22 42 pm Screen Shot 2021-01-17 at 8 18 21 pm Screen Shot 2021-01-17 at 8 18 31 pm Screen Shot 2021-01-17 at 8 19 50 pm

pier611-pm-me avatar Jan 17 '21 09:01 pier611-pm-me

For remote list, would it be possible to have a periodical update setting? Rather than only loading upon blocklist init.. Comparing to local list which is checked for timestamp every time a new flow is handled, remote list update frequency is very low.

Thanks a lot!

ivwang avatar Jan 18 '21 11:01 ivwang

I'm also seeing that it's effective in Safari but not Firefox.

Lulu 2.2.0 macOS 11.1 (M1)

heygarrett avatar Jan 21 '21 21:01 heygarrett

I believe I figured out why items on the blocklist remain accessible in Brave (and maybe Chrome, yet to be tested)

Apple's documentation notes:

/*!
 * @property URL
 * @discussion The flow's HTTP request URL. Will be nil if the flow did not originate from WebKit.
 */
@property (readonly, nullable) NSURL *URL;

Confirmed in Brave that the reported flow (that passes thru the firewall) only has the ip address, and the URL is nil. ...which means URL-based items in block list (e.g. hotelscombined.com.au) are ineffective, as the the host/URL never is seen by the firewall.

Will dig more to see if there is workaround, but this might just be an OS-limitation, that we have to live with :(

I tried this functionality in Little Snitch 5 (LS) and it was able to block requests by domain in all apps, not only Safari. Doesn't they use the same network extension framework?

I also don't understand why Lulu alerts for Safari doesn't contain a domain but only an IP address like that:

telegram-cloud-photo-size-2-5364269275323413243-y In some cases, alerts do contain a domain, though. @objective-see

georgysavva avatar Mar 15 '21 04:03 georgysavva

Hello the rules list doesn't work at all for me. When I select a local text file list and hit enter then click the button that says "View Rules" The LuLu program window stays empty and does not show any of the rules on my list. Screen Shot 2021-04-12 at 4 09 36 PM Screen Shot 2021-04-12 at 4 09 26 PM

cyberfunk avatar Apr 12 '21 23:04 cyberfunk

Same for me, using the latest version image

If I list sites by domain name it does not have any effect on browsers or even ping command in terminal If I add ip address it does not have have any effect on browsers if I use domain name, but it does block the sites by ip address in all browsers including the ping command

kuncevic avatar Dec 10 '21 05:12 kuncevic

  • Follow up to this issue with new version (2.4.2) of LuLu as seen in attached images.
  • MacOS Big Sur V 11.5.2
  • Browser is FireFox. List tested is the provided "ceadd".
  • URL tested from list: plex2.com (for others testing, this website was clean on virustotal.com)
  • Website loaded. I tried the press enter after adding list workaround, and reloaded browser and inputted the domain and it loaded all the same. Version List list and URL Website

GitHugz avatar Sep 26 '22 00:09 GitHugz

I'm confused here..

I made a blocklist file with a single entry google.com, but I can still ping google.com

But if I add 0.0.0.0 google.com to my /private/etc/hosts file, it blocks the pings/https just fine.

How can I get this to work in Lulu?

skupjoe avatar Oct 06 '22 04:10 skupjoe

I'm having the same problem, the domains on the Lulu blocklist are still accessible in Safari. The domains are only successfully blocked when I add them in host (with Lulu's block list disabled).

  • Lulu version 2.4.2
  • macOS 12.6.2

Jerry23011 avatar Jan 15 '23 04:01 Jerry23011

Block list not works. Tried url and local file, restarted Lulu and Mac, clicked "Update" and switched "on/off".

  • Lulu version 2.4.2
  • macOS 13.2 (22D49)

andriitishchenko avatar Feb 08 '23 15:02 andriitishchenko

I tried again with a local txt file, and the blocklist still doesn't seem to work. Wonder if it is my configuration's problem.

  • Lulu v2.4.2
  • macOS 13.3

Jerry23011 avatar Mar 31 '23 02:03 Jerry23011

LuLu blocklist not working for me. I have tried both local .txt file blocklist and an oneline one such as https://ceadd.ca/blockyouxlist.txt. With regards to browsers i have tried Orion, Chrome and Safari. My methodology is to insert the blocklist and press enter. Hereafter i open safari and type in the url of a given site such as hotelscombined.com.au and observe that the site continues to load for a given site. Also i can ping through terminal hotelscombined.com.au

  • Lulu v2.4.3
  • macOS Ventura (13.3.1)

MortMort avatar Apr 27 '23 16:04 MortMort

Weirdly, it's the same for me. Tried it all, seems blocklist doesn't do anything 😐 I've got a blocklist which starts like that. And I can ping all of those hosts. 2023-06-04_17-07-21 Interestingly, this only makes apple.com inaccessible in Firefox, despite I didn't block it there! Maybe could it be a parsing error? Anyway, this looks like a huge issue... :|

Intenditore avatar Jun 04 '23 14:06 Intenditore