CoreLibs icon indicating copy to clipboard operation
CoreLibs copied to clipboard

Safari is not filtered on macOS 15 Beta 5 with Private Relay enabled

Open q36zhd46w17o opened this issue 1 year ago • 53 comments

Please answer the following questions for yourself before submitting an issue

  • [X] Filters were updated before reproducing an issue
  • [X] I checked the knowledge base and found no answer
  • [x] I checked to make sure that this issue has not already been filed

AdGuard version

2.15.1.1731 release

Browser version

18.1 (20619.2.1)

OS version

macOS Sequoia Beta 15.1 (24B5035e)

Ad Blocking

AdGuard Base filter, AdGuard Mobile Ads filter, EasyList

Privacy

AdGuard Tracking Protection filter, AdGuard URL Tracking filter, EasyPrivacy, Legitimate URL Shortener, Peter Lowe's Blocklist, Fanboy's Anti-Facebook List

Social

AdGuard Social Media filter, Fanboy's Social Blocking List

Annoyances

AdGuard Annoyances filter, AdGuard Cookie Notices filter, AdGuard Popups filter, AdGuard Mobile App Banners filter, AdGuard Other Annoyances filter, AdGuard Widgets filter, Adblock Warning Removal List, Fanboy's Annoyances, EasyList Cookie List, Dandelion Sprout's Annoyances List

Security

Online Malicious URL Blocklist, Phishing URL Blocklist, Scam Blocklist by DurableNapkin, uBlock Origin – Badware risks, NoCoin Filter List

Other

Filter unblocking search ads and self-promotion, AdGuard DNS filter, AdGuard Experimental filter, Fanboy's Anti-thirdparty Fonts

Language-specific

AdGuard Chinese filter, AdGuard Japanese filter

Which DNS server do you use?

AdGuard DNS

DNS protocol

DNS-over-HTTPS

Custom DNS

No response

What Stealth Mode options do you have enabled?

Block trackers, Remove tracking parameters, Hide your search queries, Send Do-Not-Track signals, Disable cache for third-party requests, Block the third-party Authorization header, Block WebRTC, Block Push API, Block Location API, Block Java, Hide your Referrer from third-parties, Hide your User Agent, Mask your IP address, Remove X-client-Data header from HTTP request, Protect from DPI

Support ticket ID

947659

Issue Details

1.	Open the Safari browser and ensure the AdGuard extension is enabled.
2.	Visit a website known to contain ads, such as Youtube.
3.	Attempt to load the page and observe whether any ads are displayed.
4.	On the same page, try using Safari’s new privacy features, such as “element hiding,” and observe the behavior of page elements.
5.	Repeat the above steps, noting if any “You Are Not Connected to the Internet” error messages appear.

Expected Behavior

•	AdGuard should effectively block all ads on the page, with no ads bypassing the filters.
•	Safari should not display any connection error messages.
•	AdGuard should work seamlessly with Safari’s new privacy features, ensuring that page elements are properly hidden or blocked.

Actual Behavior

•	Ads intermittently bypass AdGuard’s filters and appear on some websites.
•	On certain occasions, Safari displays a “You Are Not Connected to the Internet” error, which seems related to AdGuard’s filtering process.
•	There appears to be a conflict between AdGuard and Safari’s new privacy features, preventing certain webpage elements from being effectively hidden or blocked.

Screenshots

Screenshot 1

Additional Information

I would like to add that when using Chrome on the same computer, I do not encounter any of these issues. AdGuard functions as expected on Chrome version 128.0.6613.86 (Official Build) (arm64).

q36zhd46w17o avatar Sep 02 '24 12:09 q36zhd46w17o

Hi @q36zhd46w17o

We have been able to reproduce the issue of Element blocking with the AdGuard Assistant extension in Safari. However, we cannot reproduce issues with ads bypassing AdGuard filters and "You are not connected to the Internet" error messages.

To diagnose and fix the above issues, we need to get the application logs. Here's what we need you to do:

  1. Click AdGuard icon in the menu bar → Gear → Advanced → Logging → Logging level → Debug;
  2. Reproduce the issue and remember the exact time it happened;
  3. Menu → Advanced → Logging → Export Logs and System Info…;
  4. Send the archive to [email protected] and mention this issue number in the subject.

AlexandrPkhm avatar Sep 03 '24 10:09 AlexandrPkhm

@hmgnsd Hi, it seems that the issue you are experiencing is related to the general filtering in Safari on MacOS 15 Sequoia beta versions. Could you please record the debug logs of the application for us? We need them to diagnose and fix this issue.

We have left the similar instructions in your previous ticket, but just in case, here is what we need you to do:

  1. Click AdGuard icon in the menu bar -> Gear -> Advanced -> Logging -> Logging level -> Debug.
  2. Reproduce the problem, then remember the exact time it happened.
  3. Menu -> Advanced -> Logging -> Export Logs and System Info.….
  4. Send this file to [email protected]:
    • include [mac] keyword and #1471 in the subject of your email
    • specify the exact time when the issue occurred

AlexandrPkhm avatar Sep 04 '24 16:09 AlexandrPkhm

Hi, same issue here can I send the data too?

I did send the data, it seems that when I disable iCloud Private Relay everything works fine.

xJustxMegx avatar Sep 08 '24 08:09 xJustxMegx

FYI - this seems to work when I re-enable Private-Relay on my Mac (Sequoia 15.0) on my commonly used tabs with all but usatoday.com, where several ads remain. If I turn private relay off, and refresh usatoday.com, the ads go away.

jameyers4 avatar Sep 22 '24 14:09 jameyers4

Seems that this issue is reproduced only if both Private Relay and Firewall are on.

If firewall is off, the old behaviour returns - Private Relay auto-disables when some network filtering software is running.

sfionov avatar Sep 23 '24 19:09 sfionov

I’ve not tried that specifically, but I can believe it easily - I keep firewall on all the time. From my chair, something changed with MacOS Sequoia (15.0) - this was all working in last release of macOS 14.x.

On Sep 23, 2024, at 3:13 PM, Sergey Fionov @.***> wrote:

Seems that this issue is reproduced only if both Private Relay and Firewall are on.

If firewall is off, the old behaviour returns - Private Relay auto-disables when some network filtering software is running.

— Reply to this email directly, view it on GitHub https://github.com/AdguardTeam/CoreLibs/issues/1914#issuecomment-2369150216, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHIJ5OIIOJLKM3LF5LTVOQLZYBR4ZAVCNFSM6AAAAABN6NIIKKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNRZGE2TAMRRGY. You are receiving this because you commented.

jameyers4 avatar Sep 23 '24 19:09 jameyers4

@jameyers4 this is indeed a bug of Sequoia: https://www.theregister.com/2024/09/23/security_in_brief/

Quick question: does it help to add the following two domain to AdGuard's DNS blocklist:

mask.icloud.com
mask-h2.icloud.com

ameshkov avatar Sep 23 '24 19:09 ameshkov

It does not help - still USATODAY.com http://usatoday.com/ ad’s

Jeff

On Sep 23, 2024, at 3:58 PM, Andrey Meshkov @.***> wrote:

@jameyers4 https://github.com/jameyers4 this is indeed a bug of Sequoia: https://www.theregister.com/2024/09/23/security_in_brief/

Quick question: does it help to add the following two domain to AdGuard's DNS blocklist:

mask.icloud.com mask-h2.icloud.com — Reply to this email directly, view it on GitHub https://github.com/AdguardTeam/CoreLibs/issues/1914#issuecomment-2369248744, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHIJ5OIW7BQBTBZ4FD55WWTZYBXFZAVCNFSM6AAAAABN6NIIKKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNRZGI2DQNZUGQ. You are receiving this because you were mentioned.

jameyers4 avatar Sep 23 '24 20:09 jameyers4

@jameyers4 you may need to restart AdGuard so that the rules kick in.

ameshkov avatar Sep 23 '24 20:09 ameshkov

Yessss… that did it. Seems to work!

Jeff

On Sep 23, 2024, at 4:11 PM, Andrey Meshkov @.***> wrote:

@jameyers4 https://github.com/jameyers4 you may need to restart AdGuard so that the rules kick in.

— Reply to this email directly, view it on GitHub https://github.com/AdguardTeam/CoreLibs/issues/1914#issuecomment-2369275517, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHIJ5OIRRNXTQ54OFTGFE5DZYBYVTAVCNFSM6AAAAABN6NIIKKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNRZGI3TKNJRG4. You are receiving this because you were mentioned.

jameyers4 avatar Sep 23 '24 20:09 jameyers4

Sorry - forgot to turn Private Relay back on...

It is not working

Jeff

On Sep 23, 2024, at 4:11 PM, Andrey Meshkov @.***> wrote:

@jameyers4 https://github.com/jameyers4 you may need to restart AdGuard so that the rules kick in.

— Reply to this email directly, view it on GitHub https://github.com/AdguardTeam/CoreLibs/issues/1914#issuecomment-2369275517, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHIJ5OIRRNXTQ54OFTGFE5DZYBYVTAVCNFSM6AAAAABN6NIIKKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNRZGI3TKNJRG4. You are receiving this because you were mentioned.

jameyers4 avatar Sep 23 '24 20:09 jameyers4

We reported the issue to Apple: https://developer.apple.com/forums/thread/764531

ameshkov avatar Sep 24 '24 14:09 ameshkov

We reported the issue to Apple: https://developer.apple.com/forums/thread/764531

Thanks for this! It's really annoying to have ads while on a different network then my home (mobile hotspot).

xJustxMegx avatar Sep 25 '24 08:09 xJustxMegx

In our tests filtering is working again on macOS 15.1 beta even with Firewall on.

I'm not sure if fix is present in 15.0.1 released today.

sfionov avatar Oct 04 '24 13:10 sfionov

@sfionov, thank you for the information.

I have updated to the latest: macOS 15.0.1 and the issue persists. I'll post with any updates in the future.

A note to others trying to reproduce this; I have found that after enabling/disabling Private Relay I must fully quit Safari and relaunch for the filtering changes to take effect.

atticusmatticus avatar Oct 04 '24 16:10 atticusmatticus

Just installed 15.1 on my M2 Pro MBP - still getting ads in Safari when I re-enable Private Relay. Am I missing something?

jameyers4 avatar Oct 28 '24 16:10 jameyers4

@jameyers4 are you getting ads every time you enable Private Relay?

Aydinv13 avatar Oct 28 '24 16:10 Aydinv13

That is correct.

When I updated to macOS 15.0, had the problems with ads and Private Relay; turned off Private Relay - blocking worked.

Updated to 15.0.1 0 - same exact problem.

Updated today to 15.1 release - same (although apparently 15.1 beta was supposedly working).

Jeff

On Oct 28, 2024, at 12:39 PM, Aydin Baydarov @.***> wrote:

@jameyers4 https://github.com/jameyers4 are you getting ads every time you enable Private Relay?

— Reply to this email directly, view it on GitHub https://github.com/AdguardTeam/CoreLibs/issues/1914#issuecomment-2442091829, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHIJ5OJ7LFFVIIYOWBUT2M3Z5ZLB5AVCNFSM6AAAAABN6NIIKKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINBSGA4TCOBSHE. You are receiving this because you were mentioned.

jameyers4 avatar Oct 28 '24 16:10 jameyers4

In our tests filtering is working again on macOS 15.1 beta even with Firewall on.

I'm not sure if fix is present in 15.0.1 released today.

I am on macOS 15.1 and the problem is still the same Edit: I actually found a solution online: AdGuard Settings > Network > Filtering Mode > Automatic Proxy

baslia avatar Oct 28 '24 19:10 baslia

Thank baslia! Outstanding! That did it. Thank you...

jameyers4

jameyers4 avatar Oct 28 '24 19:10 jameyers4

Isn't this more of a workaround than a fix? Perhaps I'm misunderstanding but isn't Automatic Proxy a less desirable option for the filtering mode?

atticusmatticus avatar Oct 28 '24 19:10 atticusmatticus

It could well be, but for now it works…

Jeff

jameyers4 avatar Oct 28 '24 19:10 jameyers4

If someone can explain why this is less desirable, that would provide some context. If, in fact, it is less desirable, then what is it that still needs to be done (Apple fix, AdGuard changes..? Other?). At the moment, I'm happy to be able to have Firewall and Private Relay on, and have Ads blocked.

Jeff

jameyers4 avatar Oct 28 '24 19:10 jameyers4

I agree it is good to have a workaround in the meantime. Didn’t mean to diminish that.

Regarding the desirability, I’m just going off the description of each filtering mode in the AdGuard app itself. Kernel extension is the old method, network extension is the replacement of kernel ext. and guarantees best quality filtering, the automatic proxy seems to be billed as a workaround method with diminished filtering abilities to be used when the other modes aren’t working.

So I’m guessing this was a viable workaround this whole time? I’ll test it out and report back here as I haven’t upgraded to 15.1 yet. But I don’t think that the underlying problem has been fixed if Network Extension mode is still broken.

EDIT: Yes Automatic Proxy filtering mode does fix the issue on macOS 15.0.1 as well. So, this is a good temporary workaround until the issue (Apple / Adguard / ??) is fixed for the Network Extension mode.

atticusmatticus avatar Oct 28 '24 20:10 atticusmatticus

Pending your findings, I agree with your assertions below…

Jeff

So I’m guessing this was a viable workaround this whole time? I’ll test it out and report back here as I haven’t upgraded to 15.1 yet. But I don’t think that the underlying problem has been fixed if Network Extension mode is still broken.

jameyers4 avatar Oct 28 '24 21:10 jameyers4

I've updated to macOS 15.1 as well and the issue is still present for me when on Network Extension filtering mode.

atticusmatticus avatar Oct 29 '24 13:10 atticusmatticus

Well, I would not have expected that news, since for whatever reason it works for me on 15.1. Very odd.

On Oct 29, 2024, at 9:17 AM, atticusmatticus @.***> wrote:

I've updated to macOS 15.1 as well and the issue is still present for me when on Network Extension filtering mode.

— Reply to this email directly, view it on GitHub https://github.com/AdguardTeam/CoreLibs/issues/1914#issuecomment-2444201774, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHIJ5OO7XTLMON52JGYYDL3Z56DIJAVCNFSM6AAAAABN6NIIKKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINBUGIYDCNZXGQ. You are receiving this because you were mentioned.

jameyers4 avatar Oct 29 '24 13:10 jameyers4

I thought it only works for you when you change to Automatic Proxy mode?

atticusmatticus avatar Oct 29 '24 13:10 atticusmatticus

Correct - only in automatic proxy filtering mode, it does not work in (preferred..?) network extension filtering mode.

On Oct 29, 2024, at 9:36 AM, atticusmatticus @.***> wrote:

I thought it only works for you when you change to Automatic Proxy mode?

— Reply to this email directly, view it on GitHub https://github.com/AdguardTeam/CoreLibs/issues/1914#issuecomment-2444256202, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHIJ5OKIY2BUJSAUZQYEFQDZ56FOVAVCNFSM6AAAAABN6NIIKKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINBUGI2TMMRQGI. You are receiving this because you were mentioned.

jameyers4 avatar Oct 29 '24 13:10 jameyers4

Yes, I’m in the same situation. Ads are blocked on Automatic Proxy mode and not blocked on Network Extension mode.

atticusmatticus avatar Oct 29 '24 13:10 atticusmatticus