uBO-Extra icon indicating copy to clipboard operation
uBO-Extra copied to clipboard

Regarding instart logic/g00 crap update

Open ghajini opened this issue 5 years ago • 69 comments

@gorhill @okiehsch

@mapx-

Test 1. tested with alone ublock origin on chrome

No g00 redirections/instart logic seen

https://www.afterellen.com/

americanphotomag.com now redirects to https://www.popphoto.com/

https://www.baltimoresun.com/ https://www.boatingmag.com/ https://www.boston.com/ https://www.cafemom.com/ https://calgaryherald.com/ https://calgarysun.com/ capitalgazette.com

carrollcountytimes.com redirects to https://www.baltimoresun.com/maryland/carroll/

cattime.com cbssports.com chicagotribune.com https://www.chron.com/ https://www.chroniclelive.co.uk/

citypaper.com redirecs to https://www.baltimoresun.com/citypaper/

https://www.comingsoon.net/ , admiral antiadblock

computershopper.com redirects to pcmag.com

https://www.courant.com/ https://www.cruisingworld.com/

http://csgoutpost.com/ site unavailable

https://www.courant.com/ https://www.cycleworld.com/ https://www.dailydot.com/ https://www.dailypress.com

http://dayzdb.com/ site unreachable

deathandtaxesmag.com redirects to https://www.spin.com/death-and-taxes/

https://www.delmartimes.net/

destinationweddingmag.com redirects to https://www.islands.com/destination-weddings/

https://www.dirtrider.com/ https://dogtime.com/

http://dotaoutpost.com/ site unreachable

https://download.cnet.com/windows/ https://edmontonjournal.com/ https://edmontonsun.com/ https://www.edmunds.com/ emedicinehealth.com

http://www.esohead.com/ site unreachable

http://everquest.allakhazam.com/ extremetech.com fieldandstream.com financialpost.com flyingmag.com https://www.focus.de/ gamepedia.com

https://www.gamerevolution.com/, admiral antiadblock

gamespot.com geek.com gofugyourself.com https://www.growthspotter.com/

hearthhead.com redirects tohttps://www.hearthstonetopdecks.com/

http://hockeysfuture.com/ site unreachable

hoylosangeles.com ibtimes.com ign.com https://www.islands.com/ https://www.lajollalight.com/ latintimes.com https://www.laptopmag.com/ leaderpost.com https://www.legacy.com/ https://www.lifewire.com/ livescience.com

lolking.net redirects to https://www.fanbyte.com/features/league-of-legends-model-viewer/#W1swLDAsMCwiMjY2IiwwLDBdXQ==

https://www.mamaslatinas.com/ marlinmag.com mcall.com medicaldaily.com medicinenet.com mmo-champion.com momtastic.com montrealgazette.com https://www.motorcyclecruiser.com motorcyclistonline.com https://www.motortrend.com/ https://www.msn.com/en-in

https://musicfeeds.com.au , admiral antiadblock

mustangandfords.com http://mysanantonio.com/ nasdaq.com https://nationalpost.com/ newsarama.com newsweek.com orlandosentinel.com ottawacitizen.com https://ottawasun.com/ https://www.outdoorlife.com/ pcmag.com

https://www.playstationlifestyle.net/ , admiral antiadblock

popsci.com https://www.ranchosantafereview.com/ https://www.range365.com/ https://www.ranker.com/ https://www.realclearpolitics.com/

realitytea.com site unreachable

redeyechicago.com redirects tohttps://www.chicagotribune.com/redeye/

salon.com https://www.saltwatersportsman.com/ https://www.sandiegouniontribune.com/ https://www.seattlepi.com https://www.saveur.com/ https://www.sfgate.com/

https://www.sherdog.com/, admiral antiadblock

slate.com https://slickdeals.net/

southflorida.com redirects to https://www.sun-sentinel.com/entertainment/

https://www.space.com/ , antiadblock

spin.com sporcle.com

http://sportdiver.com/ site unreachable

https://www.sportfishingmag.com/ http://sportingnews.com/

sportrider.com redirects tohttps://www.cycleworld.com/sport-rider/

spox.com stereogum.com https://www.sun-sentinel.com/

https://www.superherohype.com/ , admiral antiadblock

tenplay.com.au to https://10play.com.au/, antiadblock

http://tf2outpost.com/ site unreachable

thebalance.com

https://www.thefashionspot.com/ ,admiral antiadblock

https://theprovince.com/ https://www.thespruce.com/ thestarphoenix.com https://www.thoughtco.com/ timeanddate.com https://www.timesunion.com/ tomsguide.com https://www.tomsguide.fr/ https://www.tomshardware.co.uk/ tomshardware.com tomshardware.de https://www.tomshardware.fr/ https://torontosun.com/

https://www.totalbeauty.com/,, admiral antiadblock

trustedreviews.com tvtropes.org https://www.twincities.com/ https://vancouversun.com/

https://www.vg.no gives antiadblock

vibe.com https://www.wakeboardingmag.com/ washingtonpost.com

waterskimag.com redirects to https://www.boatingmag.com/water-sports-boats/

https://www.webmd.com wetteronline.de

wikia.comredirects to https://www.fandom.com/explore

https://www.windowscentral.com/ https://windsorstar.com/ winnipegsun.com https://www.wowhead.com/ wrestlezone.com redirects to https://www.mandatory.com/wrestlezone/ ,admiral antiablock triggered....

https://www.xda-developers.com/ yachtingmagazine.com

zam.com redirects to https://corp.fanbyte.com/

Test 2 .* tested with ublock origin+ublock extra stable latest versions g00 redirection/instart logic seen

atvrider.com baggersmag.com chowhound.com https://www.diversitybestpractices.com/ https://www.floridatravellife.com/ goal.com https://www.hotbikeweb.com/ infinitiev.com metacritic.com metrolyrics.com streetchopperweb.com superstreetbike.com thoughtcatalog.com tv.com tvguide.com utvdriver.com wibc.com workingmother.com

It seems instart logic is present on game sites😂

ghajini avatar Aug 19 '19 22:08 ghajini

The admiral sites are annoyances, update your filters and enable uBO-annoyances.

okiehsch avatar Aug 19 '19 23:08 okiehsch

Guess what I just discovered... but luckily an issue is already open.

Can confirm for

metacritic.com
thoughtcatalog.com

both look completely broken for me right now.

uBO 1.21.6 + uBO-Extra 2.84 on Chrome (latest stable, Win64)

What happened, is it official that a new version of IL has been rolled out or something?

Edit:

Well, this here is definitely new: Immediately after accessing the site, a bunch of redirects happen, as can be observed in the address bar. Ultimately I'm ending up here https://www.metacritic.com/g00/?i10c.encReferrer=

That did not happen before on that site, so far I'm sure.

Hrxn avatar Aug 20 '19 23:08 Hrxn

What happened, is it official that a new version of IL has been rolled out or something?

https://github.com/NanoMeow/QuickReports/issues/1640#issuecomment-519753460

okiehsch avatar Aug 21 '19 00:08 okiehsch

It remains unanswered, why ubo extra is running on pages that don't have g00/instart logic

ghajini avatar Aug 31 '19 06:08 ghajini

So, when certain sites are removed from uBO-Extra, such as some of the ones mentioned above were (e.g. tvguide.com, which was missing things of late), and as a result now more or less feel like they're running without any blocking at all (i.e. lots of ads coming through), what should be the course of action? Working to see what can be done over at EasyList? Such sites were in uBO-Extra in the first place for a good reason, so I'm thinking there may not be much to be done, at least in some cases.

rpodric avatar Sep 05 '19 05:09 rpodric

Interestingly the removed domains I checked are back to using the May version of Instart Logic on my end. Can you check tvguide.com on your end?

Go to view-source:https://www.tvguide.com My end: image

Is it the same on your end? If so I could re-add the domains that use that version. uBO-extra works fine on such sites.

okiehsch avatar Sep 05 '19 06:09 okiehsch

There's no mention of that in the source of that site at all here, in Chrome or Firefox. Is there some trick to it?

rpodric avatar Sep 05 '19 06:09 rpodric

Um, but you do get redirected if you go to https://www.tvguide.com?

okiehsch avatar Sep 05 '19 06:09 okiehsch

You can check if you get redirected by looking at your logger output. If you get redirected by Instart Logic you should see a lot of requests with g00 in it. Unbenannt

You only have to check using Chrome. Instart Logic does not work using Firefox at https://www.tvguide.com.

okiehsch avatar Sep 05 '19 06:09 okiehsch

No IL on my side.

Details
<!DOCTYPE html>
--
  | <html lang="en">
  | <head>
  | <meta charset="utf-8" />
  |  
  | <script type="text/javascript">(window.NREUM\|\|(NREUM={})).loader_config={xpid:"XQcAUFNADAYCUVhTDw=="};window.NREUM\|\|(NREUM={}),__nr_require=function(t,n,e){function r(e){if(!n[e]){var o=n[e]={exports:{}};t[e][0].call(o.exports,function(n){var o=t[e][1][n];return r(o\|\|n)},o,o.exports)}return n[e].exports}if("function"==typeof __nr_require)return __nr_require;for(var o=0;o<e.length;o++)r(e[o]);return r}({1:[function(t,n,e){function r(t){try{s.console&&console.log(t)}catch(n){}}var o,i=t("ee"),a=t(18),s={};try{o=localStorage.getItem("__nr_flags").split(","),console&&"function"==typeof console.log&&(s.console=!0,o.indexOf("dev")!==-1&&(s.dev=!0),o.indexOf("nr_dev")!==-1&&(s.nrDev=!0))}catch(c){}s.nrDev&&i.on("internal-error",function(t){r(t.st...


I checked few domain while ago, and some are problematic because of privacy policy wall

  • baggersmag.com - not work, privacy wall
  • chowhound.com - no g00 on 3 pages
  • diversitybestpractices.com - not work, privacy wall
  • floridatravellife.com - not work, privacy wall

gwarser avatar Sep 05 '19 11:09 gwarser

This is weird, do you get Instart Logic in the source of metacritic.com? image

okiehsch avatar Sep 05 '19 11:09 okiehsch

I think it might depend on user agent if they serve the IL script.

liamengland1 avatar Sep 05 '19 11:09 liamengland1

image

gwarser avatar Sep 05 '19 13:09 gwarser

@okiehsch

I'll try to catch up:

-I don't know if the redirects were happening last night, but this morning they are. -This morning, your "//Copyright Instart Fri May 24 2019 - All rights reserved - version: 10.6.32" string appears on tvguide.com, as if by magic, when it didn't through multiple reloads last night. Both times, however, last night and now, the site looks and feels as if ad blocking is completely disabled on it. I know it isn't, by looking at the uBO panel, but if I couldn't look at that I would have guessed that it was disabled. -Yes, also seeing the very same Instart string on Metacritic.

rpodric avatar Sep 05 '19 15:09 rpodric

//Copyright Instart Fri May 24 2019 does not tell which version of IL crap is embedded. There is a new version out there that broke sites which were listed in uBO-Extra, so they had to be removed.

What is needed is dev work to be undertaken to understand how the new IL crap work, and if it can be defused. At some point, that developer will have to be someone else than me, I do not have infinite time and interest to spend on this. I do not visit any IL-backed site personally, so the motivation to work on this beside everything else I already have to maintain because I would be affected myself is not that great.

gorhill avatar Sep 05 '19 15:09 gorhill

@rpodric You asked "after the removal of sites like tvguide.com what should be the course of action?"

On your end you can

  • Use Firefox for such sites
  • Disable javascript. This will break some stuff but should be good enough if you only want to read articles.
  • Sideload an old version of uBO-extra. I checked tvguide.com with uBO-Extra-2.83 and it works fine without any redirection or site breakage on my end.

okiehsch avatar Sep 06 '19 00:09 okiehsch

https://github.com/uBlockOrigin/uAssets/issues/6260#issuecomment-529144977

liamengland1 avatar Sep 07 '19 21:09 liamengland1

Can these filters be added for IGN? @okiehsch

||static.doubleclick.net/instream/ad_status.js$script,domain=ign.com,redirect=noop.js
||imasdk.googleapis.com/js/sdkloader/ima3.js$script,domain=ign.com,redirect=noop.js
||g01.ign.com^$script,redirect=noop.js
||g02.ign.com^$script,redirect=noop.js

liamengland1 avatar Sep 07 '19 21:09 liamengland1

For ign.com see https://github.com/uBlockOrigin/uAssets/commit/33a403e98aa4f343c012936d2bdda0cca8f76319#commitcomment-34805881

okiehsch avatar Sep 07 '19 22:09 okiehsch

Please test/add the following for ratemyprofessors.com @okiehsch:

@@||ratemyprofessors.com^$generichide
! same rule as metacritic, could be made generic? maybe something like:
! ||*/g00/*/ad?i10c.getabdurl=*&ad_channel=$media,1p,redirect=noop.txt
||ratemyprofessors.com^*/ad?i10c.getabdurl=*&ad_channel=$media,1p,redirect=noop.txt
||ratemyprofessors.com/g00/*$ping

Also for metacritic, the rule ||metacritic.com/g00/*$ping can be added as well so that no g00 content is loaded at all.

liamengland1 avatar Sep 08 '19 02:09 liamengland1

I will add your filters to uBO-filters. I have re-added some sites to uBO-extra https://github.com/gorhill/uBO-Extra/commit/448a3ab5133b1abcc852df91660ad2a5563d55c1 So those sites should work fine as soon as the next uBO-extra version is released.

okiehsch avatar Sep 08 '19 03:09 okiehsch

https://github.com/uBlockOrigin/uAssets/commit/1f28b7fc1fd8df07b77c381311b9936b7d605d23

liamengland1 avatar Sep 08 '19 04:09 liamengland1

@okiehsch please add @@||tvguide.com^$generichide for tvguide.com

liamengland1 avatar Sep 08 '19 19:09 liamengland1

And @@||maxpreps.com^$generichide for maxpreps.com

liamengland1 avatar Sep 08 '19 19:09 liamengland1

Another one: @@||metrolyrics.com^$generichide for metrolyrics.com

Side note: all of these websites are CBS Interactive brands

liamengland1 avatar Sep 08 '19 19:09 liamengland1

Oh wait, some of these sites are being added back to uBo extra. https://github.com/gorhill/uBO-Extra/commit/448a3ab5133b1abcc852df91660ad2a5563d55c1

liamengland1 avatar Sep 08 '19 19:09 liamengland1

It does not matter, still useful for those not using uBo extra

mapx- avatar Sep 08 '19 20:09 mapx-

@okiehsch https://github.com/NanoMeow/QuickReports/issues/1923#issuecomment-535641806

liamengland1 avatar Sep 26 '19 19:09 liamengland1

New version of Instart on msn.com.

Fix:

*$media,redirect=noop.txt,domain=msn.com,3p
@@||eus-streaming-video-msn-com.akamaized.net^$media,domain=msn.com

Also add:

@@||baggersmag.com^$generichide
@@||thoughtcatalog.com^$generichide

liamengland1 avatar Oct 02 '19 03:10 liamengland1

How about

baggersmag.com,msn.com,thoughtcatalog.com##+js(aopw, Object.getOwnPropertyDescriptor)

Any breakage?

okiehsch avatar Oct 02 '19 03:10 okiehsch