Pop up is scrapped from URL instead of data

[AndyTheFactory]

Issue by jigarjit Sat May 19 04:50:44 2018 Originally opened as https://github.com/codelucas/newspaper/issues/568

---

"URL": "http://economictimes.indiatimes.com/markets/stocks/recos/hold-lic-housing-finance-target-rs-600-icici-direct/articleshow/63967828.cms"

trying to scrap data from the above mentioned link it just picks up a popup which actually never shows during regular browsing can you help.

It gives this as article text:- "Article_Text": "Never miss a great news story!\n\nGet instant notifications from Economic Times\n\nAllowNot now\n\nYou can switch off notifications anytime using browser settings.",

Can you help me in skipping the never text and actually scraping the data for the given link.

" <div id="pushSec" class="pushSec"><div class="pullLeft"><span class="et-icon"></span></div><div class="pullRight"><p><b>Never miss a great news story!</b><br>Get instant notifications from Economic Times<br><a class="gcmwinProm" onclick="ga('send','event','Chrome_not-popup','click','enable')" href="https://etapps.indiatimes.com/gcm_webnotification.cms">Allow</a><a onclick="ga('send','event','Chrome_not-popup','click','disable');" class="gcmNothx" href="javascript:void(0)">Not now</a></p><br><span>You can switch off notifications anytime using browser settings.</span></div></div>"

Never miss a great news story!
Get instant notifications from Economic Times
AllowNot now

You can switch off notifications anytime using browser settings.

this is the html of the popup how can i automatically skip and move to the main data.