parser
parser copied to clipboard
How to handle 'you agree to allow cookies to be placed'?
for such url: https://www.newser.com/story/314158/cruise-ship-with-infected-passengers-docks-in-new-orleans.html
with
- mac os x:
- latest merury-parser:
Detailed Description
./node_modules/.bin/mercury-parser https://www.newser.com/story/314158/cruise-ship-with-infected-passengers-docks-in-new-orleans.html --header.User-Agent="Mozilla/5.0 (iPhone; CPU iPhone OS 10_3_1 like Mac OS X) AppleWebKit/603.1.30 (KHTML, like Gecko) Version/10.0 Mobile/14E304 Safari/602.1"
{
"title": "Cruise Ship With Infected Passengers Docks in New Orleans",
"author": null,
"date_published": "2021-12-06T12:33:28.000Z",
"dek": null,
"lead_image_url": "https://img1-azrcdn.newser.com/image/1388120-12-20211206010328.jpeg",
"content": "<div id=\"divCMText\"> <div id=\"divCMText1\"> We use cookies. By Clicking "OK" or any content on this site, you agree to allow cookies to be placed. Read more in our <a href=\"/privacy.aspx#cookies\">privacy policy</a>. </div> </div>",
"next_page_url": null,
"url": "https://www.newser.com/story/314158/cruise-ship-with-infected-passengers-docks-in-new-orleans.html",
"domain": "www.newser.com",
"excerpt": "At least 17 people on board tested positive for COVID",
"word_count": 26,
"direction": "ltr",
"total_pages": 1,
"rendered_pages": 1
}
For compare you can find https://ndaidong.github.io/article-parser-demo/ with https://www.newser.com/story/314158/cruise-ship-with-infected-passengers-docks-in-new-orleans.html is ok.
I don't find special code for www.newser.com
in its source code.
So it should be a general problem instead the special site problem?