meteor-scrape icon indicating copy to clipboard operation
meteor-scrape copied to clipboard

"url" field broken in edgecases

Open Anonyfox opened this issue 10 years ago • 0 comments

when scraping the website http://www.bostonherald.com, the "http:" part gets stripped out. The site has

<link rel="canonical" href="//www.bostonherald.com/" /> in it's HTML, so the "//" symbol must be resolved to "http" by default.

Anonyfox avatar May 02 '15 10:05 Anonyfox