snacktory icon indicating copy to clipboard operation
snacktory copied to clipboard

Not able to extract content

Open saketmalpure opened this issue 7 years ago • 1 comments

Not able to extract content from the some websites like quora.com and possibly some others. It is returning 403, for HEAD request method at this line in HtmlFetcher class.

saketmalpure avatar Jun 29 '17 15:06 saketmalpure

Quora returns 403 for a HEAD request, if you call fetchAndExtract but set resolve to false it will work. I can add a pull request for this, adding an option where if the HEAD request fails it falls back on a GET request.

bark4mark avatar Sep 15 '17 16:09 bark4mark