Amazon-downloader
Amazon-downloader copied to clipboard
Not downloading reviews (end code:500)
Command and response:
perl downloadAmazonReviews.pl com B01KQIWHOW
http://www.amazon.com/product-reviews/B01KQIWHOW/?ie=UTF8&showViewpoints=0&pageNumber=1&sortBy=bySubmissionDateDescending Downloaded 0 pages for product id B01KQIWHOW (end code:500)
Thoughts?
Thank you.
I suppose this is due to the redirection of HTTP -> HTTPS. On Ubuntu 14.04 I had to:
-
Install libssl-dev
sudo apt-get update && sudo apt-get install libssl-dev
-
Provide an SSL Interface for LWP, thus I Installed the Crypt::SSLeay module:
sudo cpan Crypt::SSLeay
-
Finally, edit the following line in downloadAmazonReviews.pl (Line 47):
my $urlPart1 = "http://www.amazon.".$domain."/product-reviews/";
tomy $urlPart1 = "https://www.amazon.".$domain."/product-reviews/";
Changing
my $urlPart1 = "http://www.amazon.".$domain."/product-reviews/"; to my $urlPart1 = "https://www.amazon.".$domain."/product-reviews/";
works, thanks comppaz !
Unfortunately the code neither creates a new folder nor downloads the html files... Any ideas? I'm trying to download reviews of a product on amazon.co.uk
Thanks
Maybe you can try an Amazon downloader