ripme icon indicating copy to clipboard operation
ripme copied to clipboard

Error: Read Timed Out when trying to download large imgur album

Open 9yorgos opened this issue 8 years ago • 14 comments

just installed ripme a couple minutes to download a big imgur album and its not working. If anyone can help me out that would be awesome!

9yorgos avatar Feb 08 '17 22:02 9yorgos

Can you post the link to the album?

cyian-1756 avatar Feb 08 '17 23:02 cyian-1756

http://imgur.com/a/7zL7T

9yorgos avatar Feb 08 '17 23:02 9yorgos

Imgur seems to be down right now

cyian-1756 avatar Feb 09 '17 01:02 cyian-1756

really? im viewing the album as im typing this.

9yorgos avatar Feb 09 '17 01:02 9yorgos

@9yorgos Trying to view the album just gives me a "Imgur is over capacity!" error, so at least on my end imgur is down.

cyian-1756 avatar Feb 09 '17 07:02 cyian-1756

Try http://isup.me to find out what a site looks like from another server.

metaprime avatar Feb 09 '17 10:02 metaprime

Imgur does seem to have problems with albums that are approx 1000 images and larger. How large is this album? You end up getting an over capacity page for albums that large, even when navigating manually, if you've had a fair amount of imgur traffic already. Not sure what their algorithm is for this. Ripme gets best results if imgur albums are not larger than a few hundred images.

metaprime avatar Feb 09 '17 10:02 metaprime

yea its 1100 images. So theres no way to save it? Thats unfortunate.

9yorgos avatar Feb 09 '17 22:02 9yorgos

Seems to be a problem on imgur's end, so at the moment, it seems it's not possible. Nothing we can do on ripme's side. Is it possible to log in to imgur and view it? We might need to use some sort of log in via ripme mechanism to enable ripping giant albums.

metaprime avatar Feb 10 '17 03:02 metaprime

yea i can log in and view the album

9yorgos avatar Feb 10 '17 03:02 9yorgos

You could get the list of URLs while logged in by using imgur's rest API endpoint for album metadata, and then use ripme's new feature: Rip a list of URLs from a file from the command line with the -f flag. (#344 by @JoshKastang)

Unfortunately, Ripme still lacks the ability to rip single images, but that's coming soon.

metaprime avatar Feb 10 '17 08:02 metaprime

Also apparently the Imgur API has changed. Now requires OAuth 2. I haven't gone through the process of setting it up but here are some resources: https://api.imgur.com/ https://api.imgur.com/oauth2 https://api.imgur.com/endpoints/album

So you might be looking into making a request for this: https://api.imgur.com/3/album/7zL7T/images

But you'll need to set up authentication or you'll get a 401.

metaprime avatar Feb 10 '17 09:02 metaprime

im confused haha. so what should i do if i want to rip the entire album? what steps should i take.

9yorgos avatar Feb 11 '17 00:02 9yorgos

Use the API to get the file list, put all the files into a text file (one file per line, no extra characters), and run ripme from the command line like java -jar ripme.jar -f file.txt.

metaprime avatar Feb 18 '17 20:02 metaprime