ripme icon indicating copy to clipboard operation
ripme copied to clipboard

Request sites to support here

Open 4pr0n opened this issue 11 years ago • 192 comments

PLEASE include an example URL of the type of album to rip.


Supported sites + commits:

  • imgur (album, userpages, subreddits) - https://github.com/4pr0n/ripme/commit/04ce12b546fe775101cc880cb072c3c284014626 https://github.com/4pr0n/ripme/commit/e904a7ee9798cd77515d9edf1768f05817a8ad13
  • instagram - https://github.com/4pr0n/ripme/commit/e2bb412d9f0e542abd8b28b8f723cd260685faab
  • deviantart - https://github.com/4pr0n/ripme/commit/b662b46a44a087af316953b10aee537397f2fa2a
  • "gonewild" - https://github.com/4pr0n/ripme/commit/c48ebff21db9c37f2f22a2ea32abf9242bbf7db5
  • twitter - https://github.com/4pr0n/ripme/commit/4a47cc650e22d865c87cd4eee04f56724d94c126
  • motherless - https://github.com/4pr0n/ripme/commit/1cdec765cc4032219056518d138985b04a2eb0db
  • reddit - https://github.com/4pr0n/ripme/commit/c8cfc57e5bce399befa51de5a0e508065c1c4bf7
  • tumblr - https://github.com/4pr0n/ripme/commit/c288afdd0ada892bc780967ae1b5f7de974e2365
  • 4chan and other *chans - Supported in https://github.com/4pr0n/ripme/commit/cfb99e0cbb4f21445c32b118fc4b5939aed21469
  • vk.com (images, albums, video, and video albums) https://github.com/4pr0n/ripme/commit/d51ad485f65416acdd5bd69a84a386fc46ca550e https://github.com/4pr0n/ripme/commit/e5906db588b4650288a7b548c03fd095f887c1d0
  • kinkyshare.com - Supported in https://github.com/4pr0n/ripme/commit/8db6e2a11b70e9b00ef0d3afe4f251fa1d7a3f8b
  • i.rarchives.com - https://github.com/4pr0n/ripme/commit/20b39743fead6786d531994640e66f44dc45a657
  • butttoucher.com - https://github.com/4pr0n/ripme/commit/0e04590e462fe538fce4f379f0aa572f280d6fb3
  • teenplanet - https://github.com/4pr0n/ripme/commit/acc7f87ad5d02f1754f1c14ccf9c531936e53327
  • xhamster (images) - https://github.com/4pr0n/ripme/commit/597a7b3903b7c7cd99f2c826a0c8151c347a8816
  • 8muses - https://github.com/4pr0n/ripme/commit/14afa9695ceee43cb255055b1bd7f935a7833dcb
  • seenive - https://github.com/4pr0n/ripme/commit/3deddf3af66abd5cb099457ef0aef36c4d254bca
  • vinebox - https://github.com/4pr0n/ripme/commit/8bfae563d273cf42a7608a3d56c5f730ce4a6034
  • photobucket - https://github.com/4pr0n/ripme/commit/2875ee8d41904ddd7e93dd062b7912cb30b6ad35
  • flickr - https://github.com/4pr0n/ripme/commit/bf100f2a321779d9e743d3c198880bc348e318ec
  • minus - https://github.com/4pr0n/ripme/commit/55aef94e860dbf6ffb1a66a79e050d8b464d1202
  • anonib - https://github.com/4pr0n/ripme/commit/0ff9fa667b6d048ad99aa3216a6a1269e12a7231
  • fapproved - https://github.com/4pr0n/ripme/commit/b5e10c01491a823b54a8f206119c860e35f4a99d
  • gifyo - https://github.com/4pr0n/ripme/commit/39bca3bb16c99a390409fb2f7c5ceb9f3671fc4d
  • vine - https://github.com/4pr0n/ripme/commit/a0356c8e9b7cab6dd486de656256fde155478050
  • supertangas - https://github.com/4pr0n/ripme/commit/81bbcaba2c6227a7b7fb0553271044c52bbf09e1
  • drawcrowd - https://github.com/4pr0n/ripme/commit/339aa8935d0fed577a92ff4673dbb86af2e5b1ca
  • modelmayhem - https://github.com/4pr0n/ripme/commit/863f722f9ca4a483dd987d03dbf10387709bbc5e
  • smutty.com - https://github.com/4pr0n/ripme/commit/e9bee91aba119d2a5fffe50f02ace9dab3d8e6dc
  • imagestash.org - https://github.com/4pr0n/ripme/commit/0073de17ea1e0462aa22b2650e1d88373c61d089
  • imgbox.com - https://github.com/4pr0n/ripme/commit/13d13b28b77690fc1b7fd3a670c4c1bd02ca712c
  • mediacru.sh - https://github.com/4pr0n/ripme/commit/574b03e45ed5b449b81aa4711d2bd53e6a17fa64
  • nfsfw - https://github.com/4pr0n/ripme/commit/5d319355d37a8e4f130933c38697f60a60770a96
  • imagebam - https://github.com/4pr0n/ripme/commit/c6957331e7029d85ea4be98f54ae74d209324f48
  • pornhub - https://github.com/4pr0n/ripme/commit/6d55e2c35cb4f6fd156f6fbdd08b5c2d0b3b7f9f
  • imagevenue - https://github.com/4pr0n/ripme/commit/838ad2a585f297934bf74e2084dc4f6eb5c7d340
  • hentai-foundry - https://github.com/4pr0n/ripme/commit/ca4ed62971035a358803bce9f918d86841054417
  • fuskator - https://github.com/4pr0n/ripme/commit/53df6caf0a440d8e225672473dc607facd8911b3
  • datw.in - https://github.com/4pr0n/ripme/commit/5afbc1ce3ac5b77cce6c7ff77c0172f23341ef77
  • furaffinity - https://github.com/4pr0n/ripme/commit/9e40e55ee90efa5371199ba8fdd797f695284472
  • 500px - https://github.com/4pr0n/ripme/commit/baab27d6af489e19baaa3fe412db5c03597ddf68
  • taptastic - https://github.com/4pr0n/ripme/commit/a95bfa79286f0aee61fdca088c6c113cfb01ddba
  • cheeby - https://github.com/4pr0n/ripme/commit/562f224c2136391f1e9ecb044aaa84cdca8a04e7
  • bcfakes - https://github.com/4pr0n/ripme/commit/aa296ef72ee76f58dbe3160e29856ba568a4a274

Pending sites + examples (NSFW):

  • getgonewild - http://www.getgonewild.com/profile/rollmeup
  • blogspot - http://marcherryfashion.blogspot.com/
  • pixiv - http://www.pixiv.net/member.php?id=2136123
  • facebook - https://www.facebook.com/EmanueleFerrariPhotographer/photos_stream
  • pinterest - http://www.pinterest.com/
  • lookbook - http://lookbook.nu/mayowo
  • 4shared - http://www.4shared.com/folder/pTUpT6wG/Heather.html
  • behance - https://www.behance.net/HS-nj
  • dribbble - https://dribbble.com/studioMUTI
  • fetlife - https://fetlife.com/users/2089769
  • diverxity - http://www.diverxity.com/users/953
  • artician - http://zionenciel.artician.com/
  • studio-g - http://studio-g.tistory.com/535
  • fg-site - http://www.fg-site.net/members/umeume/
  • gelbooru - http://gelbooru.com/index.php?page=post&s=list&tags=futa
  • thefappening.sexy - http://thefappening.sexy/albums/index.php?/category/126
  • ipernity - http://www.ipernity.com/doc/kimcums/album/676241
  • punterplanet - http://guide.punterplanet.com/escorts/featured/frontpage/amber-green_200.html
  • rule34 - rule34.paheal.net
  • photoblog.pl - http://www.photoblog.pl/colordust/170020651/typical-girl.html
  • megamodels.pl - http://www.megamodels.pl/a-ya
  • maxmodels.pl - http://www.maxmodels.pl/modelka-agnes-z-garbledville.html
  • flog.pl - http://www.flog.pl/szukaj/akt

Enhancement requests:

  • flickr - login support (see #32)
  • vk - Video ripper rename files
  • twitter - Search ripping
  • gifyo - Don't skip some images
  • *chan rippers - Handle external links (vocaroo), store comments
  • tumblr - Rip by date (/archive/year/month)

4pr0n avatar Apr 05 '14 06:04 4pr0n

wakaba threads on imageboards (such as 4chan or more examples here http://allchans.org/)

Random example: http://desuchan.net/v/res/7034.html Can probably be done by retrieving all that point to an image file extension. Or constricted to /src/ folder.

With that in mind, maybe this method can be expanded to allow the ripping of 'generic' web album pages, the ones that link directly to the files.

CaspianRoach avatar Apr 12 '14 13:04 CaspianRoach

I'll look into supporting generic *chan* sites.

maybe this method can be expanded to allow the ripping of 'generic' web album pages, the ones that link directly to the files.

For that, there's already DownThemAll, the Firefox add-on which works really well.

4pr0n avatar Apr 12 '14 17:04 4pr0n

maybe this method can be expanded to allow the ripping of 'generic' web album pages, the ones that link directly to the files.

I've had an idea for a ripper that can scrape anything, like random message boards that link to imagebam.com galleries or imgur albums. It would default to just try to scrape the page if the host isn't strictly supported. It would require refactoring the existing rippers, and adding a ton of one-off single-image hosts (imagetwist etc) which would be painful, but it's possible.

4pr0n avatar Apr 13 '14 00:04 4pr0n

Not sure if it's worth your time, but there's this site: http://kinkyshare.com and I just can't leave it because I'm constantly opening new images from the bottom side :)

anyway, they sometimes have galleries like this http://kinkyshare.com/c/1857/blonde_and_brunette_margo_et_lilas_-amiti_et_complicit and this http://kinkyshare.com/c/1384/gia_felino-_barbie_latex_catsuit

If it's not too much trouble a ripper for albums or even tag pages here would be nice.

CaspianRoach avatar Apr 16 '14 16:04 CaspianRoach

Pornhub seems to have a decent number of albums, too. http://www.pornhub.com/albums It feels like a popular enough site to bother with a ripper for it.

CaspianRoach avatar Apr 16 '14 16:04 CaspianRoach

Request for support for: Butttoucher.com getgonewild.com i.rarchives.com user pages and teenplanet.org Thank you for making this ripper!

domonic46 avatar Apr 20 '14 18:04 domonic46

Request for support for: Butttoucher.com getgonewild.com i.rarchives.com user pages

Instead of waiting for these rippers to be implemented, try ripping http://gonewild.com/user/username (replace username with the user's name). It's more exhaustive than the above sites but doesn't always have the user.

4pr0n avatar Apr 20 '14 20:04 4pr0n

Is Photobucket on the list?

slipl avatar Apr 21 '14 03:04 slipl

Is Photobucket on the list?

It is now. Stay (patiently) tuned

4pr0n avatar Apr 21 '14 03:04 4pr0n

3 commits above are in latest version & ripme should be updateable to this version.

@domonic46: getgonewild doesn't appear to work -- I can't find any "profiles" that contain imgur links. Hence the bolded text in OP:

Requests must include an example URL

4pr0n avatar Apr 21 '14 07:04 4pr0n

Flickr support would be very nice too, thanks!

slipl avatar Apr 22 '14 01:04 slipl

Request for support for: flickr.com | For example, the photo on this page is not available download option. https://www.flickr.com/photos/beargills/

artician.com pixiv.net

Thank you for making this ripper!

Jar4ek avatar Apr 22 '14 16:04 Jar4ek

Possible to add a video ripper for something like this http://vk.com/videos213696261

crimble avatar Apr 24 '14 01:04 crimble

Haven't fully tested the VK video album ripper (hard to with a sample album of 2,000+ videos). It starts downloading them, so I guess it works.

4pr0n avatar Apr 24 '14 06:04 4pr0n

Recently I asked for support for Flickr page and it works very good, but there is a problem. Namely, the pictures were downloaded link only partially.

Link: https://www.flickr.com/photos/beargills/ to 1,470 images downloaded only 100 photos. I'd asked for a solution to this problem.

Next Link : www.flickr.com/photos/gestiefeltekatze to 1,290 images downloaded only 100 photos. I'd asked for a solution to this problem.

I also failed to download photos from this site:

https://www.flickr.com/photos/bubuyalove/

I also would ask for support downloading photos from the 500px.com

If there is such a possibility, please let me know the solution to this problem.

Best Regards Jarek.

Jar4ek avatar Apr 24 '14 16:04 Jar4ek

The VK video ripper is working great so far but before I attempt all 2,000+ videos, are there any original file names available to replace the current output?

What I'm getting now: 001_f4fc9d1705.720.mp4 002_dc3bda4117.720.mp4 003_9bc4105e2d.720.mp4

crimble avatar Apr 25 '14 00:04 crimble

Looks like Flickr changed the login scheme to use javascript to set cookies that are required for logging in. The scheme is too complex for me to bother with. This means the Flickr ripper can't rip NSFW images.

I left the code to login (which used to work a few months ago) in case someone else wants to pick it up.

4pr0n avatar Apr 25 '14 03:04 4pr0n

Request for support for MINUS http://exogallery.minus.com/mYzoL2DVlmXMJ

ghost avatar Apr 25 '14 04:04 ghost

is it possible to rip partially tumblr archives, e.g. http://***.tumblr.com/archive/2014/4 ?

erofanboy avatar Apr 25 '14 14:04 erofanboy

twitter hashtags and keyword media search results

https://twitter.com/search?q=cosplay&src=typd&mode=photos

jadedgnome avatar Apr 26 '14 15:04 jadedgnome

Anon-ib.com with a log of text if possible Example: http://anon-ib.com/red/res/205.html

slipl avatar May 02 '14 21:05 slipl

Request support for fapproved.com Example: http://fapproved.com/users/swimer210/images -or- http://fapproved.com/users/missballerina/images

The program has come a long way. Thanks for all your hard work in making it better. Take care.

Fonziesthumbs avatar May 03 '14 06:05 Fonziesthumbs

Example for Getgonewild: http://www.getgonewild.com/profile/rollmeup I double checked for imgur links with the ripper http://176.31.245.135/rips/#getgonewild_rollmeup btw statigr.am is now iconosquare.com

domonic46 avatar May 03 '14 19:05 domonic46

Gifyo.com Example URL: http://gifyo.com/kittiekaulitz48/

domonic46 avatar May 05 '14 00:05 domonic46

pixiv:

  1. http://www.pixiv.net/member.php?id=2136123 HentaiFoundry:
  2. http://www.hentai-foundry.com/pictures/user/LiquidShadow
  3. http://www.hentai-foundry.com/pictures/user/LiquidShadow/scraps Facebook:
  4. https://www.facebook.com/EmanueleFerrariPhotographer/photos_stream
  5. https://www.facebook.com/EmanueleFerrariPhotographer/photos_albums Supertangas:
  6. http://www.supertangas.com/fotos/?level=search&exact=1&searchterms=Vikis%20%28Argentina%29 datwin
  7. http://datw.in/gorgeous-brunette-on-vacation/

ghost avatar May 05 '14 00:05 ghost

Vine.co Example: https://vine.co/u/921539294726860800

domonic46 avatar May 05 '14 21:05 domonic46

EHentai Galleries added in f9e8dd33060167a10c572495dc9d0ec8886d06ad

metaprime avatar May 12 '14 05:05 metaprime

http://drawcrowd.com http://drawcrowd.com/rabbiteyes

&

http://www.pinterest.com/

singhs-apps avatar May 15 '14 02:05 singhs-apps

Model Mayhem: http://www.modelmayhem.com/759568

tim712 avatar May 16 '14 14:05 tim712

Modelmayhem mostly works but can't get images that require being logged in (unless someone can provide a verified account).

4pr0n avatar May 17 '14 15:05 4pr0n