gallery-dl icon indicating copy to clipboard operation
gallery-dl copied to clipboard

[Poipiku] Cannot download "Twitter follower", "Twitter mutual" and "Warning" labeled posts

Open oxi7589 opened this issue 1 year ago • 3 comments

Posts classified as only available to Twitter followers, Twitter mutuals, and the ones which have a warning label on them are not properly downloaded by gallery-dl.

Test case 1

What I've tried

  gallery-dl --cookies cookies-poipiku-com.txt https://poipiku.com/2010722/6416103.html

(cookies are sufficient to view the post; to test use a poipiku acc tied to a twitter acc following this person)

Expected behavior: two image attachments downloaded. Actual behavior: a single image, and a rather useless one: 6416103_1

Test case 2

What I've tried

  gallery-dl --cookies cookies-poipiku-com.txt https://poipiku.com/2010722/6591104.html

(cookies are not strictly necessary to view the post)

Expected behavior: a single image attachment downloaded. Actual behavior: a single image, but a rather useless one: 6591104_1

The example posts are NSFW. I was not able to find a Mutuals-only example, but they do exist and I've seen them around before.

oxi7589 avatar Jul 30 '22 18:07 oxi7589

Expected behavior: two image attachments downloaded. Actual behavior: a single image, and a rather useless one:

To add to this, this happens even with posts that aren't behind any locks, it always only downloads one image.

turnitoff92 avatar Aug 01 '22 10:08 turnitoff92

The issue from https://github.com/mikf/gallery-dl/issues/2796#issuecomment-1201001546 as well as gallery-dl downloading warning pictures is fixed in commits https://github.com/mikf/gallery-dl/commit/b9a14b5758d5283293e90fde39b7fcce6b071693 and https://github.com/mikf/gallery-dl/commit/033faf67ec8cecf3566fc5f7907036f69efe174f.

Maybe those also fixed the problem with follower-only posts, but I haven't tested that yet.

mikf avatar Aug 03 '22 12:08 mikf

I can confirm that follower-exclusive posts are downloaded properly in the latest dev version.

I still don't have a good mutuals-only example, but they are very likely to work fine as well.

oxi7589 avatar Aug 03 '22 23:08 oxi7589

It's not working for me but I may be doing something wrong...

Edit: I am seeing the additional follower content being added in the IllustItemThubExpand div.

biggestsonicfan avatar Sep 10 '22 13:09 biggestsonicfan

This probably deserves its own issue, but I will point it out here at first. While follower-locked content is downloaded properly, some of the pics (regardless of whether those are follower-locked or not) fail to download with a 404 error due to gallery-dl trying to access originals via the https://img.poipiku.com/ domain (the site itself uses https://img-org.poipiku.com/), and while that works for most pics, some newer ones are only accessible via the img-org.

oxi7589 avatar Sep 11 '22 14:09 oxi7589

It's not working for me but I may be doing something wrong...

What is not working? Downloading follower-exclusive posts? You need to use browser cookies for this, I would think, and according to https://github.com/mikf/gallery-dl/issues/2796#issuecomment-1204586886 it does work.

some of the pics … fail to download with a 404 error due to gallery-dl trying to access originals via the https://img.poipiku.com/

It now uses img-org.poipiku.com for all downloads (https://github.com/mikf/gallery-dl/commit/673b6f1218b7c0da7e9afa060c189ee9adb80dd7). img-org URLs require a valid Referer header to download, by the way.

I've also found a post that throws a 404 error regardless of domain and is also not viewable in browser. Only its preview version is available. https://poipiku.com/25049/7394673.html

mikf avatar Sep 14 '22 15:09 mikf