gallery-dl icon indicating copy to clipboard operation
gallery-dl copied to clipboard

[cyberdrop] Unable to download some of images that is there.

Open dajotim937 opened this issue 2 years ago • 7 comments

So, https://cyberdrop.me/a/Dc9WF6m2 this gallery. First two images have urls: https://fs-05.cyberdrop.to/3840x2880_f990a4fc449c771c7613a5febfc9d3a9-eb0KV4SA.jpg and https://fs-03.cyberdrop.to/3840x2880_f53f573ef0ea46ee57b5d91a4e6af011-SVwRTqj7.jpg First one doesn't load and other is okay. BUT. If you change first url from fs-05.cyberdrop.to to fs-03.cyberdrop.to it will open too.

Also both of them fallback to img-01.cyberdrop.to domain. Need more test, but I checked like 30 images from that gallery, all of them fallback to img-01.cyberdrop.to domain, and those that doesn't (fs-05.cyberdrop.to domain) fallback to when I change 05 to 03.

Also for 1st image (and for other images) https://cyberdrop.to/3840x2880_f990a4fc449c771c7613a5febfc9d3a9-eb0KV4SA.jpg https://cyberdrop.me/3840x2880_f990a4fc449c771c7613a5febfc9d3a9-eb0KV4SA.jpg works too.

Also, when you change gallery mode, images urls are on i1.wp.com/img-01.cyberdrop.to/ domain. https://i1.wp.com/img-01.cyberdrop.to/3840x2880_f990a4fc449c771c7613a5febfc9d3a9-eb0KV4SA.jpg

dajotim937 avatar Jun 10 '22 20:06 dajotim937

The problem seems to be on the website's end. I guess you could make it so that it uses the img-01.cyberdrop.to domain? but there's no guarantee that it'll always work. Nothing really can be done imo.

foderking avatar Jun 11 '22 23:06 foderking

The problem seems to be on the website's end.

Well, yes. That's why I also sent email to them.

but there's no guarantee that it'll always work..

Like there is no guarantee that site will work tomorrow also.

Nothing really can be done imo.

Yeah, you are right. Just 4 fallback domains where you can get image. Can't be done anything.

dajotim937 avatar Jun 12 '22 20:06 dajotim937

Nothing really can be done imo.

Well, I've added fallback URLs (https://github.com/mikf/gallery-dl/commit/78d83345d3957309d3be58268a48a077e3b78052), so if https://fs-05.cyberdrop.to etc doesn't work, it tries to download from https://cyberdrop.to.

mikf avatar Jun 20 '22 10:06 mikf

I checked and downloaded 2 albums. Looks like it works fine. I guess you can close, if you don't plan to add img-01.cyberdrop.to fallback domain. Or at least mark issue as partially-done.

Also, about i1.wp.com/img-01.cyberdrop.to/. If you plan to add it too, put it as last one because I downloaded some images manually with firefox and powershell. And for some reason browser downloads lossy-webp image, poweshell downloads jpg, but slightly smaller filesize than original from other domains.

dajotim937 avatar Jun 20 '22 11:06 dajotim937

And for some reason browser downloads lossy-webp image, poweshell downloads jpg, but slightly smaller filesize than original from other domains.

Well, this is not surprising. Servers usually check for the UA and change their response accordingly. Depends on which method you were using to download with PS, because there are many, actually. Simply iwr <URL>? Because this has a -UserAgent parameter, which you can set to the UA string of your browser, for example, maybe this is already enough to change the response to what you've described here.

Hrxn avatar Jun 20 '22 13:06 Hrxn

Well, this is not surprising.

It is for me because I don't load page where loaded images, I loaded image by it's direct link with .jpg extension at the end of link. Didn't met other cases where I would download file with different extension by it direct link. And also, i1.wp.com/img-01.cyberdrop.to/ the only domain that gives webp image when I download via browser. Other ones give same jpg image.

Servers usually check for the UA and change their response accordingly.

Fair enough, I guess, you are right. I used just URL without any other params. Well, in the worst case it's just more info for gallery-dl dev(s).

dajotim937 avatar Jun 20 '22 13:06 dajotim937

Got email from site after report about fs-05.

Sorry for the late response. fs-02-06 are their own servers that serve what they have stored locally or redirect to fs-01 for anything that it doesnt have (and images go to img-01 to use cloudflares caching.). fs-05 is scuffed and shits itself alot which requires a manual reset.

fs-01 just proxies data from the main file sever. Direct from cyberdrop.to/me is pretty much the same, it comes direct from the master server so loading from it doesnt 404. Speeds from the main site urls depends too since those servers were chosen to ensure they wont get removed from reports instead of being chosen for their speeds.

Ive been too busy this year and havent kept an eye on the site that much. For the most part the site just works. I disabled new registration a while ago because the site got way too big for my liking.

dajotim937 avatar Jul 03 '22 16:07 dajotim937