gallery-dl icon indicating copy to clipboard operation
gallery-dl copied to clipboard

[Request] skeb.jp

Open indrakaw opened this issue 3 years ago • 4 comments

indrakaw avatar Sep 25 '20 16:09 indrakaw

I realize for the most part skeb.jp is supported, but last night I ran into a user that has a portfolio but no works and I could not download from the portfolio. They have since (between last night and now) added one work. https://skeb.jp/@hataraku73

EDIT: Also for your consideration Google seems to crawl non-watermarked images somehow...

biggestsonicfan avatar Apr 04 '22 01:04 biggestsonicfan

EDIT: Also for your consideration Google seems to crawl non-watermarked images somehow...

That's interesting @mikf You can compare this two URLs: From google: link From skeb page: link

Basically, the one from google have different http parameters, but if you try to modify them by yourself you will get 403 error, so it doesn't seem to help much. The response to the modified parameters seems to be tied to the s= parameter (md5?), which is somehow generated for those set of parameters. I don't know but what if the algorithm for it is in the page script lol?

Anyway, the sample-less link from google is actually in the page's source code, so there's no some special privileges for google. I guess it might be considered as an option to download, however there's 2 issues:

  1. The sample-less image has smaller resolution.
  2. The sample-less image does not always exists in the page's source.

nisehime avatar Jun 23 '22 22:06 nisehime

seems to be tied to the s= parameter (md5?)

The hex-digest length fits, but they are most likely applying some not easy to guess transformation to URL or query string before MD5-ing it.

  1. The sample-less image has smaller resolution.
  2. The sample-less image does not always exists in the page's source.

and 3. the sample-less images got generated with a terrible JPEG compression value: &q=45

mikf avatar Jul 08 '22 13:07 mikf

  1. the sample-less images got generated with a terrible JPEG compression value: &q=45

I wouldn't really call it terrible tbh. Some people still might prefer it over the text covering half of the image.

nisehime avatar Jul 08 '22 18:07 nisehime

EDIT: Also for your consideration Google seems to crawl non-watermarked images somehow...

That's interesting @mikf You can compare this two URLs: From google: link From skeb page: link

Basically, the one from google have different http parameters, but if you try to modify them by yourself you will get 403 error, so it doesn't seem to help much. The response to the modified parameters seems to be tied to the s= parameter (md5?), which is somehow generated for those set of parameters. I don't know but what if the algorithm for it is in the page script lol?

Anyway, the sample-less link from google is actually in the page's source code, so there's no some special privileges for google. I guess it might be considered as an option to download, however there's 2 issues:

  1. The sample-less image has smaller resolution.
  2. The sample-less image does not always exists in the page's source.

How did you get the sample-less url from google?

NeroTheYoung avatar Dec 04 '22 18:12 NeroTheYoung

@NeroTheYoung I reverse image searched the image on Google, but the Google url doesn't appear to be valid anymore.

biggestsonicfan avatar Dec 04 '22 19:12 biggestsonicfan

Just an FYI: https://twitter.com/skeb_jp/status/1606106596764852225

🚨Attention🚨 Using extensions that scrape or increase access to Skeb is a violation of our terms and policies.

biggestsonicfan avatar Dec 23 '22 03:12 biggestsonicfan

Just an FYI: https://twitter.com/skeb_jp/status/1606106596764852225

🚨Attention🚨 Using extensions that scrape or increase access to Skeb is a violation of our terms and policies.

What else is new ? I mean, you must expect scrapers/downloaders not being allowed, so this is nothing unexpected nor new.

rautamiekka avatar Dec 23 '22 16:12 rautamiekka

I understand, but this is the first official statement I've seen of it.

biggestsonicfan avatar Dec 23 '22 23:12 biggestsonicfan