kemono-dl icon indicating copy to clipboard operation
kemono-dl copied to clipboard

Yesterday it work normal,but suddenly broken

Open qiuqiumaomao opened this issue 1 year ago • 14 comments

Version

Version:kemono-dl-2022.04.27

Your Command

`` python kemono-dl.py --cookies "cookies.txt" --link https://kemono.party/patreon/user/28464855




### Error messages and tracebacks
<!-- Please include any error messages or tacebacks. -->
```<!-- A description of the bug. -->
ERROR:Unable to get list of creators from kemono.party
Traceback (most recent call last):
  File "C:\Users\瑞雪千骐\AppData\Local\Programs\Python\Python310\lib\site-packages\requests\models.py", line 910, in json
    return complexjson.loads(self.text, **kwargs)
  File "C:\Users\瑞雪千骐\AppData\Local\Programs\Python\Python310\lib\json\__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "C:\Users\瑞雪千骐\AppData\Local\Programs\Python\Python310\lib\json\decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "C:\Users\瑞雪千骐\AppData\Local\Programs\Python\Python310\lib\json\decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "G:\kemono-dl\src\main.py", line 669, in start_download
    self.creators += self.get_creators(domain)
    return self.session.get(url=creators_api, cookies=self.cookies, headers=self.headers, timeout=self.timeout).json()
  File "C:\Users\瑞雪千骐\AppData\Local\Programs\Python\Python310\lib\site-packages\requests\models.py", line 917, in json
requests.exceptions.JSONDecodeError: [Errno Expecting value] <!doctype html>

Description of bug

a few days ago,When i normally try to download something this happened,it works well just yesterday,I asked GPT and it said that the server ruturn a 404,I try to get the new cookies but it also didn't work.

How To Reproduce

1.Copy link from the site

2.Use command i always used

Additional comments

Appreciate your work,I don't know why some text didn't view,so i copy them here.by the way it is not work on kemono.su.I'll be appreciated if you fix it :D

qiuqiumaomao avatar Oct 23 '23 10:10 qiuqiumaomao

It's cause of kemono update its api base url. So you will get all 404 not found when using the api.

I have forked a version and tried to fixed it. But it's not perfect now. And the api now limit with max 50 posts to get. Maybe you can try it. https://github.com/billy0402/kemono-dl

billy0402 avatar Oct 24 '23 04:10 billy0402

I also made an update here: https://github.com/ILogOutOnTheToilet/kemono-dl/tree/update-api My branch doesn't support the old ".party" top-level domain, so you need to use the new ".su" top-level domain for the URL.

ILogOutOnTheToilet avatar Oct 25 '23 06:10 ILogOutOnTheToilet

I also made an update here: https://github.com/ILogOutOnTheToilet/kemono-dl/tree/update-api My branch doesn't support the old ".party" top-level domain, so you need to use the new ".su" top-level domain for the URL.

I tried your script, but when I try to download a post, it will automatically download all the author's posts.

gugulumasiro avatar Oct 25 '23 08:10 gugulumasiro

I also made an update here: https://github.com/ILogOutOnTheToilet/kemono-dl/tree/update-api My branch doesn't support the old ".party" top-level domain, so you need to use the new ".su" top-level domain for the URL.

I tried your script, but when I try to download a post, it will automatically download all the author's posts.

What command did you use? It worked fine for me when I tried using --dateafter and --datebefore, but I didn't test every case since there are no tests to begin with.

ILogOutOnTheToilet avatar Oct 25 '23 09:10 ILogOutOnTheToilet

I also made an update here: https://github.com/ILogOutOnTheToilet/kemono-dl/tree/update-api My branch doesn't support the old ".party" top-level domain, so you need to use the new ".su" top-level domain for the URL.

I tried your script, but when I try to download a post, it will automatically download all the author's posts.

What command did you use? It worked fine for me when I tried using --dateafter and --datebefore, but I didn't test every case since there are no tests to begin with.

In the use of the previous script, I did not use -- date after and -- date before, but it can still download specific posts by using post_id. It seems that after modification, only the user ID can be recognized, regardless of whether you have added a post_id after the link or not.

gugulumasiro avatar Oct 25 '23 09:10 gugulumasiro

I also made an update here: https://github.com/ILogOutOnTheToilet/kemono-dl/tree/update-api My branch doesn't support the old ".party" top-level domain, so you need to use the new ".su" top-level domain for the URL.

I tried your script, but when I try to download a post, it will automatically download all the author's posts.

What command did you use? It worked fine for me when I tried using --dateafter and --datebefore, but I didn't test every case since there are no tests to begin with.

In the use of the previous script, I did not use -- date after and -- date before, but it can still download specific posts by using post_id. It seems that after modification, only the user ID can be recognized, regardless of whether you have added a post_id after the link or not.

It should work now. They changed the way single posts are returned from array to object and I accidentally added a regex that only checked for creators and not posts because I don't usually download by posts.

ILogOutOnTheToilet avatar Oct 25 '23 11:10 ILogOutOnTheToilet

I also made an update here: https://github.com/ILogOutOnTheToilet/kemono-dl/tree/update-api My branch doesn't support the old ".party" top-level domain, so you need to use the new ".su" top-level domain for the URL.

I tried your script, but when I try to download a post, it will automatically download all the author's posts.

What command did you use? It worked fine for me when I tried using --dateafter and --datebefore, but I didn't test every case since there are no tests to begin with.

In the use of the previous script, I did not use -- date after and -- date before, but it can still download specific posts by using post_id. It seems that after modification, only the user ID can be recognized, regardless of whether you have added a post_id after the link or not.

It should work now. They changed the way single posts are returned from array to object and I accidentally added a regex that only checked for creators and not posts because I don't usually download by posts.

thank you so much, it truly work for me.

gugulumasiro avatar Oct 25 '23 11:10 gugulumasiro

Started from scratch and made sure everything is as it should be, but now getting "ERROR:No creator information was retrieved. | exiting" when trying to download with the user ID. Something I'm missing or did something change again?

Dazven avatar Oct 27 '23 22:10 Dazven

@ILogOutOnTheToilet Thank you for the fix, quick question, how to remove the folder creation for individual items? Thank you

JamiDEV avatar Nov 12 '23 20:11 JamiDEV

@ILogOutOnTheToilet Thank you for the fix, quick question, how to remove the folder creation for individual items? Thank you

Not exactly sure what you talking but maybe you need to modify the filename patterns

L4cache avatar Dec 09 '23 10:12 L4cache

@ILogOutOnTheToilet Thank you for the fix, quick question, how to remove the folder creation for individual items? Thank you

Not exactly sure what you talking but maybe you need to modify the filename patterns

when downloading the creators content, a folder is made for each individual file based on date. You can end up with 2000 folders.

JamiDEV avatar Jan 08 '24 20:01 JamiDEV