WebToEpub icon indicating copy to clipboard operation
WebToEpub copied to clipboard

Fetching novel Chapters for fictionzone.net

Open Franzeeee opened this issue 11 months ago • 4 comments

The new update on the site fictionzone.net break the fetching of the chapters. When i tried to download a novel it is now cut of the the first page which is only up to 100 chapter.

Franzeeee avatar Jan 14 '25 19:01 Franzeeee

@Franzeeee Until I get around to fixing this, you can manually select each range of 100 pages, open WebToEpub to get a set of 100 chapter links and then use the "Copy URLs to Clipboard" to build up a full list of chapters to fetch.

My notes, for how to get list of chapters.

Need to make POST call to https://fictionzone.net/api/__api_party/api-v1, with JSON package like

{
"path":"/chapter/all/102062",
"query":{"page":2},
"headers":{"content-type":"application/json"},
"method":"get"
}

This will return 100 links. Need to increase "page" for each batch of 100.

To get the value in path, need to call same URL with JSON package

{"path":"/novel/the-saint-s-fiancee-cheated-on-her-let-s-face-it-both-of-them-must-die",
"headers":{"content-type":"application/json"},
"method":"get"
}

(Note this is for ToC page https://fictionzone.net/novel/the-saint-s-fiancee-cheated-on-her-let-s-face-it-both-of-them-must-die

dteviot avatar Jan 15 '25 07:01 dteviot

Can i push the update i made on the parser? I fixed it on my side with just little code.

Franzeeee avatar Jan 15 '25 21:01 Franzeeee

@Franzeeee

Can i push the update i made on the parser?

Yes you can. That's kind of the point of GitHub. I'm not sure why you're even asking me.

dteviot avatar Jan 16 '25 00:01 dteviot

@Franzeeee here is a guide to help you making a pull request: https://github.com/dteviot/WebToEpub/wiki/Developer-guide

gamebeaker avatar Jan 19 '25 20:01 gamebeaker

@gamebeaker Url - https://fictionzone.net/novel/my-battleship-can-upgrade Web to epub - latest version It's also latest chrome version - pc Firefox nightly latest version - android Epub Reader - https://github.com/IReaderorg/IReader 2 . https://github.com/LagradOst/QuickNovel I reader saying unknown novel Quick novel saying fail to parse

Originally posted by @Legendoras in #1746

gamebeaker avatar Apr 02 '25 18:04 gamebeaker

Version 1.0.3.0 is perfectly working now for fictionzone.net , latest one is not even fetching 100 chapters

Legendoras avatar Apr 03 '25 12:04 Legendoras

@Legendoras @Franzeeee i don't have this problem i have recorded what i did:

https://github.com/user-attachments/assets/934126ed-2d0f-4dbb-a385-cedc54770205

I didn't download all Chapter because i didn't want to wait this long.

Do you have set Max web pages to fetch simultaneously to 1 Manual Throttle|Delay per chapter to default or 3 sec

gamebeaker avatar Apr 03 '25 18:04 gamebeaker

I actually forgot to close this, but when I tried to use the latest ver. they alrdy fixed it. Though I recreated the code for the scrapper on this one and used it on mine.

Franzeeee avatar Apr 03 '25 21:04 Franzeeee

Actually Fiictionzone problem is fixed in the last 3 week ago update 1.0.4 but the site is unstable and get weird updates which can cause problems there is no problem when downloading chapter but the problem was with opening it , it doesn't get parse at all or broken or corrupt I was using 1.0.3.0 version for now which works perfectly no problem and I use overwrite the min throttle so it's doesn't take much time to download novels @gamebeaker

Legendoras avatar Apr 04 '25 01:04 Legendoras

@Legendoras my thoughts are that maybe the server recognizes that you are making too many requests and shadow bans you. What do i mean with shadow ban? The server doesn't response with an error message. Instead the server sends an empty page to you and WebToEpub doesn't realize that this isn't the correct content. I don't know if fictionzone does that but i have seen this behaviour. Can you please upload an broken epub here: https://nx39171.your-storageshare.de/s/FMdradcMYAHLydP maybe i can figure out what happens.

gamebeaker avatar Apr 04 '25 02:04 gamebeaker

Ok I have uploaded @gamebeaker , when the new update came them i downloaded 1000 chapter I can't download all because my phone can't handle that much of pressure of downloading all and start getting slower after 3 weeks i done listening all 1000 chapter so I tried downloading remaining chapter then this thing happen

Legendoras avatar Apr 04 '25 02:04 Legendoras

@Legendoras If you download in steps you can use the Library.

gamebeaker avatar Apr 04 '25 02:04 gamebeaker

@Legendoras The file is named "My_Battleship_Can_Upgrade.epub (1)" it should be "My_Battleship_Can_Upgrade (1).epub" my viewer can view it if i use calibre. Does a simple rename solve your problem?

gamebeaker avatar Apr 04 '25 04:04 gamebeaker

It's showing txt icon now when rename like other epub but before it's showing other format icon but still it's not opening but it's ok upi can close this issue now as 1.0.3.0 is working perfectly for me so I don't need to change anything now but still thanks for help @gamebeaker

Legendoras avatar Apr 04 '25 04:04 Legendoras

Updated version (1.0.5.0) has been submitted to Firefox and Chrome stores. Firefox version is available now. Chrome might be available in a few hours (typical) to 21 days.

dteviot avatar Apr 27 '25 05:04 dteviot