WebToEpub icon indicating copy to clipboard operation
WebToEpub copied to clipboard

Extension crashes when trying to process a large novel.

Open dteviot opened this issue 7 years ago • 1 comments

Reported:

Trying to turn "http://novelplanet.com/Novel/Martial-God-Asura". It's crashing everytime. Error message "Aw, Snap!"

On initial investigation, there are several issues.

  • [x] jszip library needs about 640 kilobytes per page to compress. I've raised https://github.com/Stuk/jszip/issues/446 with jszip's author. But will probably need to find a solution myself.
  • [ ] Currently, each fetched page is consuming about 5 megabytes of Chrome memory. Mostly NOT javascript heap. I suspect this is because I hold each web pages as a DOM object, I need to prove this. Not good for a 35 kilobyte raw HTML.

A consequence of above, maximum limit for number of pages/chapters that can be processed is about 500.

dteviot avatar Aug 21 '17 20:08 dteviot

jszip branch 3.1.4 https://github.com/Stuk/jszip/releases/tag/v3.1.4 has partial fix for the memory issue https://github.com/Stuk/jszip/issues/446

dteviot avatar Sep 04 '17 21:09 dteviot