kiwix-js icon indicating copy to clipboard operation
kiwix-js copied to clipboard

Test the wasm version of libzim/kiwix-lib with split ZIM files

Open mossroy opened this issue 6 years ago • 6 comments

This is a follow-up of #116.

I see no technical reason why it would not work, but it needs to be tested.

mossroy avatar Jun 01 '19 13:06 mossroy

I've implemented what I felt was necessary for that : passing all the files to the wasm, and call the libzim with the baseName (.zim instead of .zimaa). But every call to the libzim still fails with an "Uncaught" error in the browser console

mossroy avatar Oct 27 '21 13:10 mossroy

It's still the case. I would probably need help from @mgautierfr to investigate with me. There must be something wrong in how we do that

mossroy avatar Jun 03 '22 19:06 mossroy

I believe libzim no longer supports split ZIM archives (*.zimaa, *.zimab, etc.). @mgautierfr or @kelson42, can you confirm that the code supporting this was removed?

Jaifroid avatar Nov 06 '22 13:11 Jaifroid

libzim supports splitted zim files but they can not anymore be splitted randomly. See zim-split tool.

kelson42 avatar Nov 07 '22 07:11 kelson42

libzim still support randomly split zim files. Other "tools" (as xapian or video player to which we would like to pass a fd and a offset/range where to read do not support split files at all) zim-split tool splits zim files at position where we avoid to cut internal content. This way we are sure that xapian and other tools will works. (And we earn a bit of performance as we can mmap the memory range in libzim if the range is not in two files)

mgautierfr avatar Nov 08 '22 17:11 mgautierfr

OK, thank you for responses. I'll keep this issue open in that case.

Jaifroid avatar Nov 10 '22 08:11 Jaifroid