ThisIsFineTM

It would be helpful if we could figure out which minimum compiler version we specifically want to target. The codebase already uses some >= C++17 features, so those sections would...

Hi Kelson, Thank you for the quick reply. Here are the ones that stood out to me. https://github.com/openzim/zim-tools/blob/a65cb01f63d391f6684e823f5d6c3dcef3ce7fda/meson.build#L4 ``` 4: default_options : ['c_std=c11', 'cpp_std=c++17', 'werror=true', 'warning_level=1']) ^^^^^^^^^^^^^^^^ ``` https://github.com/openzim/zim-tools/blob/a65cb01f63d391f6684e823f5d6c3dcef3ce7fda/src/zimwriterfs/zimcreatorfs.cpp#L45 ```...

As a bit of a followup: libzim targets c++17. https://github.com/openzim/libzim/blob/40bfe6470490fb52b0a44a9fdab8ddbaad37b181/meson.build#L4 xapian-core targets c++11 https://github.com/openzim/xapian-meson/blob/d3efba172e832ce9b0860996576e96eef7850d83/xapian-core/meson.build#L2 kiwix-tools targets c++17 https://github.com/kiwix/kiwix-tools/blob/e65354a486376445d809f4a1dd7e3394b5e933ba/meson.build#L4 libkiwix targets c++17 https://github.com/kiwix/libkiwix/blob/6c37e2827e6ccf0497d20b5cfe1696df6481c4ed/meson.build#L4 The oldest compiler I found in the Repology...

It looks like C++17 target was added in this repository August 30, 2023 by @mgautierfr: https://github.com/openzim/zim-tools/commit/297e672826d599076cbe3ec31337bbefa3d737e4

... ... ... So yeah, um, bzip3 is just rediculously outperforming everything else for numerical data sets. I got ahold of a friend's data set from a particle physics experiment....

@alerque I did, and the multithreaded compression and decompression were of comparable times for bzip3. These were using the default settings. I did some other tests with -b256 and -b511,...

I did a little bit more experimentation, mainly comparing bz3 to zstd. I haven't had much time to dive into how bz3 works, but it seems like bz3 really accels...

I did some cursory experimentation with lrzip, and it did help some, but not enough to change the relative final compression ratios of the different algorithms/settings for the test data...

In my own limited testing, webp and avif seem to get the best compression, but webp certainly wins when it comes to speed and platform support. libwebp has support for...

Just flagging this here since it seemed to be the most relevant place. I've seen this warning popping up in the CI runs. It is not immediately pressing, but at...