Oleg Korsak
Oleg Korsak
``` -rw-rw-r-- 1 kamikaze kamikaze 180M Apr 9 18:36 archive_20250408_210018_1.tar.bz2 -rw-rw-r-- 1 kamikaze kamikaze 102M Apr 9 18:34 archive_20250408_210018_6.tar.bz2 -rw-rw-r-- 1 kamikaze kamikaze 91M Apr 9 15:34 archive_20250408_210018_9.tar.bz2 -rw-rw-r-- 1...
I just switched encoder to XzEncoder (xz2 feature in async-compression), that's the only change. And file looks really compressed ``` -rw-rw-r-- 1 kamikaze kamikaze 180M Apr 9 18:36 archive_20250408_210018_1.tar.bz2 -rw-rw-r--...
That will be a good task for me, meanwhile I can show my code in a project: https://github.com/bixority/object-storage-maintenance/blob/main/src/compressor.rs
> [@kamikaze](https://github.com/kamikaze) one of the key difference between your demo and bzip2 cli is the I/O part, fetching from network has more latency and less bandwidth than disk I/O, and...
> > since I've swapped BzEncoder to XzEncoder > > [@kamikaze](https://github.com/kamikaze) it might be that xz creates much smaller archive that takes much faster to upload, since it's likely the...
> Yeah, from what I understand: > > - bzip2 is good at very particular data, and performs quite poorly for everything else > - zlib/gzip is a good allround...
same on linux/amd64 building in docker.
msgspec is so much better in memory saving, please make it a first class citizen :)
China. enough said
great idea. please