Ventoy icon indicating copy to clipboard operation
Ventoy copied to clipboard

Support compression

Open TPS opened this issue 5 years ago • 8 comments

@ventoy All the listed currently-supported disk image formats are typically uncompressed, which is wasteful when supporting multiple disk images on an often limited-space USB drive. Could compression be supported in @ least 1 of these ways?:

  • [ ] Explicit & complete support for compressed disk image formats (e.g., .wim @ #288, .dmg @ #665, .cso, .dax, .imz, .vhdz, .chd @ https://github.com/ventoy/Ventoy/issues/817#issuecomment-810763455, &c)
  • [ ] Explicit & complete support for compressed file systems ~~both for host (e.g., USB's) &~~ within the disk image file(s) (e.g., btrfs @ https://github.com/ventoy/Ventoy/issues/645#issuecomment-745019189, zfs, ntfs ~~/refs~~, &c)

TPS avatar Mar 28 '21 18:03 TPS

As I said in #645 Ventoy depends on the file's location on the disk and map these blocks to a virtual device. So the file in the filesystem can NOT be compressed. So brtfs and other filesystems with compression enabled can NOT be supported.

ventoy avatar Mar 29 '21 01:03 ventoy

Are the rest possible?

TPS avatar Mar 29 '21 03:03 TPS

How about mame chd support? https://github.com/rtissera/libchdr

whocares0101 avatar Mar 31 '21 05:03 whocares0101

For other Googlers, to find this issue:

error: module `ntfscomp` isn't loaded
error: read MFT 0x53 fails.

Work-around: You don't need to uncompress the whole drive, just the .iso itself, or perhaps the folder containing your boot ISOs :)

HaleTom avatar Jan 27 '22 13:01 HaleTom

cant img/iso files compressed with various tools be uncompressed to a ramdisk and treated the same as uncompressed images? That would be a great feature

derzahla avatar Jun 14 '23 21:06 derzahla

@derzahla that's a good idea -- feel free to raise it as a separate issue :)

Even so, the ISO couldn't be loaded into ramdisk as per your suggestion because of this current issue: the data in the ISO couldn't be read if the ISO was compressed and residing on NTFS.

HaleTom avatar Jun 28 '23 16:06 HaleTom

Ventoy depends on the file's location on the disk and map these blocks to a virtual device. So the file in the filesystem can NOT be compressed. So brtfs and other filesystems with compression enabled can NOT be supported.

Is there a particular resource that clarifies this limitation?

I would have thought that the filesystem was responsible for managing it's data and how it compresses and stores the extents of a file. Other software would just take the file and could modify any part of it completely oblivious to filesystem features like compression, without any issue.

What is different with how Ventoy approaches it?


A 128 GB fixed size .img (with a linux OS install) compressed to 7GB disk usage on host BTRFS (with compression enabled) disk, but without using specialized utility like compsize, most generic software still considers it as 128 GB file.

I would have thought that Ventoy would map the 128GB file as per usual, and BTRFS would handle the compression behind the scenes without any issues/differences?

I tried to look up compression limitation with device mapper but wasn't finding any helpful results :(

polarathene avatar Jul 24 '23 23:07 polarathene