fvid icon indicating copy to clipboard operation
fvid copied to clipboard

Converting large files is not feasible due to high memory usage

Open dylanpdx opened this issue 4 years ago • 1 comments

This tool works great for small files, but trying to convert a relatively large file (1GB) will cause a MemoryError, even with 32 GB of RAM

dylanpdx avatar Dec 20 '20 01:12 dylanpdx

Indeed. There's a bit of a tradeoff between memory and speed, and we've mostly gone the speed route since it was envisioned that people wouldn't try to encode a file above a few tens of megabytes. If there's an interest in adding modes for memory or speed, I'd be happy to work on that. For now though, can you run a memory profiler (scalene or memprof work well) to tell us where the code uses most of the memory on your machine, or send the 1GB file here so I can test?

Theelx avatar Jan 16 '21 02:01 Theelx