simulot
High memory usage when uploading large raw file
I'm using immich-go on mac, and my server is running on the same machine.
When I try to import using upload from-folder to import a large library of canon cr3 raw file, the upload speed is very slow, and the memory usage become extremely high.
Same on my side with rw2 file.
Ssh on my server and launched :
./immich-go upload from-folder --server=https://immich.myserver.com --api-key=api-key ../Photos/*.RW2
The ram goes to 100% and I need to restart my server.
There's like 3000 rw2 file in the folder.
Worked flawlessly from Google photos with 30k jpg.
Immich-go uses a 32K buffer to search exif data in a cr3. This doesn't explain this memory usage. I'll check this.
I've had this issue too - I've found it to be intermittent, but it has caused 4 crashes now running the latest version of immich-go. Twice on my server (32GB RAM) and twice when running on my laptop (64GB RAM).
