immich-go icon indicating copy to clipboard operation
immich-go copied to clipboard

Immich-go upload failing after small percentage of files uploaded

Open tyler72us opened this issue 4 months ago • 9 comments

Issue: Running immich-go to upload google takeout zip files to immich server. After running immich go, the initial scan goes fine, but the upload fails after a small percentage of the files are uploaded.

Troubleshooting I've tried: I've tried running Immich-go multiple times. Originally, the zip files were hosted on an NFS share (137k files). I originally tried running Immich go on a windows host and reaching out to the immich server running on a Linux VM (about 600~ files successfully uploaded before the upload quit prematurely). I have tried running immich-go on the Linux VM. Running Immich-go on the same host as immich server, running immich-go with sudo, and moving one of the zip files to the local host to run it (3500 files with only about 60-100 files uploaded successfully before failure). I've also tried manually pausing all immich jobs, reducing concurrency to 1 for every job to reduce load, increasing the client timeout to 400 ms, and giving the API key access to all options. The API key was created by the immich admin, which is the only user on the server. All attempts seem to generate the same error.

immich-go_2025-11-04_16-37-33.log immich-go_2025-11-04_16-22-06.log immich-go_2025-11-04_16-15-20.log immich-go_2025-11-04_16-10-10.log immich-go_2025-11-04_16-01-39.log immich-go_2025-11-04_15-30-15.log

tyler72us avatar Nov 04 '25 17:11 tyler72us

This due to a chive in the immich API.

2025-11-04 15:35:24 ERR upload error file.OriginalFileName=20180830_141847.jpg file.FileName=takeout-20251023T184201Z-1-001:Takeout/Google Photos/Curated France photos/20180830_141847.jpg file.ID= file.FileDate=2025-10-24 10:47:00 file.Description= file.FileSize=2796059 file.CaptureDate=2018-08-30 12:18:47 file.Trashed=false file.Archived=false file.FromPartner=false file.Favorite=false file.Stars=0 file.Latitude=49.xxxxx file.Longitude=-1.xxxxx error=AssetUpload, POST, http://127.0.0.1:2283/api/assets

This on the top of my todo list. But I don't have to much time before the weekend.

simulot avatar Nov 04 '25 18:11 simulot

This due to a chive in the immich API.

2025-11-04 15:35:24 ERR upload error file.OriginalFileName=20180830_141847.jpg file.FileName=takeout-20251023T184201Z-1-001:Takeout/Google Photos/Curated France photos/20180830_141847.jpg file.ID= file.FileDate=2025-10-24 10:47:00 file.Description= file.FileSize=2796059 file.CaptureDate=2018-08-30 12:18:47 file.Trashed=false file.Archived=false file.FromPartner=false file.Favorite=false file.Stars=0 file.Latitude=49.xxxxx file.Longitude=-1.xxxxx error=AssetUpload, POST, http://127.0.0.1:2283/api/assets

This on the top of my todo list. But I don't have to much time before the weekend.

Perfect. I'm happy to wait as long as needed since this is a free resource you support. Just happy to know it's a noted issue that is on the roadmap to be fixed.

tyler72us avatar Nov 04 '25 19:11 tyler72us

--> #1158

simulot avatar Nov 07 '25 16:11 simulot

Could you try the latest release?

simulot avatar Nov 08 '25 18:11 simulot

Hi!

I am encountering the same error while uploading files:

2025-11-10 17:49:48 ERR upload error file.OriginalFileName=.trashed-1765278608-IMG_20251109_150855602_BURST14.jpg file.FileName=cloud-mi9t:.trashed-1765278608-IMG_20251109_150855602_BURST14.jpg file.ID= file.FileDate=2025-11-09 15:43:57 file.Description= file.FileSize=1072125 file.CaptureDate=2025-11-09 15:08:56 file.Trashed=false file.Archived=false file.FromPartner=false file.Favorite=false file.Stars=0 file.Latitude=53.xxxxx file.Longitude=50.xxxxx error=AssetUpload, POST, http://127.0.0.1:2283/api/assets

2025-11-10 17:49:48 ERR Error err=AssetUpload, POST, http://127.0.0.1:2283/api/assets
...
2025-11-10 17:49:48 ERR AssetUpload, POST, http://127.0.0.1:2283/api/assets, 500 Internal Server Error

I have tried both versions v0.28.0 and v0.29.0, but the issue persists. Immich [v2.2.0]

p166 avatar Nov 10 '25 13:11 p166

Could you try the latest release?

Worked great @simulot I did a smaller batch and not a single error this time.

Image

tyler72us avatar Nov 11 '25 04:11 tyler72us

@p166 try using this variant to see how many errors you have by the end. sudo immich-go upload from-google-photos --server=http://127.0.0.1:2283 --api-key={API KEY} --client-timeout=400m --pause-immich-jobs=TRUE --on-server-errors=continue /[your media folers]/takeout-*.zip

tyler72us avatar Nov 11 '25 04:11 tyler72us

My variant of launch: /home/user/bin/immich-go --no-ui=FALSE upload from-folder --concurrent-tasks=8 --pause-immich-jobs=FALSE --server=http://127.0.0.1:2283 --api-key={...} /home/user/syncthing-data/cloud-redmi/Camera/

Image

p166 avatar Nov 11 '25 05:11 p166

@p166 try using this variant to see how many errors you have by the end. sudo immich-go upload from-google-photos --server=http://127.0.0.1:2283 --api-key={API KEY} --client-timeout=400m --pause-immich-jobs=TRUE --on-server-errors=continue /[your media folers]/takeout-*.zip

unknown flag: --on-server-errors

immich-go version 0.29.0

p166 avatar Nov 14 '25 13:11 p166