immich icon indicating copy to clipboard operation
immich copied to clipboard

[BUG] iOS app upload repeat error

Open presario222 opened this issue 1 year ago • 20 comments

The bug

ios app upload frequently had error "PathNotFoundException" with "can not open file" or "can not delete file".

I have setup a shared album on iphone but the immich uploading album is "Recents", the default one in iphone. and I open the icloud function "optimize iphone storage" to save some space.

1af2db0533a6a755e437c7e9f921e96

The OS that Immich Server is running on

Unraid

Version of Immich Server

v1.81

Version of Immich Mobile App

latest

Platform with the issue

  • [X] Server
  • [ ] Web
  • [X] Mobile

Your docker-compose.yml content

version: "3.8"

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    command: [ "start.sh", "immich" ]
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /mnt/user/media/pictures:/mnt/user/media/pictures
    env_file:
      - .env
    depends_on:
      - redis
      - database
      - typesense
    restart: always

  immich-microservices:
    container_name: immich_microservices
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    # extends:
    #   file: hwaccel.yml
    #   service: hwaccel
    command: [ "start.sh", "microservices" ]
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /mnt/user/media/pictures:/mnt/user/media/pictures
    env_file:
      - .env
    depends_on:
      - redis
      - database
      - typesense
    restart: always

  immich-machine-learning:
    container_name: immich_machine_learning
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always

  immich-web:
    container_name: immich_web
    image: ghcr.io/immich-app/immich-web:${IMMICH_VERSION:-release}
    env_file:
      - .env
    restart: always

  typesense:
    container_name: immich_typesense
    image: typesense/typesense:0.24.1@sha256:9bcff2b829f12074426ca044b56160ca9d777a0c488303469143dd9f8259d4dd
    environment:
      - TYPESENSE_API_KEY=${TYPESENSE_API_KEY}
      - TYPESENSE_DATA_DIR=/data
      # remove this to get debug messages
      - GLOG_minloglevel=1
    volumes:
      - tsdata:/data
    restart: always

  redis:
    container_name: immich_redis
    image: redis:6.2-alpine@sha256:70a7a5b641117670beae0d80658430853896b5ef269ccf00d1827427e3263fa3
    restart: always

  database:
    container_name: immich_postgres
    image: postgres:14-alpine@sha256:28407a9961e76f2d285dc6991e8e48893503cc3836a4755bbc2d40bcc272a441
    env_file:
      - .env
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
    volumes:
      - pgdata:/var/lib/postgresql/data
    restart: always

  immich-proxy:
    container_name: immich_proxy
    image: ghcr.io/immich-app/immich-proxy:${IMMICH_VERSION:-release}
    environment:
      # Make sure these values get passed through from the env file
      - IMMICH_SERVER_URL
      - IMMICH_WEB_URL
    ports:
      - 2283:8080
    depends_on:
      - immich-server
      - immich-web
    restart: always

volumes:
  pgdata:
  model-cache:
  tsdata:

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=/mnt/user/media/photos

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secrets for postgres and typesense. You should change these to random passwords
TYPESENSE_API_KEY=eiwokdnsjgfds1234jgf
DB_PASSWORD=postgres

# The values below this line do not need to be changed
###################################################################################
DB_HOSTNAME=immich_postgres
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

REDIS_HOSTNAME=immich_redis

Reproduction steps

1.setup the immich server follow the guide.
2.download the iphone app and start to upload
3.the app's log will show error information
...

Additional information

No response

presario222 avatar Oct 04 '23 12:10 presario222

I have the same issue

vongoethe avatar Oct 18 '23 05:10 vongoethe

Same issue here on version 1.85. I'm backing up a large iOS library (with iCloud enabled).

When the error appears the backup from the immich app stops, and I have to cancel and start backup again. There are no errors on the server side.

This also prevent the background backup to work consistently.

jetblack-nz avatar Nov 14 '23 19:11 jetblack-nz

@jetblack-nz Can you elaborate on what error are you seeing, are you accessing over DNS or local IP?

alextran1502 avatar Nov 14 '23 20:11 alextran1502

Hi @alextran1502 thanks for answering and for the great app!

The error on my iOS app matches the screenshot of the OP. The app log shows "PathNotFoundException" with "can not open file" or "can not delete file". See below.

  • iPhone 12, iOS 17.03
  • Photos with iCloud sync enabled and 'Optimise iPhone Storage' also enabled
  • I am on the same network as the server and I access it locally using the IP address (no DNS or VPN).

The issue happens every few minutes. I don't have shared albums yet, it's a fresh server install with the first backup churning through 55k photos which mostly are on iCloud.

I'm happy to provide more info or help with testing... I self-host quite a few apps and can set up a new VM or LXC in minutes.

Catch all error: PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/09EC83EA-ECCD-412E-8D5C-3DB0F23D9831/tmp/.image/D44C463E-91C0-4187-ABC5-62A1BDE57A62_L0_001_1574712794.916106_o_FullSizeRender.jpg' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/09EC83EA-ECCD-412E-8D5C-3DB0F23D9831/tmp/.image/D44C463E-91C0-4187-ABC5-62A1BDE57A62_L0_001_1574712794.916106_o_FullSizeRender.jpg' (OS Error: No such file or directory, errno = 2)

jetblack-nz avatar Nov 14 '23 22:11 jetblack-nz

I have the same issue on ser version 1.86 and iOS app version 1.86 in iOS 17. Did try reinstall the application and restart the containers without any luck. I have to kill the stalled backup in the application and then start it over to backup any other pictures taken after error.

2023-11-15 19:42:54.073644,LogLevel.SEVERE,"ImmichErrorLogger","Catch all error: PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/9B57F0FA-BD38-456D-8F9A-D0C410694481/tmp/.image/9D2DC033-393C-4A4D-8C14-BD0E6F3A9C09_L0_001_0.000000_o_IMG_2494.JPG' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/9B57F0FA-BD38-456D-8F9A-D0C410694481/tmp/.image/9D2DC033-393C-4A4D-8C14-BD0E6F3A9C09_L0_001_0.000000_o_IMG_2494.JPG' (OS Error: No such file or directory, errno = 2)","#0 _checkForErrorResponse (dart:io/common.dart:55) #1 _File.open.<anonymous closure> (dart:io/file_impl.dart:381) <asynchronous suspension> #2 _FileStream._start.onOpenFile (dart:io/file_impl.dart:153) <asynchronous suspension> " 2023-11-15 19:42:52.592458,LogLevel.SEVERE,"ImmichErrorLogger","Catch all error: PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/9B57F0FA-BD38-456D-8F9A-D0C410694481/tmp/.image/9D2DC033-393C-4A4D-8C14-BD0E6F3A9C09_L0_001_0.000000_o_IMG_2494.JPG' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/9B57F0FA-BD38-456D-8F9A-D0C410694481/tmp/.image/9D2DC033-393C-4A4D-8C14-BD0E6F3A9C09_L0_001_0.000000_o_IMG_2494.JPG' (OS Error: No such file or directory, errno = 2)","#0 _checkForErrorResponse (dart:io/common.dart:55) #1 _File.open.<anonymous closure> (dart:io/file_impl.dart:381) <asynchronous suspension> #2 _FileStream._start.onOpenFile (dart:io/file_impl.dart:153) <asynchronous suspension> "

Uberpainer avatar Nov 15 '23 19:11 Uberpainer

@Uberpainer Are you using iCloud with Optimized Storage options enabled?

alextran1502 avatar Nov 15 '23 19:11 alextran1502

@alextran1502 No on both mine and her iPhone are Optimized Storage options not enabled. It's set to keep originals.

Uberpainer avatar Nov 15 '23 19:11 Uberpainer

@Uberpainer just to confirm that iCloud is used, correct?

alextran1502 avatar Nov 15 '23 19:11 alextran1502

@alextran1502 Yes, thats is correct. Issue only appear on my wifes iPhone and not mine. If you need me to test anything please say, I'm here to help as much as possible eventhough my lack of programming skills ;)

Uberpainer avatar Nov 15 '23 19:11 Uberpainer

Same problem here, just checked the logs on iPhone after noticing that it's getting stuck often. Any workarounds for now? (I have iCloud enabled BTW). Thanks

vitobotta avatar Dec 09 '23 17:12 vitobotta

@vitobotta are you on 1.90? There is a toggle to ignore iCloud photos and videos. Let me know if it works

alextran1502 avatar Dec 09 '23 18:12 alextran1502

After updated version i iOS app to version 1.90 and running server version 1.90.2 then does errors still occour. And thats even after I have set Immich app on my wife phone to ignore iCloud Photos. Immich_log_2023-12-09T204935.138182.csv Immich_log_2023-12-10T151028.850868.csv

Uberpainer avatar Dec 09 '23 19:12 Uberpainer

@vitobotta are you on 1.90? There is a toggle to ignore iCloud photos and videos. Let me know if it works

Hi Alex, yep latest versions both server and mobile app. I tried ignoring iCloud photos but the upload just stopped working altogether. Then I reinstalled the app and left it turned on to try again with it enabled and now it's been uploading happily for a while so I will wait for now to see if it finishes. It has done 5k out of 50k photos and videos and it's not getting stuck so far, so seems to be going better now :)

vitobotta avatar Dec 09 '23 21:12 vitobotta

Hi all, I have the same issue. Latest version and only uploading "recent pictures" folder and have icloud turned off.. Reinstall of the app did not help

talan-z avatar Dec 11 '23 04:12 talan-z

Having the same problem on a fresh install of Immich 1.91.3, doing an initial backup of 7k photos. iCloud enabled, Optimized Storage enabled.

Catch all error: PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2)

#0 _File.throwIfError (dart:io/file_impl.dart:675) #1 _File._deleteSync (dart:io/file_impl.dart:329) #2 FileSystemEntity.deleteSync (dart:io/file_system_entity.dart:424) #3 BackupService.backupAsset (package:immich_mobile/modules/backup/services/backup.service.dart:398) <asynchronous suspension> #4 BackupNotifier.startBackupProcess (package:immich_mobile/modules/backup/providers/backup.provider.dart:461) <asynchronous suspension>

mtehonica avatar Dec 18 '23 16:12 mtehonica

Having the same problem on a fresh install of Immich 1.91.3, doing an initial backup of 7k photos. iCloud enabled, Optimized Storage enabled.

Catch all error: PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2)

#0 _File.throwIfError (dart:io/file_impl.dart:675) #1 _File._deleteSync (dart:io/file_impl.dart:329) #2 FileSystemEntity.deleteSync (dart:io/file_system_entity.dart:424) #3 BackupService.backupAsset (package:immich_mobile/modules/backup/services/backup.service.dart:398) <asynchronous suspension> #4 BackupNotifier.startBackupProcess (package:immich_mobile/modules/backup/providers/backup.provider.dart:461) <asynchronous suspension>

@mtehonica Fixed in #5827

alextran1502 avatar Dec 18 '23 16:12 alextran1502

Having the same problem on a fresh install of Immich 1.91.3, doing an initial backup of 7k photos. iCloud enabled, Optimized Storage enabled. Catch all error: PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2) #0 _File.throwIfError (dart:io/file_impl.dart:675) #1 _File._deleteSync (dart:io/file_impl.dart:329) #2 FileSystemEntity.deleteSync (dart:io/file_system_entity.dart:424) #3 BackupService.backupAsset (package:immich_mobile/modules/backup/services/backup.service.dart:398) <asynchronous suspension> #4 BackupNotifier.startBackupProcess (package:immich_mobile/modules/backup/providers/backup.provider.dart:461) <asynchronous suspension>

@mtehonica Fixed in #5827

#5827 doesn't seem to have resolved this. Still seeing this on 1.91.4.

Catch all error: PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/2EDFA739-B179-43F8-B1A8-12BD4817560C_L0_001_1700290858.381235_o_FullSizeRender.jpg' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/2EDFA739-B179-43F8-B1A8-12BD4817560C_L0_001_1700290858.381235_o_FullSizeRender.jpg' (OS Error: No such file or directory, errno = 2)

#0 _File.throwIfError (dart:io/file_impl.dart:675) #1 _File._deleteSync (dart:io/file_impl.dart:329) #2 FileSystemEntity.deleteSync (dart:io/file_system_entity.dart:424) #3 BackupService.backupAsset (package:immich_mobile/modules/backup/services/backup.service.dart:398 #4 BackupNotifier.startBackupProcess (package:immich_mobile/modules/backup/providers/backup.provider.dart:461)

mtehonica avatar Dec 19 '23 13:12 mtehonica

@mtehonica is your mobile app on 1.91.4?

alextran1502 avatar Dec 19 '23 15:12 alextran1502

@alextran1502 , I have updated my wife mobile app to version 1.91.4 and run server version 1.91.4. But are still seeing issue with sync failing and stops. Keeps spinning in the "cloud icon" in the app, at give this error in the log:

created_at,level,context,message,stacktrace 2023-12-20 16:11:04.954693,LogLevel.SEVERE,"ImmichErrorLogger","Catch all error: PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/F7F2D158-7CDB-4F64-BAC1-6A05F6B9A9C1/tmp/.image/4D5C31AA-EC3A-4626-A76A-A71D2C81F823_L0_001_1702855632.121231_o_IMG_2051.HEIC' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/F7F2D158-7CDB-4F64-BAC1-6A05F6B9A9C1/tmp/.image/4D5C31AA-EC3A-4626-A76A-A71D2C81F823_L0_001_1702855632.121231_o_IMG_2051.HEIC' (OS Error: No such file or directory, errno = 2)","#0 _checkForErrorResponse (dart:io/common.dart:55) #1 _File.open. (dart:io/file_impl.dart:381) #2 _FileStream._start.onOpenFile (dart:io/file_impl.dart:153) " 2023-12-20 16:11:04.954463,LogLevel.INFO,"AssetNotifier","Load partner assets: 5069ms","" 2023-12-20 16:11:03.344731,LogLevel.INFO,"AssetNotifier","Load assets: 3445ms","" 2023-12-20 16:11:03.344658,LogLevel.SEVERE,"ImmichErrorLogger","Catch all error: PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/F7F2D158-7CDB-4F64-BAC1-6A05F6B9A9C1/tmp/.image/4D5C31AA-EC3A-4626-A76A-A71D2C81F823_L0_001_1702855632.121231_o_IMG_2051.HEIC' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/F7F2D158-7CDB-4F64-BAC1-6A05F6B9A9C1/tmp/.image/4D5C31AA-EC3A-4626-A76A-A71D2C81F823_L0_001_1702855632.121231_o_IMG_2051.HEIC' (OS Error: No such file or directory, errno = 2)","#0 _checkForErrorResponse (dart:io/common.dart:55) #1 _File.open. (dart:io/file_impl.dart:381) #2 _FileStream._start.onOpenFile (dart:io/file_impl.dart:153)

Immich_log_2023-12-20T161140.487950.csv

Uberpainer avatar Dec 20 '23 20:12 Uberpainer

Has anyone found a workaround or solution on this?

Uberpainer avatar Feb 01 '24 11:02 Uberpainer