immich icon indicating copy to clipboard operation
immich copied to clipboard

Failed to hash file xxx

Open gaetschwartz opened this issue 1 year ago • 4 comments
trafficstars

The bug

It seems like some image files crashing the HashService component of the mobile app.

The OS that Immich Server is running on

Linux gaetans-home 6.10.10-200.fc40.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 18:26:09 UTC 2024 x86_64 GNU/Linux

Version of Immich Server

1.116.0

Version of Immich Mobile App

1.116.0

Platform with the issue

  • [ ] Server
  • [ ] Web
  • [X] Mobile

Your docker-compose.yml content

name: immich

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    extends:
      file: hwaccel.transcoding.yml
      service: quicksync # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding
    volumes:
      # Do not edit the next line. If you want to change the media storage location on your system, edit the value of UPLOAD_LOCATION in the .env file
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    ports:
      - 2283:3001
    depends_on:
      - redis
      - database
    restart: always
    healthcheck:
      disable: false

  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration
    #   file: hwaccel.ml.yml
    #   service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always
    healthcheck:
      disable: false

  redis:
    container_name: immich_redis
    image: docker.io/redis:6.2-alpine@sha256:2d1463258f2764328496376f5d965f20c6a67f66ea2b06dc42af351f75248792
    healthcheck:
      test: redis-cli ping || exit 1
    restart: always

  database:
    container_name: immich_postgres
    image: docker.io/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
      POSTGRES_INITDB_ARGS: '--data-checksums'
    volumes:
      # Do not edit the next line. If you want to change the database storage location on your system, edit the value of DB_DATA_LOCATION in the .env file
      - ${DB_DATA_LOCATION}:/var/lib/postgresql/data
    healthcheck:
      test: pg_isready --dbname='${DB_DATABASE_NAME}' --username='${DB_USERNAME}' || exit 1; Chksum="$$(psql --dbname='${DB_DATABASE_NAME}' --username='${DB_USERNAME}' --tuples-only --no-align --command='SELECT COALESCE(SUM(checksum_failures), 0) FROM pg_stat_database')"; echo "checksum failure count is $$Chksum"; [ "$$Chksum" = '0' ] || exit 1
      interval: 5m
      start_interval: 30s
      start_period: 5m
    command: ["postgres", "-c", "shared_preload_libraries=vectors.so", "-c", 'search_path="$$user", public, vectors', "-c", "logging_collector=on", "-c", "max_wal_size=2GB", "-c", "shared_buffers=512MB", "-c", "wal_compression=on"]
    restart: always

volumes:
  model-cache:

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=./library
# The location where your database files are stored
DB_DATA_LOCATION=./postgres

# To set a timezone, uncomment the next line and change Etc/UTC to a TZ identifier from this list: https://en.wikipedia.org/wiki/List_of_tz_database_time_zones#List
# TZ=Etc/UTC

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
# Please use only the characters `A-Za-z0-9`, without special characters or spaces
DB_PASSWORD=

# The values below this line do not need to be changed
###################################################################################
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

Reproduction steps

  1. Have pictures in your photos on iOS
  2. Start sync either manually or automatically
  3. Check logs

Relevant log output

Immich App logs ```shell 2024-09-27 13:06:51.310343 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/6566BFE5-A22F-469A-876A-212E86632C22_L0_001_1727109796.117346_o_IMG_7572.HEIC, skipping | 2024-09-27 13:06:51.310341 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/DFD397A8-9F77-4F8B-A3F7-944B2724054F_L0_001_1727109796.109524_o_IMG_7573.HEIC, skipping | 2024-09-27 13:06:51.310340 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/36E13C3E-209E-422B-B6A2-B916D2F79C4A_L0_001_1727109796.081740_o_IMG_7574.HEIC, skipping | 2024-09-27 13:06:51.310339 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/705818BC-C032-498F-B6FB-BE202ADB6E22_L0_001_1727109796.104271_o_IMG_7575.HEIC, skipping | 2024-09-27 13:06:51.310338 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/109D7A83-817C-49FF-AFE4-C838FF59BCF7_L0_001_1727109796.069043_o_IMG_7576.HEIC, skipping | 2024-09-27 13:06:51.310337 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/3CAD15C5-FA32-43B3-A56B-DCF96AAE69C6_L0_001_1727109796.073709_o_IMG_7577.HEIC, skipping | 2024-09-27 13:06:51.310335 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/B055A1E7-693B-4696-96A8-7EA75FA0C83A_L0_001_1727109796.099173_o_IMG_7578.HEIC, skipping | 2024-09-27 13:06:51.310334 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/8879B05E-4DDE-4F4B-852C-2CCC69F879DD_L0_001_1727109796.089509_o_IMG_7579.HEIC, skipping | 2024-09-27 13:06:51.310333 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/50CA5F42-9BA2-40A2-AAEC-F5D150903896_L0_001_1727109796.072236_o_IMG_7580.HEIC, skipping | 2024-09-27 13:06:51.310332 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/C7C483D2-0FBD-4F57-93A7-828D3C70F30E_L0_001_1727109796.062806_o_IMG_7581.HEIC, skipping | 2024-09-27 13:06:51.310331 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/5F7F0B1E-14E7-4768-8ADF-30D55C6FBB30_L0_001_1727109796.095542_o_IMG_7582.HEIC, skipping | 2024-09-27 13:06:51.310330 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/66E92E1E-BEE7-4B61-8442-480A41DE9594_L0_001_1727109796.101559_o_IMG_7583.HEIC, skipping | 2024-09-27 13:06:51.310329 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/0C663196-2BF3-4678-8EAE-87AD62986FBE_L0_001_1727109796.087488_o_IMG_7584.HEIC, skipping | 2024-09-27 13:06:51.310328 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/708D94F3-8B78-4F39-825F-5B816AE58C72_L0_001_1727109796.076904_o_IMG_7585.HEIC, skipping | 2024-09-27 13:06:51.310327 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/368E5866-FECB-4BE2-BE71-1A9F9B260D35_L0_001_1727109796.061043_o_IMG_7586.HEIC, skipping | 2024-09-27 13:06:51.310326 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/D69F8CF2-101B-4278-B2E1-22517D01C4C7_L0_001_1727109796.113371_o_IMG_7587.HEIC, skipping | 2024-09-27 13:06:51.310323 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/279339FC-C57F-4EC7-B7FC-43C9B7D88D42_L0_001_1727109796.091792_o_IMG_7588.HEIC, skipping | 2024-09-27 13:06:51.310322 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/88D3A4AE-B833-4BAD-A10C-EB19DC602054_L0_001_1727109796.064303_o_IMG_7589.HEIC, skipping | 2024-09-27 13:06:51.310321 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/5AE720CA-7097-48E2-9337-925BAF989914_L0_001_1727109796.083036_o_IMG_7590.HEIC, skipping | 2024-09-27 13:06:51.310320 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/BE644D4C-F395-4A29-9AE4-2830E84C0E34_L0_001_1727109796.078162_o_IMG_7591.HEIC, skipping | 2024-09-27 13:06:51.310319 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/D13AC125-226C-458F-B390-196F9E3BEEF0_L0_001_1727109796.115301_o_IMG_7592.HEIC, skipping | 2024-09-27 13:06:51.310318 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/828E505A-054D-4F73-A78D-268896188EF5_L0_001_1727109796.116756_o_IMG_7593.HEIC, skipping | 2024-09-27 13:06:51.310317 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/8B0B692D-7F5A-4BAD-B08A-B994488731EC_L0_001_1727109796.079247_o_IMG_7594.HEIC, skipping | 2024-09-27 13:06:51.310316 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/03AD8E14-0DD2-453B-AFF4-A99A40B0C895_L0_001_1727109796.090637_o_IMG_7595.HEIC, skipping | 2024-09-27 13:06:51.310315 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/1BD3B0FE-4824-4A62-9AF3-E3373EA18BF9_L0_001_1727109796.502689_o_IMG_7596.HEIC, skipping | 2024-09-27 13:06:51.310313 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/39F43356-6AB6-4A83-BB2D-6C94E3E4E738_L0_001_1727109796.490096_o_IMG_7597.HEIC, skipping | 2024-09-27 13:06:51.310301 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/7A9E7E06-051C-4509-BCEC-856B16203A41_L0_001_1727109796.458586_o_IMG_7598.HEIC, skipping | 2024-09-27 13:06:51.310299 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/DD19279C-F2E2-4F1C-8150-A6F0DC485FD4_L0_001_1727109796.486588_o_IMG_7599.HEIC, skipping | 2024-09-27 13:06:51.310296 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/EA5B26C7-6DA5-4E1B-B012-C7C0DAC754D0_L0_001_1727109796.494530_o_IMG_7600.HEIC, skipping | 2024-09-27 13:06:51.310293 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/14E99223-6F82-4CF1-8E5F-6625A347F065_L0_001_1727109796.480662_o_IMG_7601.HEIC, skipping | 2024-09-27 13:06:51.310287 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/BD959338-D494-4FBF-8844-1982E6951FB1_L0_001_1727109796.493362_o_IMG_7602.PNG, skipping | 2024-09-27 13:06:51.310285 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/C9D6DC50-A052-4480-93B1-B26CFFFA7E86_L0_001_1727109796.470475_o_IMG_7603.HEIC, skipping | 2024-09-27 13:06:51.310282 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/EC546CCE-4A8C-4DD3-82E9-C25BE2BFF37C_L0_001_1727109796.459164_o_IMG_7604.HEIC, skipping | 2024-09-27 13:06:51.310279 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/6E68D9FC-89F9-4BBF-8176-7924E9FFD815_L0_001_1727109796.500422_o_IMG_7605.HEIC, skipping | 2024-09-27 13:06:51.310277 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/CCD5365A-63BD-45AD-8633-74D820C1EA32_L0_001_1727109796.457448_o_IMG_7606.HEIC, skipping | 2024-09-27 13:06:51.310274 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/7621D969-FBE7-4BB8-8BD3-13D7FFFC37AF_L0_001_1727109796.483068_o_IMG_7607.HEIC, skipping | 2024-09-27 13:06:51.310271 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/CA66DB7C-A17C-475C-AD1E-BA450D0E787C_L0_001_1727109796.463177_o_IMG_7608.HEIC, skipping | 2024-09-27 13:06:51.310256 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/FB233196-84AE-49B8-9E72-9C3A6649D41A_L0_001_1727109796.450395_o_IMG_7609.HEIC, skipping | 2024-09-27 13:06:51.310253 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/2D9ACE33-7545-405B-99B0-6D79DAE8B9F1_L0_001_1727109796.486016_o_IMG_7610.HEIC, skipping | 2024-09-27 13:06:51.310251 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/A78C2058-3612-4AD6-8E57-DCD72B4FC660_L0_001_1727109796.474090_o_IMG_7611.HEIC, skipping | 2024-09-27 13:06:51.310248 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/6628B488-C80C-4373-869E-441EF5833801_L0_001_1727109796.444549_o_IMG_7612.HEIC, skipping | 2024-09-27 13:06:51.310245 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/C15310C2-1100-49BB-BB22-B8FA73DCCC3E_L0_001_1727332275.380634_o_IMG_7613.HEIC, skipping | 2024-09-27 13:06:51.310243 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/30E96907-27CA-4628-9E79-345DA6EF5700_L0_001_1727109796.458043_o_IMG_7614.HEIC, skipping | 2024-09-27 13:06:51.310238 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/67E9293E-398C-4398-89E9-B1C3FF1ABBDA_L0_001_1727109796.501016_o_IMG_7615.HEIC, skipping | 2024-09-27 13:06:51.310235 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/61D20E20-29B1-4929-9AE7-618712797420_L0_001_1727109796.502146_o_IMG_7616.HEIC, skipping | 2024-09-27 13:06:51.310232 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.video/E745F96A-2D58-4066-9C14-E55BDE5FC3C9_L0_001_1727109796.466586_o_IMG_7617.MOV, skipping | 2024-09-27 13:06:51.310230 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.video/D5BA2E04-7C65-4D16-8415-4A5D96FDF54A_L0_001_1727109796.475447_o_IMG_7618.MOV, skipping | 2024-09-27 13:06:51.310227 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/CB7394BF-8EE9-4873-94C0-705BB66B46C0_L0_001_1727109796.454526_o_IMG_7619.HEIC, skipping | 2024-09-27 13:06:51.310224 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/9D6F6579-9B4C-49FE-A310-21276DB8BF10_L0_001_1727109796.468793_o_IMG_7620.HEIC, skipping | 2024-09-27 13:06:51.310222 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/5B75844E-17DD-42B7-BEBC-51B04308991D_L0_001_1727109796.482441_o_IMG_7621.HEIC, skipping | 2024-09-27 13:06:51.310219 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/DBF21CC1-CDA8-413A-AC4E-B9BF0773BA29_L0_001_1727109796.487720_o_IMG_7622.HEIC, skipping | 2024-09-27 13:06:51.310216 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/98CDEFB6-AF79-46A5-BA9D-4C5B12F633F3_L0_001_1727109796.467126_o_IMG_7623.HEIC, skipping | 2024-09-27 13:06:51.310214 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/21D0D122-04DC-460F-ACA8-D80CB193C5E5_L0_001_1726941404.685411_o_IMG_7624.PNG, skipping | 2024-09-27 13:06:51.310211 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/426FC6BD-D3E3-4A6E-95DC-D4139B17D7FA_L0_001_1727109796.495720_o_IMG_7625.HEIC, skipping | 2024-09-27 13:06:51.310209 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/8AFB3B97-9E4F-46FB-8935-BAA36DB8FD02_L0_001_1727109796.450998_o_IMG_7626.HEIC, skipping | 2024-09-27 13:06:51.310206 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/F9352738-D05A-4038-B064-985A5AA182CA_L0_001_1727332275.377222_o_IMG_7627.HEIC, skipping | 2024-09-27 13:06:51.310200 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/DCCC7B47-366C-4914-85AE-78E0EA8B768F_L0_001_1727109796.496303_o_IMG_7628.HEIC, skipping | 2024-09-27 13:06:51.310198 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/46B791E7-43B3-4EBE-A797-7E26CCD8294A_L0_001_1727109796.481847_o_IMG_7629.HEIC, skipping | 2024-09-27 13:06:51.310195 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/1483176D-908B-4D8D-A59E-ADC1741C2C2D_L0_001_1727109796.478398_o_IMG_7630.HEIC, skipping | 2024-09-27 13:06:51.310192 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/E95FDA27-A625-45ED-B9DF-0FBEF7CE5BFE_L0_001_1727109796.460333_o_IMG_7631.HEIC, skipping | 2024-09-27 13:06:51.310190 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/A5FFA9F4-EF85-4F4D-AFB0-C8B7EF9A564F_L0_001_1727109796.474722_o_IMG_7632.HEIC, skipping | 2024-09-27 13:06:51.310187 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/0DD828F9-9608-4C6E-9552-42594A641E1E_L0_001_1727109796.466025_o_IMG_7633.HEIC, skipping | 2024-09-27 13:06:51.310184 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/D613074C-724E-4B0A-93B1-31013757C225_L0_001_1727109796.462618_o_IMG_7634.HEIC, skipping | 2024-09-27 13:06:51.310182 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/C23A45B1-1AC4-40F1-A384-1586374382E8_L0_001_1727109796.443280_o_IMG_7635.HEIC, skipping | 2024-09-27 13:06:51.310179 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/1C0AEFE4-6760-400C-BDD8-27F06E42FE68_L0_001_1727109796.483652_o_IMG_7636.HEIC, skipping | 2024-09-27 13:06:51.310177 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/31E1CC61-3B39-41F0-9127-84D5AD9C5272_L0_001_1727109796.455086_o_IMG_7637.HEIC, skipping | 2024-09-27 13:06:51.310174 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/D4ACE6C5-55BC-4A3A-8BCF-A26FEA4F73EB_L0_001_1727109796.489471_o_IMG_7638.HEIC, skipping | 2024-09-27 13:06:51.310171 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/6EC837B8-5618-49D7-9D93-2272E960E2AB_L0_001_1727109796.484278_o_IMG_7639.HEIC, skipping | 2024-09-27 13:06:51.310168 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/FCA91416-8F1D-4359-894E-7D0C5435D574_L0_001_1727109796.446301_o_IMG_7640.HEIC, skipping | 2024-09-27 13:06:51.310162 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/F5AC8F6D-0C15-47DF-A39C-3EA5C184EEAA_L0_001_1727109796.472817_o_IMG_7641.HEIC, skipping | 2024-09-27 13:06:51.310155 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/917463BA-A7A3-485C-97BC-622700582DA3_L0_001_1727109796.471621_o_IMG_7642.HEIC, skipping | 2024-09-27 13:06:51.310152 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/18459578-ABBF-44CA-A726-508B94D73A51_L0_001_1727109796.472173_o_IMG_7643.HEIC, skipping | 2024-09-27 13:06:51.310149 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/E1D526C7-1679-42A3-ABAD-FE5488FF5080_L0_001_1727109796.443935_o_IMG_7644.HEIC, skipping | 2024-09-27 13:06:51.310146 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/E5B9F3DF-5D7D-4D6E-89B7-3E37216D918E_L0_001_1727109796.445134_o_IMG_7645.HEIC, skipping | 2024-09-27 13:06:51.310142 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/8B257205-1ED7-4BC2-9BD6-D894B24AB4CC_L0_001_1727109796.496872_o_FullSizeRender.jpg, skipping | 2024-09-27 13:06:51.310139 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/C43EE801-11C0-4096-A93E-B022CFA20AE1_L0_001_1727109796.471041_o_FullSizeRender.jpg, skipping | 2024-09-27 13:06:51.310134 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/5D259E5F-11CB-4853-B909-4550F93614FF_L0_001_1727109796.477205_o_FullSizeRender.jpg, skipping | 2024-09-27 13:06:51.310096 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/31DF2B1E-440B-48B5-982B-F7BEAE3C1297_L0_001_1727109796.498599_o_FullSizeRender.jpg, skipping | ```

Additional information

Note: I am unable to reproduce the issue multiple times on the same app, it seems like it fails once and after it just silently fails the backup, staying stuck loading. That said, it can be reproduced by deleting and reinstalling the app.

gaetschwartz avatar Sep 27 '24 10:09 gaetschwartz

Those are the files that the app doesn't have access or cannot read. It is usually the symptoms of assets from Shared Album that have been moved by other users or corrupted file

alextran1502 avatar Sep 27 '24 11:09 alextran1502

Right, when disabling related iCloud albums this works. We should find a way to not try to hash these files in the first place probably ?

gaetschwartz avatar Sep 27 '24 11:09 gaetschwartz

I think those files are no longer available but the database on iOS still have those records somehow

alextran1502 avatar Sep 27 '24 11:09 alextran1502

I am also facing the same problem! There are around 2-3K photos that the Immich app is unable to back up, resulting in a decrease in the total number of photos. For example, I deleted the app, reinstalled it, and logged back in. The first column shows the initial stats, while the second column represents the current state:

  • Total: 30,971 -> 27,818
  • Backup: 27,772 -> 27,810
  • Remainder: 3,199 -> 9

Now, whenever I open the app, it always shows me the current state, and it doesn't seem to attempt a re-backup.

I can see these errors in my app logs from the first time it skipped the photos:

Message Error getting file to hash for asset 9BDDD9F3-F909-45D8-85E9-EA3753D1F19F/L0/001, name: BF6CE792-BBA8-4432-BB24-2FA374D460B4.HEIC, created on: 2023-04-23 11:09:44.000, skipping

Details

PlatformException(CloudPhotoLibraryErrorDomain (1005), The operation couldn’t be completed. (CloudPhotoLibraryErrorDomain error 1005.), No failure reason provided, null)

From HashService

Stack Trace

#0      StandardMethodCodec.decodeEnvelope (package:flutter/src/services/message_codecs.dart:648)
#1      MethodChannel._invokeMethod (package:flutter/src/services/platform_channel.dart:334)
<asynchronous suspension>
#2      AssetEntity._getFile (package:photo_manager/src/types/entity.dart:750)
<asynchronous suspension>
#3      HashService._hashAssets (package:immich_mobile/services/hash.service.dart:77)
<asynchronous suspension>
#4      SyncService._addAlbumFromDevice (package:immich_mobile/services/sync.service.dart:704)
<asynchronous suspension>
#5      diffSortedLists (package:immich_mobile/utils/diff.dart:30)
<asynchronous suspension>
#6      SyncService._syncLocalAlbumAssetsToDb (package:immich_mobile/services/sync.service.dart:516)
<asynchronous suspension>
#7      AsyncMutex.run.<anonymous closure> (package:immich_mobile/utils/async_mutex.dart:15)
<asynchronous suspension>

https://github.com/user-attachments/assets/87ca6f77-2b25-4317-8b61-c16e0f75f63c

UmarFarooq-Ch avatar Oct 12 '24 18:10 UmarFarooq-Ch

same issue,I don't know how to fix it, I even tried to find the file in icloud, But no this file.

BenBenJian avatar Nov 26 '24 10:11 BenBenJian

Same issue here

PlatformException(PHPhotosErrorDomain (-1), The operation couldn’t be completed. (PHPhotosErrorDomain error -1.), No failure reason provided, null)

#0      StandardMethodCodec.decodeEnvelope (package:flutter/src/services/message_codecs.dart:648)
#1      MethodChannel._invokeMethod (package:flutter/src/services/platform_channel.dart:334)
<asynchronous suspension>
#2      AssetEntity._getFile (package:photo_manager/src/types/entity.dart:765)
<asynchronous suspension>
#3      HashService._hashAssets (package:immich_mobile/services/hash.service.dart:77)
<asynchronous suspension>
#4      SyncService._addAlbumFromDevice (package:immich_mobile/services/sync.service.dart:696)
<asynchronous suspension>
#5      diffSortedLists (package:immich_mobile/utils/diff.dart:34)
<asynchronous suspension>
#6      SyncService._syncLocalAlbumAssetsToDb (package:immich_mobile/services/sync.service.dart:508)
<asynchronous suspension>
#7      AsyncMutex.run.<anonymous closure> (package:immich_mobile/utils/async_mutex.dart:15)
<asynchronous suspension>

castanley avatar Dec 02 '24 02:12 castanley

I'm seeing the same as @castanley. Some other issues with "Remainder > 0" were caused by DNS or reverse proxy configurations, but I'm not having any error in my traefik logs - this really looks to be on the app side. I've also searched for the failing asset in iCloud but it doesn't seem to be there.

henriquevcosta avatar Jan 16 '25 23:01 henriquevcosta

@henriquevcosta there is a bug about Shared Album assets that were removed but somehow still present in the phone database and getting pulled. Do you know if the albums you selected for backup, any of them are Shared Album?

alextran1502 avatar Jan 17 '25 00:01 alextran1502

@henriquevcosta there is a bug about Shared Album assets that were removed but somehow still present in the phone database and getting pulled. Do you know if the albums you selected for backup, any of them are Shared Album?

Yes they are! I can try removing those from the sharing scope to see if it goes to zero, if you'd like. Happy to test things

henriquevcosta avatar Jan 17 '25 00:01 henriquevcosta

@henriquevcosta yes please if you can

alextran1502 avatar Jan 17 '25 01:01 alextran1502

OK I removed the shared albums from the "Albums to be backed up" part and that didn't seem to do much. I also pressed the "Sync" button in the Backup options screen (not sure what it does but it was worth a try) and also tried turning off/on backup altogether and restarting the app. Neither change did anything, those remainder are still there and the logs still show the same file names. If there's anything else you'd like me to test/inspect, let me know.

henriquevcosta avatar Jan 17 '25 02:01 henriquevcosta

@henriquevcosta you can try select the Recents album, then double tap on the Shared Albums, the assets will be excluded from the candidate list

alextran1502 avatar Jan 17 '25 02:01 alextran1502

@henriquevcosta you can try select the Recents album, then double tap on the Shared Albums, the assets will be excluded from the candidate list

Actually after my last message I was away from my phone for a while and when I came back it had synced everything, so I guess it's confirmation that it's the bug you mentioned?

henriquevcosta avatar Jan 17 '25 07:01 henriquevcosta

I was also getting this issue on app version 1.139.3 build.217, server version 1.139.4.

I removed the shared albums from my backup list, restarted the app, and that fixed it.

I'd much prefer to have my shared albums backed up, but this is better than nothing!

chrsgrhm avatar Aug 26 '25 18:08 chrsgrhm

Does this still happen with the new beta timeline?

bo0tzz avatar Sep 23 '25 09:09 bo0tzz