GPS Coordinates Are Not Correct If Coordinate Direction Is In Separate Field when using external XMP file

[BigCheeZ]

The bug

This is the same issue as reported in issue 3540 except that I'm reporting it for when external XMP files are used with media (eg: image0.jpg and image0.jpg.xmp) using External Libraries. The linked ticket is fixed, but it seems it was only fixed for when the data is embedded in the media file.

I've attached a zip file with a JPG and XMP file that show the issue. The JPG actually has the accurate EXIF data inside the file. The XMP files does too, but when it is parsed by Immich it results in the location being shown as Nepal (see below) instead of Orlando, FL USA because GPSLongitudeRef is not being handled appropriately.

Birendranagar Surkhet, Karnali Pradesh Nepal

immich-xmp-test.zip

I understand that if I did not use the external XMP file then the location would be properly extracted from the JPG. I have other data in the XMP file from previous applications I've used that I do not want to lose.

I have tried:

• Syncing Sidecar Metadata in Jobs tab
• Extract Metadata (All) in Jobs tab
• Force re-scan all Library files from Settings >> Libraries

The OS that Immich Server is running on

Docker on NixOS 23.05

Version of Immich Server

v1.93.3

Version of Immich Mobile App

v1.93.0 build.134

Platform with the issue

• [X] Server
• [ ] Web
• [ ] Mobile

Your docker-compose.yml content

---
version: "3.8"

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    command: [ "start.sh", "immich" ]
    volumes:
      - ${IMMICH_ROOT}/uploads:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
      - <my_external_library_mount>:/mnt/media/icloud:ro
    env_file:
      - .env
    depends_on:
      - redis
      - database
    restart: always
    networks:
      - luna-compose_caddynet
      - immich-net
    labels:
      caddy: "photos.${MY_DOMAIN}"
      caddy.reverse_proxy: "{{upstreams 3001}}"
      caddy.tls.dns: "cloudflare ${CLOUDFLARE_API_TOKEN}"

  immich-microservices:
    container_name: immich_microservices
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    command: [ "start.sh", "microservices" ]
    volumes:
      - ${IMMICH_ROOT}/uploads:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
      - <my_external_library_mount>:/mnt/media/icloud:ro
    env_file:
      - .env
    depends_on:
      - redis
      - database
    restart: always
    networks:
      - immich-net

  immich-machine-learning:
    container_name: immich_machine_learning
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    volumes:
      - ${IMMICH_ROOT}/model-cache:/cache
    env_file:
      - .env
    restart: always
    networks:
      - immich-net

  redis:
    container_name: immich_redis
    image: redis:6.2-alpine@sha256:70a7a5b641117670beae0d80658430853896b5ef269ccf00d1827427e3263fa3
    env_file:
      - .env
    restart: always
    networks:
      - immich-net

  database:
    container_name: immich_postgres
    image: tensorchord/pgvecto-rs:pg14-v0.1.11
    env_file:
      - .env
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
    volumes:
      - ${IMMICH_ROOT}/pgdata:/var/lib/postgresql/data
    restart: always
    networks:
      - immich-net

networks:
  luna-compose_caddynet:
    external: true
  immich-net:
    attachable: true
    driver: bridge

Your .env content

IMMICH_VERSION=v1.93.3

Reproduction steps

1. Create an External Library using the JPG and associated XMP in the zip file linked in the ticket
2. After image is added to Immich open it in web view and see that GPS is incorrect

Additional information

No response

[Kia0ra]

Hello,

I seem to have the same problem with sidecar data not loading or loading incorrectly with an external gallery and XMP files.

Example : exif:PixelXDimension="4368" exif:PixelYDimension="2912" exif:GPSLatitude="42,6.51768S" exif:GPSLongitude="171,20.16774E" exif:GPSVersionID="2.2.0.0" exif:GPSAltitude="200000/10000"

Wrong file resolution and no GPS data are shown immich_xmp_fail_to_import.zip

[BigCheeZ]

@Kia0ra your issue looks to be a naming issue.

See https://immich.app/docs/features/xmp-sidecars/

When importing files via the CLI bulk uploader, Immich will automatically detect XMP sidecar files as files that exist next to the original media file and have the exact same name with an additional .xmp file extension (i.e., PXL_20230401_203352928.MP.jpg and PXL_20230401_203352928.MP.jpg.xmp).

In the zip you attached you have:

• IMG_5090.CR2
• IMG_5090.JPG
• IMG_5090.xmp

[Kia0ra]

Ok I see but this is Lightroom's default behavior, I imagined it could also be taken into account in Immich. It doesn't explain why the resolution of the RAW file isn't extracted correctly.

[waclaw66]

I have checked your issue and there's nothing to blame Immich. Seems to be the similar issue as https://github.com/photostructure/exiftool-vendored.js/issues/165 of upstream library.

[waclaw66]

It turned out it's an issue of exiftool itself. Opened an issue... https://exiftool.org/forum/index.php?topic=15622.0

[BigCheeZ]

@waclaw66 thanks for the effort! From looking at the comments on the forum post it seems I will need to modify my existing XMP files. That's not a big problem for me since I am not syncing them back upstream anywhere. FYI, I did use the Apple Photos app for creating the XMP files.

I am a little confused about how the embedded-XMP issue, https://github.com/immich-app/immich/issues/3540, was fixed. If embedded-XMP data is read by exiftool then would it not have the same issue since it seems the Ref fields are not being used per the spec?

[MrColumbo]

I once opened this one Wrong location on map #4340 ...not sure if that is related but at least even with the latest version immich is still showing the wrong map location. I never as able to see the XMP data by using exiftool in the example of the lizzeard picture ..I once thought i might do a batch thing to just remove the XMP data ...

[Bluish9428]

I'm having the exact same issue. Just tried to migrate my library from Apple Photos with GPS stored in XMP and all my photos are mapped to very incorrect places.

[BigCheeZ]

@Bluish9428 there is a command provided from the https://exiftool.org/forum/index.php?topic=15622.0 post that fixed the issue for me. It will modify your XMP files to match the standard and work with Immich. If you're exporting from Apple Photos once, then this will likely work for you.

Specifically, it is this post: https://exiftool.org/forum/index.php?msg=83953

[Bluish9428]

Thanks, I'll give that a try! It would be nice if this was built in for less technical people in the future, but glad there is a workaround.