immich-go icon indicating copy to clipboard operation
immich-go copied to clipboard

Upload to immich "from-folder" discards all files

Open towerplease opened this issue 1 month ago • 9 comments

Hey there,

i am currently testing the import of a lot of fotos from my NAS to immich. Therefore i installed a small testing instance of immich.

So, i ran this command, to try to upload a bunch of fotos/videos:

.\immich-go upload from-folder --server=http://rpi5-01.asbach.lan:2283 --api-key=XXXXXXXXXXXXXXXXXXXXX--concurrent-uploads=4 M:\Bilder

The Process starts, scanning all data correctly, but discards ALL files with "reason=extension not included"

Image

I got it working with either defining --include-extensions=.jpg,.jpeg,.png,.mp4,.heic or run it twice with --include-type=VIDEO and --include-type=IMAGE

As the documentation states, i would expect that all files are taken for upload when no include or exclude is given.

Is this a bug of some kind?

Thank you in advance

towerplease avatar Oct 07 '25 10:10 towerplease

Thanks for the report. This a pre-version still not properly tested. Did you try with the last stable version?

simulot avatar Oct 08 '25 07:10 simulot

I have the same issue, I also tested last stable release with same result

command immich-go upload from-folder --server=http://192.168.1.120:2283 --api-key=xxx --include-extensions=all --concurrent-uploads=8 /Users/me/Pictures/UploadPhotos

parts of log file:

2025-10-08 10:01:04 INF immich-go version:0.28.0, commit:8300f4f1ad617ab013e6f1180b4008019a014d2e, date:2025-09-22T09:00:04Z 2025-10-08 10:01:04 INF Running environment: architecture=amd64 os=darwin 2025-10-08 10:01:04 INF Command: immich-go upload from-folder 2025-10-08 10:01:04 INF Flags: 2025-10-08 10:01:04 INF --admin-api-key= 2025-10-08 10:01:04 INF --album-path-joiner= / 2025-10-08 10:01:04 INF --album-picasa=false 2025-10-08 10:01:04 INF --api-key=************************************** 2025-10-08 10:01:04 INF --api-trace=false 2025-10-08 10:01:04 INF --ban-file='@eaDir/', '@_thumb/', 'SYNOFILE_THUMB.', 'Lightroom Catalog/', 'thumbnails/', '.DS_Store/', '/._*', '.photostructure/' 2025-10-08 10:01:04 INF --client-timeout=20m0s 2025-10-08 10:01:04 INF --concurrent-uploads=8 2025-10-08 10:01:04 INF --date-from-name=true 2025-10-08 10:01:04 INF --date-range=unset 2025-10-08 10:01:04 INF --device-uuid=192.168.1.5 2025-10-08 10:01:04 INF --dry-run=false 2025-10-08 10:01:04 INF --exclude-extensions= 2025-10-08 10:01:04 INF --folder-as-album=NONE 2025-10-08 10:01:04 INF --folder-as-tags=false 2025-10-08 10:01:04 INF --help=false 2025-10-08 10:01:04 INF --ignore-sidecar-files=false 2025-10-08 10:01:04 INF --include-extensions=all 2025-10-08 10:01:04 INF --include-type= 2025-10-08 10:01:04 INF --into-album= 2025-10-08 10:01:04 INF --log-file=/Users/me/Library/Caches/immich-go/immich-go_2025-10-08_10-01-04.log 2025-10-08 10:01:04 INF --log-level=INFO 2025-10-08 10:01:04 INF --log-type=text 2025-10-08 10:01:04 INF --manage-burst=NoStack 2025-10-08 10:01:04 INF --manage-epson-fastfoto=false 2025-10-08 10:01:04 INF --manage-heic-jpeg=NoStack 2025-10-08 10:01:04 INF --manage-raw-jpeg=NoStack 2025-10-08 10:01:04 INF --no-ui=false 2025-10-08 10:01:04 INF --on-server-errors=stop 2025-10-08 10:01:04 INF --overwrite=false 2025-10-08 10:01:04 INF --pause-immich-jobs=true 2025-10-08 10:01:04 INF --recursive=true 2025-10-08 10:01:04 INF --server=http://192.168.1.120:2283 2025-10-08 10:01:04 INF --session-tag=false 2025-10-08 10:01:04 INF --skip-verify-ssl=false 2025-10-08 10:01:04 INF --tag=[] 2025-10-08 10:01:04 INF --time-zone= 2025-10-08 10:01:04 INF Arguments: 2025-10-08 10:01:04 INF "/Users/me/Pictures/UploadPhotos" 2025-10-08 10:01:04 INF Connection to the server http://192.168.1.120:2283 2025-10-08 10:01:05 INF Server status: OK 2025-10-08 10:01:05 INF Server information: version=v2.0.1 2025-10-08 10:01:05 INF Connected, user: xxxx, ID: xxxxx 2025-10-08 10:01:05 INF Immich Job command sent pause=thumbnailGeneration 2025-10-08 10:01:05 INF Immich Job command sent pause=metadataExtraction 2025-10-08 10:01:05 INF Immich Job command sent pause=videoConversion 2025-10-08 10:01:05 INF Immich Job command sent pause=faceDetection 2025-10-08 10:01:05 INF Immich Job command sent pause=smartSearch

2025-10-08 09:45:09 INF scanned image file file=UploadPhotos:20150319_145222.jpg 2025-10-08 09:45:09 WRN discarded file file=UploadPhotos:20150319_145222.jpg reason=extension not included

2025-10-08 09:45:14 INF Input analysis: 2025-10-08 09:45:14 INF --------------- 2025-10-08 09:45:14 INF scanned image file : 2380 2025-10-08 09:45:14 INF scanned video file : 70 2025-10-08 09:45:14 INF scanned sidecar file : 0 2025-10-08 09:45:14 INF discarded file : 2450 2025-10-08 09:45:14 INF unsupported file : 0 2025-10-08 09:45:14 INF file duplicated in the input : 0 2025-10-08 09:45:14 INF associated metadata file : 0 2025-10-08 09:45:14 INF missing associated metadata file : 0

TeaPack97 avatar Oct 08 '25 08:10 TeaPack97

Good i am not the only one experiencing this :)

I also tested further. I finally was able to download my google takeout-files and began testing the upload to my testinstance. With the command: .\immich-go upload from-google-photos --server=http://rpi5-01.asbach.lan:2283 --api-key=XXXX C:\Users\ammer\Downloads\takeout-*.zip There was no issue and all files (well except 5) were taken and uploaded as expected.

Image

Seems like the issue is only occuring with "from-folder". Further info: I am using this within windows.

towerplease avatar Oct 08 '25 13:10 towerplease

Same problem in the linux release 0.29.2-dev-3d89bdd

j4nk00 avatar Oct 12 '25 17:10 j4nk00

same problem with 0.29.2-dev-3d89bdd on macOS, trying to upload .MP4 files.

my full command:

./immich-go upload from-folder a6700 --no-ui --recursive --session-tag --tag volume/a6700 --manage-burst Stack --manage-heic-jpeg StackCoverHeic --manage-raw-jpeg StackCoverJPG --log-type JSON --log-file logs/2025-10-12-immich-go-m.jsonl --pause-immich-jobs=false --server "$IMMICH_URL" --api-key "$IMMICH_API_KEY"

finds files but logs sa: "msg":"discarded file","file":"a6700:private/M4ROOT/CLIP/C0092.MP4","reason":"extension not included"

stable v0.28.0 works

niieani avatar Oct 12 '25 22:10 niieani

Pushed a fix in #1130

niieani avatar Oct 13 '25 00:10 niieani

Good i am not the only one experiencing this :)

I also tested further. I finally was able to download my google takeout-files and began testing the upload to my testinstance. With the command: .\immich-go upload from-google-photos --server=http://rpi5-01.asbach.lan:2283 --api-key=XXXX C:\Users\ammer\Downloads\takeout-*.zip There was no issue and all files (well except 5) were taken and uploaded as expected.

Image Seems like the issue is only occuring with "from-folder". Further info: I am using this within windows.

i had the exact same thing with latest release 0.29.2 and had to change from archive to google photos. thanks for putting the google photos command

carlos-garcia avatar Oct 14 '25 02:10 carlos-garcia

I've just been uploading today into a new immich installation and getting a lot of discrded. So I read your explanation above, but I'm not understanding if that actually discarded all these pictures, or it just said it did. Do I have to re-do all my uploadsd? And can I, will there be hash issues? Using immich-go version 0.28.0.

My command:

./immich-go upload from-folder --server=http://192.168.1.103:8212/ --api-key=xxxxxxxxxxxxxxxxxxxx --into-album Boys --exclude-extensions .xmp,.json,.xml,.ini,.db,.nfo,.tmp,.part,.bak,.swp,.ARW,.CR2,.CR3,.NEF,.RAF,.ORF,.RW2,.DNG,.mts,.m2ts,.ts,.vob /volume1/photo/Boys Image

harryfine avatar Oct 25 '25 20:10 harryfine

My bad. I jumped the gun and made assumptions. There were a load of files put there by synology.

Input analysis:

scanned image file : 608 scanned video file : 383 scanned sidecar file : 0 discarded file : 920 unsupported file : 0 file duplicated in the input : 22 associated metadata file : 0 missing associated metadata file : 0

Uploading:

uploaded : 774 upload error : 0 file not selected : 0 server's asset upgraded with the input : 3 server has same asset : 175 server has a better asset : 1

harry1@Solutions:/volume1/photo/Rob and Jody Wedding$ find '/volume1/photo/Rob and Jody Wedding' -type f | wc -l
1987

But then:

harry1@Solutions:/volume1/photo/Rob and Jody Wedding$ find /volume1/photo -type f -name "SYNOINDEX_MEDIA_INFO" -delete

harry1@Solutions:/volume1/photo/Rob and Jody Wedding$ find '/volume1/photo/Rob and Jody Wedding' -type f | wc -l
1083

harryfine avatar Oct 26 '25 13:10 harryfine