immich-go icon indicating copy to clipboard operation
immich-go copied to clipboard

Missing file

Open macminoz opened this issue 1 year ago • 9 comments

hi, during the massive importing data, I notice several log like this:

INFO | server has same asset | file=1946/11/VID_20121102_090926.mp4 info="the server has this file" time="2024-11-07T12:11.21 CET"
INFO | server has same asset | file=1946/11/VID_20121104_101048.mp4 info="the server has this file" time="2024-11-07T12:11.22 CET"

but if I start looking at the upload folder, this file is missing. What can I do ? Of course this mp4 isn't available under the gallery and so the research:

me@NAS:/volume1/IMMICH-MASTER-CATALOG_20Ott24/$ find . | grep -i VID_20121102_090926.mp4
me@NAS:/volume1/IMMICH-MASTER-CATALOG_20Ott24/$

I have the feeling that the immich-go consider this file similar to another with the same creation time :

me@beorn ~ % ffmpeg -i VID_20121102_090926.mp4 -dump | grep -i creation_time
creation_time : 2012-11-02T08:09:43.000000Z

Where this file is located ?

macminoz avatar Nov 07 '24 23:11 macminoz

Immich renames files with an id before storing them. The find . is helpless. You can use the immich's image search to locate the file on immich. On details, you get the actual path: image

Immich-go gets the list of uploaded files with their name, date and length before processing the input. File with same attributes are discarded from the import with that message. If you have duplicates in your data set, you'll get the same message as well for the 2nd occurrence of the file.

simulot avatar Nov 08 '24 09:11 simulot

If you use Storage template you should be able to keep the image filename. https://immich.app/docs/administration/storage-template/

image

redge76 avatar Nov 08 '24 10:11 redge76

Immich renames files with an id before storing them. The find . is helpless. You can use the immich's image search to locate the file on immich. On details, you get the actual path: image

Immich-go gets the list of uploaded files with their name, date and length before processing the input. File with same attributes are discarded from the import with that message. If you have duplicates in your data set, you'll get the same message as well for the 2nd occurrence of the file.

I'm not able to find even with the Image Search. I looked it via Name or with Creation Date but I cannot find it. What I have to do? thanks

macminoz avatar Nov 11 '24 00:11 macminoz

If you use Storage template you should be able to keep the image filename. https://immich.app/docs/administration/storage-template/

image

nope, same story :(

image

macminoz avatar Nov 11 '24 00:11 macminoz

Have you checked the log files?

simulot avatar Nov 11 '24 06:11 simulot

where ? I only noticed logs from immich-go importer (on the first post)

macminoz avatar Nov 11 '24 10:11 macminoz

It's not possible to have a good understanding with this small context.

This message can be also returned by the server when it has already got the same binary, whatever is name. The file could be also in the immich's trash can.

simulot avatar Nov 11 '24 10:11 simulot

checked also there...it's a mystery. What I'm trying to do is avoid any data loss because of "the server has this file" message before deleting from a sparse archive. I'm trying the immich-cli right now but it's very slow (especially for 250K pictures and 9K videos). Keep you posted! Thanks

macminoz avatar Nov 11 '24 16:11 macminoz

As far as I know immich-cli pushes all files to the server and let it deciding if it's a duplicate or not. So, it's more precise, but way slower.

simulot avatar Nov 11 '24 16:11 simulot