UTF-8 error scanning files
Hi,
I store my STL file in a disk managed by openmediavault. This drive is mounted on my docker host, Ubuntu 22.04. After configuring the librairies, with "/libraries/06_STL", manyfold found 0 stl file "Désolé, nous n'avons rien à vous montrer ! Essayez de modifier les filtres ou les termes de recherche, ou de télécharger des modèles."
Here is my docker compose :
manyfold:
image: ghcr.io/manyfold3d/manyfold-solo:latest
restart: unless-stopped
container_name: manyfold
ports:
- 3214:3214
volumes:
- ./config:/config
- /mnt/docs/Impression_3D:/libraries
environment:
SECRET_KEY_BASE: a_nice_long_random_string_denis49
TZ: "Europe/Paris"
labels:
- traefik.enable=true
- traefik.docker.network=traefik
- traefik.http.routers.manyfold.rule=Host(`manyfold.xxxxx.com`)
- traefik.http.routers.manyfold.entrypoints=websecure
- traefik.http.routers.manyfold.service=yourls
- traefik.http.routers.manyfold.tls=true
- traefik.http.routers.manyfold.middlewares=crowdsec-bouncer@docker,sslheader@docker
- traefik.http.middlewares.sslheader.headers.customrequestheaders.X-Forwarded-Proto=https
- traefik.http.services.manyfold.loadbalancer.server.port=3214
networks:
manyfold:
traefik:
networks:
manyfold:
name: manyfold
driver_opts:
com.docker.network.bridge.name: br-manyfold
traefik:
external: true
What i see in the log :
12:45:53 default_worker.1 | INFO 2025-11-08T11:45:53.277Z pid=148 tid=hro context=Job raised exception job={"retry" => 10, "queue" => "scan", "wrapped" => "Scan::Library::DetectFilesystemChangesJob", "args" => [{"job_class" => "Scan::Library::DetectFilesystemChangesJob", "job_id" => "6609c4a4-56b1-4797-aedc-bf4659f1c5f5", "provider_job_id" => nil, "queue_name" => "scan", "priority" => nil, "arguments" => [2], "executions" => 0, "exception_executions" => {}, "locale" => "fr", "timezone" => "UTC", "enqueued_at" => "2025-11-08T11:44:10.718117466Z", "scheduled_at" => "2025-11-08T11:44:10.685953561Z"}], "class" => "Sidekiq::ActiveJob::Wrapper", "jid" => "f09d97f27d8eb899078ffd61", "created_at" => 1762602250718, "enqueued_at" => 1762602352696, "error_message" => "invalid byte sequence in UTF-8", "error_class" => "ArgumentError", "failed_at" => 1762602251335, "retry_count" => 2, "retried_at" => 1762602312074}: invalid byte sequence in UTF-8 (ArgumentError)
Inside manyfold docker :
So manyfold ACCESS my folder, and tested to create a new folder with success too...
Thanks for helping !
Thanks to IA claude, found my problem !
- Adding in environment :
LANG: "fr_FR.UTF-8"
LC_ALL: "fr_FR.UTF-8"
- Then using convmv :
apt-get install convmv
# Convertir les noms de fichiers en UTF-8
convmv -f ISO-8859-1 -t UTF-8 -r /mnt/docs/Impression_3D --notest
Restarting manyfold, and the scan is working !
That's interesting, implies some UTF8 file system problem, perhaps something I should look into... glad you got it sorted, but I think perhaps there's an underlying bug.