manyfold icon indicating copy to clipboard operation
manyfold copied to clipboard

UTF-8 error scanning files

Open pinkfloydFR opened this issue 3 months ago • 2 comments

Hi,

I store my STL file in a disk managed by openmediavault. This drive is mounted on my docker host, Ubuntu 22.04. After configuring the librairies, with "/libraries/06_STL", manyfold found 0 stl file "Désolé, nous n'avons rien à vous montrer ! Essayez de modifier les filtres ou les termes de recherche, ou de télécharger des modèles."

Image

Here is my docker compose :

  manyfold:
    image: ghcr.io/manyfold3d/manyfold-solo:latest
    restart: unless-stopped
    container_name: manyfold
    ports:
      - 3214:3214
    volumes:
      - ./config:/config
      - /mnt/docs/Impression_3D:/libraries
    environment:
      SECRET_KEY_BASE: a_nice_long_random_string_denis49
      TZ: "Europe/Paris"
    labels:
      - traefik.enable=true
      - traefik.docker.network=traefik
      - traefik.http.routers.manyfold.rule=Host(`manyfold.xxxxx.com`)
      - traefik.http.routers.manyfold.entrypoints=websecure
      - traefik.http.routers.manyfold.service=yourls
      - traefik.http.routers.manyfold.tls=true
      - traefik.http.routers.manyfold.middlewares=crowdsec-bouncer@docker,sslheader@docker
      - traefik.http.middlewares.sslheader.headers.customrequestheaders.X-Forwarded-Proto=https
      - traefik.http.services.manyfold.loadbalancer.server.port=3214
    networks:
      manyfold:
      traefik:

networks:
  manyfold:
    name: manyfold
    driver_opts:
      com.docker.network.bridge.name: br-manyfold
  traefik:
    external: true

What i see in the log :

12:45:53 default_worker.1 | INFO 2025-11-08T11:45:53.277Z pid=148 tid=hro context=Job raised exception job={"retry" => 10, "queue" => "scan", "wrapped" => "Scan::Library::DetectFilesystemChangesJob", "args" => [{"job_class" => "Scan::Library::DetectFilesystemChangesJob", "job_id" => "6609c4a4-56b1-4797-aedc-bf4659f1c5f5", "provider_job_id" => nil, "queue_name" => "scan", "priority" => nil, "arguments" => [2], "executions" => 0, "exception_executions" => {}, "locale" => "fr", "timezone" => "UTC", "enqueued_at" => "2025-11-08T11:44:10.718117466Z", "scheduled_at" => "2025-11-08T11:44:10.685953561Z"}], "class" => "Sidekiq::ActiveJob::Wrapper", "jid" => "f09d97f27d8eb899078ffd61", "created_at" => 1762602250718, "enqueued_at" => 1762602352696, "error_message" => "invalid byte sequence in UTF-8", "error_class" => "ArgumentError", "failed_at" => 1762602251335, "retry_count" => 2, "retried_at" => 1762602312074}: invalid byte sequence in UTF-8 (ArgumentError)

Inside manyfold docker :

Image

So manyfold ACCESS my folder, and tested to create a new folder with success too...

Thanks for helping !

pinkfloydFR avatar Nov 08 '25 11:11 pinkfloydFR

Thanks to IA claude, found my problem !

  • Adding in environment :
LANG: "fr_FR.UTF-8"
LC_ALL: "fr_FR.UTF-8"
  • Then using convmv :
apt-get install convmv

# Convertir les noms de fichiers en UTF-8
convmv -f ISO-8859-1 -t UTF-8 -r /mnt/docs/Impression_3D --notest

Restarting manyfold, and the scan is working !

pinkfloydFR avatar Nov 08 '25 12:11 pinkfloydFR

That's interesting, implies some UTF8 file system problem, perhaps something I should look into... glad you got it sorted, but I think perhaps there's an underlying bug.

Floppy avatar Nov 08 '25 13:11 Floppy