WrenAI icon indicating copy to clipboard operation
WrenAI copied to clipboard

for embeddibg model does hugginface model support

Open anshulpwappgo opened this issue 4 months ago • 0 comments

in config.yaml

type: embedder
provider: litellm_embedder
models:
  # We are now using the direct Hugging Face provider via LiteLLM.
  - model: huggingface/sentence-transformers/all-MiniLM-L6-v2
    alias: default
    api_key: ${HF_TOKEN}
    timeout: 600

i got the error of unauthorization 401

and in docker-compose.yaml:

  wren-ai-service:
    image: ghcr.io/canner/wren-ai-service:${WREN_AI_SERVICE_VERSION}
    restart: on-failure
    platform: ${PLATFORM}
    expose:
      - ${WREN_AI_SERVICE_PORT}
    ports:
      - ${AI_SERVICE_FORWARD_PORT}:${WREN_AI_SERVICE_PORT}
    # We now manually list every variable EXCEPT HF_TOKEN to prevent the startup crash.
    environment:
      PYTHONUNBUFFERED: 1
      CONFIG_PATH: /app/config.yaml
      GROQ_API_KEY: ${GROQ_API_KEY}
      LANGFUSE_SECRET_KEY: ${LANGFUSE_SECRET_KEY}
      LANGFUSE_PUBLIC_KEY: ${LANGFUSE_PUBLIC_KEY}
      # Notice HF_TOKEN is MISSING from this list.
    # We REMOVED the env_file directive.
    volumes:
      - ${PROJECT_DIR}/config.yaml:/app/config.yaml:ro
      - ${PROJECT_DIR}/data:/app/data:ro
    networks:
      - wren
    depends_on:
      - qdrant

anshulpwappgo avatar Aug 21 '25 08:08 anshulpwappgo