WrenAI icon indicating copy to clipboard operation
WrenAI copied to clipboard

using deepseek problem

Open wuhq7 opened this issue 10 months ago • 4 comments

Referred to the example in this place(https://github.com/Canner/WrenAI/blob/main/wren-ai-service/docs/config_examples/config.deepseek.yaml), and modified the pipeline configuration of 0.15.3, please help to see where there is a problem that needs to be modified

config.txt

env.txt

wrenai-wren-ai-service-1.txt

wuhq7 avatar Feb 15 '25 06:02 wuhq7

  1. embedder 配置要修改 deepseek 没有embedder 模型(本地部署 nomic-embed-text 模型)
#运行ollama server
OLLAMA_HOST="0.0.0.0" #设置这个环境变量
ollama pull nomic-embed-text
ollama serve
type: embedder
provider: litellm_embedder
models:
- model: openai/nomic-embed-text  # put your embedding model name here, if it is not openai embedding model, should be <provider>/<model_name>
  api_base: http://192.168.1.88:11434/v1  # change this according to your embedding model    
  #api_key_name: EMBEDDER_OLLAMA_API_KEY
  api_key_name: OPENAI_API_KEY
  timeout: 600
  1. type: document_store 的 embedding_model_dim 修改为 768
  2. deepseek 官方的api限流经常503体验不好

jos666 avatar Feb 24 '25 01:02 jos666

  1. embedder 配置要修改 deepseek 没有embedder 模型(本地部署 nomic-embed-text 模型)

#运行ollama server OLLAMA_HOST="0.0.0.0" #设置这个环境变量 ollama pull nomic-embed-text ollama serve type: embedder provider: litellm_embedder models:

  • model: openai/nomic-embed-text # put your embedding model name here, if it is not openai embedding model, should be /<model_name> api_base: http://192.168.1.88:11434/v1 # change this according to your embedding model
    #api_key_name: EMBEDDER_OLLAMA_API_KEY api_key_name: OPENAI_API_KEY timeout: 600
  1. type: document_store 的 embedding_model_dim 修改为 768
  2. deepseek 官方的api限流经常503体验不好

哥能不能加个微信DDD-527 请教一下。 @jos666

wuhq7 avatar Feb 27 '25 08:02 wuhq7

Referred to the example in this place(https://github.com/Canner/WrenAI/blob/main/wren-ai-service/docs/config_examples/config.deepseek.yaml), and modified the pipeline configuration of 0.15.3, please help to see where there is a problem that needs to be modified

config.txt

env.txt

wrenai-wren-ai-service-1.txt

@wuhq7 你这个问题解决了吗?

zhenglu696 avatar Mar 27 '25 09:03 zhenglu696

Image

利用deepseek模型,我这边也报错

zhenglu696 avatar Mar 27 '25 10:03 zhenglu696