WrenAI icon indicating copy to clipboard operation
WrenAI copied to clipboard

How to use Zhipu AI GLM-4.5

Open xiatiandegaga opened this issue 5 months ago • 4 comments

1:the version is 0.26.0 2:env file: the name of key of Zhipu is OPENAI_API_KEY?

OPENAI_API_KEY=3ac6dc63f6ea482c9a12f17f353e4b71xxxUxxx

3:config

type: llm provider: litellm_llm models:

  • api_base: https://open.bigmodel.cn/api/paas/v4/ model: openai/glm-4.5 alias: default timeout: 900 kwargs: n: 1 temperature: 0.1 top_p: 0.8 extra_body: chat_template_kwargs: enable_thinking: false allowed_openai_params: ["extra_body"] # Force LiteLLM to allow extra_body

type: embedder provider: litellm_embedder models:

  • model: embedding-3 alias: default timeout: 120

only change the embedder as the embedding-3 of Zhipu,because I don‘t have the key of openai

Image

Failed to create asking task.

Image

xiatiandegaga avatar Aug 06 '25 03:08 xiatiandegaga

type: embedder provider: litellm_embedder models:

  • model: openai/embedding-3 alias: default timeout: 120

change from embedding-3 to openai/embedding-3 ,also can't work

xiatiandegaga avatar Aug 06 '25 04:08 xiatiandegaga

Moreover, there was a duplication of allowed_openai_params

lowpair avatar Aug 10 '25 14:08 lowpair

@xiatiandegaga @lowpair just released a new wren-ai-service version 0.27.4, you could change wren-ai-service image version in ~/.wrenai/.env and try again. Thanks

cyyeh avatar Aug 14 '25 06:08 cyyeh

thanks

xiatiandegaga avatar Aug 21 '25 05:08 xiatiandegaga