AnyCrawl icon indicating copy to clipboard operation
AnyCrawl copied to clipboard

very confused about the environment variable configuration for AI features.

Open lvsao opened this issue 3 months ago • 1 comments

Especially this statement: "Connect the provider name and the model name with a ">", such as openai:gpt-4o-mini, openrouter:openai/gpt-4o-mini" The text says to use ">", but the examples show ":". I've actually tried both formats, but neither seems to successfully enable the LLMs-related functionality. My configuration file is:

# AI feature
ANYCRAWL_AI_CONFIG_PATH=
# if set ANYCRAWL_AI_CONFIG_PATH, the coming ai env will be disabled.
# AI for extracting
# format: openai>gpt-40
# Connect the provider name and the model name with a ">", such as openai:gpt-4o-mini, openrouter:openai/gpt-4o-mini
DEFAULT_LLM_MODEL=custom>glm-4.5-air
DEFAULT_EXTRACT_MODEL=custom>glm-4.5-air

# Support configuring many providers, and decide by model name.
# Provide your OpenAI API key here to enable AI features
#OPENAI_API_KEY=

# OpenRouter
# OPENROUTER_API_KEY=

# OpenAI-compatible API, the provider name is: "custom"
OPENAI_COMPATIBLE_BASE_URL=https://open.bigmodel.cn/api/paas/v4
OPENAI_COMPATIBLE_API_KEY=xxxxxxxxxxxxxxxxxxxxxxxxxxxxx

ANYCRAWL_EXTRACT_JSON_CREDITS=5

lvsao avatar Sep 03 '25 06:09 lvsao

Hi, thanks for your feedback.

The current env should be like:

DEFAULT_LLM_MODEL=custom/glm-4.5
DEFAULT_EXTRACT_MODEL=custom/glm-4.5
DEFAULT_EMBEDDING_MODEL=


CUSTOM_BASE_URL=https://open.bigmodel.cn/api/paas/v4
CUSTOM_API_KEY=xxx

ANYCRAWL_EXTRACT_JSON_CREDITS=5

And, you need to comment ANYCRAWL_AI_CONFIG_PATH

Image

QThans avatar Sep 03 '25 09:09 QThans