MetaGPT icon indicating copy to clipboard operation
MetaGPT copied to clipboard

请问如何配置本地部署的大模型来使用呢?

Open DominicRen opened this issue 1 year ago • 2 comments

Feature description

Your Feature

DominicRen avatar Jun 28 '24 07:06 DominicRen

参考文档中的【ollama-api】部分 https://docs.deepwisdom.ai/main/en/guide/get_started/configuration/llm_api_configuration.html#ollama-api

voidking avatar Jul 02 '24 11:07 voidking

Finished call to 'metagpt.actions.action_node.ActionNode._aask_v1' after 123.000(s), this was the 6th time calling it. exp: RetryError[<Future at 0x1cfc23fd350 state=finished raised JSONDecodeError>] 本地模型调用会报这个错误

liuxymm avatar Jul 12 '24 10:07 liuxymm

@liuxymm Do you still have the problem, what's your content of config2.yaml?

better629 avatar Oct 09 '24 17:10 better629

@liuxymm The JSONDecodeError usually dues to the small size llm json output following ability(it can't output complete json). Maybe you should try a larger model.

better629 avatar Oct 10 '24 14:10 better629