[<Agent component: framework|tool|llm|etc...>] ollama._types.ResponseError: pull model manifest: file does not exist

[mushenL]

Initial Checks

• [X] I have searched GitHub for a duplicate issue and I'm sure this is something new
• [X] I have read and followed the docs & demos and still think this is a bug
• [X] I am confident that the issue is with modelscope-agent (not my code, or another library in the ecosystem)

What happened + What you expected to happen

ollama._types.ResponseError: pull model manifest: file does not exist

Versions / Dependencies

modelscope 1.12.0 Python 3.8.18 Mac

Reproduction script

from modelscope_agent.agents import RolePlay

role_template = '你是一个agent小助手，你需要根据用户的要求来回答他们的问题' llm_config = { 'model': 'qwen2_7b_instruct_q5_k_m', 'model_server': 'ollama', } function_list = []

import pdb; pdb.set_trace()

bot = RolePlay(function_list=function_list,llm=llm_config, instruction=role_template)

response = bot.run("你好，请以李云龙的语气和我对话") text = '' for chunk in response: text += chunk print(text)

Issue Severity

None