ms-agent icon indicating copy to clipboard operation
ms-agent copied to clipboard

本地部署疑问

Open XduSyL opened this issue 1 year ago • 4 comments

Initial Checks

  • [ ] I have searched GitHub for a duplicate issue and I'm sure this is something new
  • [ ] I have read and followed the docs & demos and still think this is a bug
  • [ ] I am confident that the issue is with modelscope-agent (not my code, or another library in the ecosystem)

What happened + What you expected to happen

请问一下,本地部署之后,怎么通过demo/demo_qwen_agent.ipynb 这个例子来使用呢,就是部署完成之后怎么通过实例化RolePlay,来调用本地部署完成的qwen-7b呢,我在这个目录(config/cfg_model_template.json)下 添加了 "qwen1.5-7b-chat": { "type": "openai", "model": "qwen/Qwen1.5-7B-Chat", "api_base": "http://localhost:8000/v1", "is_chat": true, "is_function_call": false } 之后,关掉api_key,然后再llm_config中修改为'qwen1.5-7b-chat' ,此时无法调用本地llm来运行

Versions / Dependencies

Reproduction script

Issue Severity

None

XduSyL avatar Apr 01 '24 08:04 XduSyL

参考这个例子:https://github.com/modelscope/modelscope-agent/blob/master/examples/llms/local_llm.ipynb

zzhangpurdue avatar Apr 15 '24 01:04 zzhangpurdue

参考这个例子:https://github.com/modelscope/modelscope-agent/blob/master/demo/demo_qwen_local_llm.ipynb

hi, 无法在代码仓库中找到这个demo文件

gudeyang1 avatar Apr 23 '24 08:04 gudeyang1

https://github.com/modelscope/modelscope-agent/blob/master/examples/llms/local_llm.ipynb 你好,由于本周做了example结构调整,还没来得及更新。

zzhangpurdue avatar Apr 23 '24 08:04 zzhangpurdue

本地使用modelscope-swift运行模型,这里使用本地方式方式调用接口,执行报错 image 调整了几种方式,都无法解决,求指教

etersin avatar May 07 '24 09:05 etersin