ms-agent

ms-agent copied to clipboard

请问怎么评估模型的效果呢？

1

Maybewuss

import flash_attn rotary fail

2

背景：在本地部署ModelScope-Agent-7B，机器为nvidia的A100，速度特别慢，chat一次平均耗时18秒 已经按照[https://modelscope.cn/models/iic/ModelScope-Agent-7B/summary的步骤安装了flash-attention==2.3.5、layer_norm、rotary-embedding-torch==0.5.3] 启动ModelScope-Agent-7B 还是报：Warning: import flash_attn rotary fail, please install FlashAttention rotary to get higher efficiency https://github.com/Dao-AILab/flash-attention/tree/main/csrc/rotary

cnahmgx

## Change Summary ## Related issue number ## Checklist * [ ] The pull request title is a good summary of the changes - it will be used in the...

Zhikaiiii

bugfix and feature

2

1. add traceback info when call llm failed at the retry decorator; 2. add zhipu function call at the no_stream mode; 3. remove useless code;

jiaqianjing

## Change Summary ## Related issue number ## Checklist * [ ] The pull request title is a good summary of the changes - it will be used in the...

suluyana

## Change Summary ## Related issue number ## Checklist * [ ] The pull request title is a good summary of the changes - it will be used in the...

lcl6679292

能否增加返回结果的状态，类似langchain的Callbacks/Streaming tokens

1

### Initial Checks - [X] I have searched Google & GitHub for similar requests and couldn't find anything - [X] I have read and followed [the docs & demos](https://github.com/modelscope/modelscope-agent/tree/master/demo) and...

supercocoa

无代码创建Agent，使用GLM4的企业api_key 和api_base， 问答无回复。

3

我用mofelscope社区搭了一个简单的agent，线上一切正常。本地把代码下载下来后正常运行了 。 模型用的是企业版本的glm4。使用企业的key，需要修改api_key 和base_url。我真对zhipu.py进行了修改 修改后， agent无回复  且无任何报错 换成我个人的glm4 api _key 就没有问题了， agent就可以正常回复

zhangyukun230

智能体编排

5

### Initial Checks - [X] I have searched Google & GitHub for similar requests and couldn't find anything - [X] I have read and followed [the docs & demos](https://github.com/modelscope/modelscope-agent/tree/master/demo) and...

401557122

[framework] AgentFabric local deploy has memory leak

1

### Initial Checks - [X] I have searched GitHub for a duplicate issue and I'm sure this is something new - [X] I have read and followed [the docs &...

fire7night