KwaiAgents

KwaiAgents copied to clipboard

阿里云DSW环境，总是提示 The model's max seq len (8192) is larger than the maximum number of tokens that can be stored in KV cache (5392). Try increasing `gpu_memory_utilization` or decreasing `max_model_len` when initializing the engine.

1

KwaiKEG/kagentlms_qwen_7b_mat Qwen/Qwen-7B-Chat 两个都一样的提示。 尝试qwen1.5新版本，提示keyerror，qwen2

leeeex

提问后出现错误提示 AttributeError: module 'eventlet.green.select' has no attribute 'epoll'

1

kagentsys --query="刘德华老婆是谁？" --llm_name="kagentlms_qwen_7b_mat" --use_local_llm --local_llm_host="localhost" --local_llm_port=8899 --lang="zh" File "/opt/conda/lib/python3.10/site-packages/trio-0.24.0-py3.10.egg/trio/_core/_io_epoll.py", line 203, in EpollIOManager _epoll: select.epoll = attr.ib(factory=select.epoll) AttributeError: module 'eventlet.green.select' has no attribute 'epoll' --------------------------------- 还有就是：单卡模型推理服务 ，加载模型后隔一小段时间后就会崩溃，然后出现以下提示 ValueError: The model's...

leeeex

fix #28

Yimi81

web_search无法使用

9

Traceback (most recent call last): File "c:\users\user\desktop\kwaiagents-main\kwaiagents-main\kwaiagents\tools\search.py", line 119, in _retry_search_result if not search_results and counter >= 2: ^^^^^^^^^^^^^^ UnboundLocalError: cannot access local variable 'search_results' where it is not associated...

ZzzIKnow

如何向KAgentSys添加新的tool，有更详细的文档吗

rickeyhhh