大禹

CUDA version error and generate nothing

1

I used "python demo_imitator.py --gpu_ids 0 --batch_size 1" to run the demo, but it warned "Error in forward_face_index_map_1: CUDA driver version is insufficient for CUDA runtime version, Error in forward_face_index_map_2:...

自定义了个工具查询天气，函数要求传入参数城市，请问怎么从用户的输入中提取出城市啊？

3

用户输入是正常的聊天，要求遇到天气相关的问题时调用该工具，不知道该咋把城市提取出来 @register_tool('search_weather') class SearchWeather(BaseTool): description = '天气查询' parameters = [{ 'name': 'prompt', 'type': 'string', 'description': '用中文回答城市的天气情况', 'required': True, }] def call(self, params: str, **kwargs) -> str: params = self._verify_json_format_args(params) print(111111)...

vllm能够直接调用gguf格式的权重吗

1

我使用04-Qwen2-7B-Instruct vLLM 部署调用.md里的调用方法，把模型权重换为gguf格式，报错，是要自己重新写调用方法吗

[Question]: How to solve the problem of logging in multiple accounts at the same time?

1

### Describe your problem You can only log in to one account at a time