Zenify

Failed to set multiple gpus

1

When using parallel computing with multiple GPUs, if I set "--num-gpus 4," only three GPUs are actually activated. How can I solve this issue?

请问有推荐的部署框架吗?

16

我查阅了几个LLM部署推理框架，目前似乎都不支持InternVL，请问项目组有推荐使用的框架吗？

### Is your feature request related to a problem? Please describe Yes, the current platform lacks support for the cutting-edge InternVL-Chat-V1.5 model, which limits the variety of state-of-the-art models available...

Very helpful research, great worI wanted to express my appreciation for the excellent work your team has done in contributing significantly to the evaluation of visual language models. Your paper...

Advanced-chat API returns empty metadata

7

### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing...

When the model_worker starts, the template parameter settings seem invalid.

2

My startup command is ``` python -m fastchat.serve.vllm_worker --model-path TheBloke/Nous-Capybara-34B-AWQ --trust-remote-code --tensor-parallel-size 2 --quantization awq --max-model-len 8192 --conv-template manticore ``` But I got the following output ``` "A chat between...

**Current Behavior** The `audiorecorder()` function only returns the recorded audio after stopping, without providing any way to detect when recording starts or stops. **Use Case** When starting a new recording,...