sherry085

Cannot find OpenChat 3.5 1210 version

2

It seems that OpenChat 3.5 1210 is not open-source and not available on Hugging Face.

Why does the 8-GPUs experience a longer concurrent delay compared to the 2-GPUs?

2

I conducted concurrent processing tests on an RTX 3090 and the results showed that it takes longer for the 8-GPUs to process the same concurrent requests than 2-GPUs, and the...

Whether role supports system in api server

1

Hello @imoneoi , I would like to ask for your guidance on whether OpenChat 3.5 supports the usage of **"role": "system"** when calling with the OpenAI api format.

微调qwen后会循环输出

8

  ![Uploading image.png…]()