Qwen2-72B-Instruct-GPTQ-Int4 逻辑推理问题

Open Yue-Rain opened this issue 1 year ago • 1 comments

第一个问题，逻辑推理有问题；第二个问题，逻辑推理是正确的。 Qwen2-72B-Instruct-GPTQ-Int4 基于vllm默认参数部署的推理服务。有人碰到类似的问题吗？

Sep 03 '24 07:09 Yue-Rain

Hi, could you provide the full contexts for us to reproduce?

基于vllm默认参数

Do you mean the default of vllm or the default of Qwen2?

Sep 03 '24 08:09 jklj077

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

Feb 22 '25 08:02 github-actions[bot]