YAETHeryk
YAETHeryk
编程时偶然发现的,就多测试了几次,似乎即便模型能正确列出优先级顺序表,它依然会固执地认为^运算符应该先于+运算。 1.    2.     Qwen2-7B-Instruct-GPTQ-Int4在这个问题也出现类似错误。 ``` client = OpenAI( api_key=openai_api_key, base_url=openai_api_base, ) chat_response = client.chat.completions.create( model="Qwen2-7B-Instruct-GPTQ-Int4", messages=[ {"role": "system", "content": "You are a helpful...
### Has this been raised before? - [X] I have checked [the GitHub README](https://github.com/QwenLM/Qwen2.5). - [X] I have checked [the Qwen documentation](https://qwen.readthedocs.io) and cannot find an answer there. - [X]...
### Self Checks - [x] I have searched for existing issues [search for existing issues](https://github.com/infiniflow/ragflow/issues), including closed ones. - [x] I confirm that I am using English to submit this...
部署代码 ``` byzerllm deploy --pretrained_model_type custom/sensevoice ^ --infer_backend transformers ^ --cpus_per_worker 0.001 ^ --gpus_per_worker 0 ^ --num_workers 1 ^ --model_path D:/Project/PYTHON/william-toolbox/SenseVoiceSmall ^ --infer_params vad_model=fsmn-vad vad_kwargs.max_single_segment_time=30000 ^ --model voice2text ``` 用文档里whisper模型的代码测试了一下:...