web3aipro
Results
1
issues of
web3aipro
使用xinfernece启动DeepSeek-R1-Distill-Qwen-14B时候，通过程序调用接口，发现缺少起始符号，有. 代码如下： `from openai import OpenAI client = OpenAI(base_url="http://127.0.0.1:9997/v1", api_key="not used actually") question2 = "2.8比2.18大吗？" messages = [{"role": "user", "content": f'{question2}'}] response = client.chat.completions.create( model="custom-llm-deepseek", messages=messages, temperature=0.6, max_tokens=32768, ) content...