zhuifengzl
zhuifengzl
我用的模型是RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096.pth，也转换过RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096-fp16.bin，都测试过，即使修改代码backend-python\routes\completion.py下的设置，重启程序也不生效，是这个模型不支持吗 class ChatCompletionBody(ModelConfigBody): messages: Union[List[Message], None] model: Union[str, None] = "rwkv" stream: bool = False stop: Union[str, List[str], None] = default_stop user_name: Union[str, None] = Field( None, description="Internal user name",...
好像每次程序都会重置修改的参数，那个流式参数是不能修改吗
public struct LocalSendData { public string model; public bool stream; public bool presystem; public int max_tokens; public double temperature; public double top_p; public double presence_penalty; public double frequency_penalty; public List...