jiaolongxue

``` r = await func(self, *args, **kwargs) File "/opt/conda/lib/python3.10/site-packages/xinference/core/model.py", line 375, in chat response = await self._call_wrapper( File "/opt/conda/lib/python3.10/site-packages/xinference/core/model.py", line 104, in _asy nc_wrapper return await fn(*args, **kwargs) File "/opt/conda/lib/python3.10/site-packages/xinference/core/model.py",...

openai_api_server only accept these parameters ``` @app.post("/v1/chat/completions", dependencies=[Depends(check_api_key)]) async def create_chat_completion(request: ChatCompletionRequest): ``` ```python class ChatCompletionRequest(BaseModel): model: str messages: Union[str, List[Dict[str, str]]] temperature: Optional[float] = 0.7 top_p: Optional[float] = 1.0...

modify protocol/openai_api_protocol.py ```python class ChatCompletionRequest(BaseModel): model: str messages: Union[str, List[Dict[str, str]]] temperature: Optional[float] = 0.7 top_p: Optional[float] = 1.0 n: Optional[int] = 1 max_tokens: Optional[int] = None stop: Optional[Union[str, List[str]]]...

+1