zhuhao

icon location shenzhen/China

Results 4 comments of zhuhao

安装xinference卡住不动

+1

自定义的模型API都要配置步骤有哪些，除了写config文件外

I have modified the get_token_len method in the file opencompass/models/openai_api.py, as follows: def get_token_len(self, prompt: str) -> int: """Get lengths of the tokenized string. Only English and Chinese characters are...

Divide by zero: request_metrics[common_metrics.REQ_OUTPUT_THROUGHPUT] = num_output_tokens / request_metrics[common_metrics.E2E_LAT]

same problem here when testing a api deployed in house

feat: add upstash as a new vector database provider

@userzhangqg refer this pr to fix the test, https://github.com/langgenius/dify/pull/9287