TOMATODA comments

Repositories
Issues
Comments

Results 1 comments of


                                            TOMATODA

[Bad Case]: 在机器上部署reranker模型之后，请求的时候报错了

启动命令： command: /app/.venv/bin/python /app/.venv/bin/infinity_emb --model-name-or-path /opt/llm/input/pretrain/OpenBMB--MiniCPM-Reranker --port 8002 --device cuda imageUrl: pre-openmatrix-acr-registry.cn-beijing.cr.aliyuncs.com/openmatrix/infinity:0.0.32 curl http://localhost:8002/models {"data":[{"id":"pretrain/OpenBMB--MiniCPM-Reranker","stats":{"queue_fraction":0.0,"queue_absolute":0,"results_pending":0,"batch_size":32},"object":"model","owned_by":"infinity","created":1726209146,"backend":"torch"}],"object":"list"} 不知道提供的信息是否足够，如果还需要其他信息麻烦提醒一下