Geotk

请问BAAI / bge-reranker-base 模型转为onnx怎么只有分类前的部分？

9

# BAAI / bge-reranker-base 模型转为onnx的疑问 如题，当我转换huggingface上提供的模型为onnx时，生成的onnx模型在运行时只输出logits，而不是分类的分数。 ## 转换代码如下 ```python import torch from transformers import BertForSequenceClassification import onnx from transformers import AutoModel import logging logging.basicConfig(level=logging.DEBUG) device = torch.device('cuda:0' if torch.cuda.is_available() else...

How to specify the TensorRT version in Triton Server for inference?

3

Description: I am currently facing an issue with specifying the TensorRT version in Triton Server. I have exported my models as .plan files using TensorRT 10.0 because using version 8.6.1...