靳西

tritonserver loading onnx model exported by optimum failed

1

### System Info ```shell optimum: 1.14.1 python: 3.11 onnx: 1.15.0 onnxruntime: 1.16.3 tritionserver images: tritonserver:22.12-py3 ``` ### Who can help? @michaelbenayoun ### Information - [X] The official example scripts -...

感谢您参与 X2Paddle 社区！ 问题模版为了 X2Paddle 能更好的迭代，例如新功能发布、 RoadMaps 和错误跟踪. :smile_cat: ## 问题描述 x2paddle支持7B的onnx转为paddle么？ - 错误信息 - 错误截图 ## 具体信息 - 转换模型后用处 - [ ] 使用 Paddle 框架/ PaddleInference 推理预测 - [...

we encountered a problem: client of c++ binds to server of scala using jzmq, and the client also binds to another server of c++. when the client is restarted, it...

Want Lorax with newer version of TGI

5

### Feature request hello，our models are deploying with TGI(v1.4.3), and we alse want to use lorax. But I find that the tgi version lorax is based on is very different...

Support self-trained model

2

### Model description hi, my company has trained a model of 7b， we want to deploy lorax with our model. Can you introduce key steps to support model in loraX？...