Yufan He

Results 6 comments of Yufan He

[feasibility research] Investigate if we can get signature without the model server

model inference server mean trtis (triton) ？ TRT plan has has some constraints: > Note: The generated plan files are not portable across platforms or TensorRT versions. Plans are specific...

[feature] Provider unified offline batch inference interface

There are roughly two ways to consider: - Transform all models into a unified type (eg onnx. Use onnxruntime to provide inference). At this time, the task needs some resources...

[feature] Provider unified offline batch inference interface

> > Transform all models into a unified type (eg onnx. Use onnxruntime to provide inference). At this time, the task needs some resources and dependencies. It is recommended to...

[feature] Provider unified offline batch inference interface

/assign

github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.88.43|:443... llfailed: Connection timed out.

@nautilusshell Please provide more information then reopen this issue again.

Add support for more frameworks like caffe, onnx, mxnet .

Thx for your reply. I think if Neuropod only support python SDK (with out use_native), supporting newly frameworks maybe easier. By the way where can I find Neuropod 's roadmap...