model_navigator

model_navigator copied to clipboard

PyTorch lightning to Onnx conversion

10

Hi i am trying to convert the donut model which is built on PyTorch lightning and its throwing me the following error. **2022-09-27 15:02:35,649 INFO Navigator API: PyTorch to ONNX...

swapnil-lader

TensorRT-LLM Triton Backend Support

6

When can NAV support creating Triton Repo for this new backend? Is it on your roadmap? https://github.com/triton-inference-server/tensorrtllm_backend

shixianc

chore: typo

1

dsgibbons

Readme update

5

This install: `pip install -U --extra-index-url https://pypi.ngc.nvidia.com triton-model-navigator[]` breaks pips parser. This works instead: `pip install -U --extra-index-url https://pypi.ngc.nvidia.com triton-model-navigator[extras]`

esnvidia

Questions related to TRT conversion and TRT-LLM support

3

I have 2 separate questions which I could not find an answer yet, so post it here hope someone can answer: 1. When doing TRT conversion from torchscript to trt....

shixianc

Assistance Needed: Errors Encountered While Following Tutorial

1

I am trying to follow the tutorial from your repository using the Triton server. However, I am encountering the following errors: # ./optimize.py Traceback (most recent call last): File "./examples/01_optimize_torch_linear_model/./optimize.py",...

AutoStudyP

Fix a typo

1

get_output_metadat**e**_impl -> get_output_metadat**a**_impl

caffeinism