model_navigator

model_navigator copied to clipboard

Triton Navigator failing to convert the tensorflow model into tensorflow-trt.

1

While trying conversion from the tf-savedmodel format to tf-trt format model-navigator throws error (Please provide a full dataset profile instead of max_batch_size.). We have given the dataset profile as mentioned...

swapnil-lader

Triton Navigator Failing At Torch Conversion To TRT-Torch.

1

I am working on model_navigator to deploy into the triton server but facing Issue While converting the torchscript model into torch-trt framework it ends up throwing the error tensorflow module...

swapnil-lader

Segfault Immediately After Hifigan Conversion from TorchScript

2

## Steps to reproduce 1. Get a hifigan model from NeMo and export it to .pt ```bash docker run --rm --gpus '"device=0"' -it --ipc=host \ -v $HOME/:/ext_home \ -v ${PWD}:${PWD}...

okdimok

[Perf_Analyzer]: took very long to exit, killing perf_analyzer.

4

**I tried to run model_navigator on my onnx model and it stops by giving following error..** `2022-04-22 18:56:36.187 INFO[perf_analyzer.py:214] perf_analyzer took very long to exit, killing perf_analyzer... 2022-04-22 18:56:41.700 INFO[server_local.py:121]...

sbmalik

[feature] add support for creating ensemble model config

4

Would you consider letting users add ensemble configs using `model-navigator triton-config-model`?

Rusteam

No such file or directory error when model-navigator convert executes

4

I am trying to convert from Tensorflow saved-model to onnx model, but when I execute model_navigator from command line, this error occurs: `FileNotFoundError: [Errno 2] No such file or directory:...

justmert

Change triton version to be used for the model navigator

2

I saw that this model_navigator uses triton version 21.05 If I want to use the version of 21.02 , how can I config it as I have errors on different...

Aun0124

convert_results.yaml instead of convert.yaml?

1

Following the quick start guide on a fresh install, receive the following error mod: ``` model-navigator run --model-name add_sub \ --model-path examples/quick-start/model.pt \ --inputs INPUT__0:-1,16:float32 INPUT__1:-1,16:float32 \ --outputs OUTPUT__0:-1,16:float32 OUTPUT__1:-1,16:float32...

dawilliams-nvidia

Model conversion for multiple models

1

Hi Triton team, Thanks for the model navigator tool and autoconversion, as well as, autovalidation features that comes with it. I wanted to know if there is any way to...

pshwetank

When generating a model configuration using the `triton-config-model` command, it would great to allow users to assign Host Policies to specific instance groups as described in [Model Configuration - Host...

gnovack