model_analyzer

model_analyzer copied to clipboard

Model load failed: [StatusCode.RESOURCE_EXHAUSTED] to-be-sent trailing metadata size exceeds peer limit

3

I refer to the example/quick-start and try to profile a resnet libtorch model. Then I got the error 'Model load failed: [StatusCode.RESOURCE_EXHAUSTED] to-be-sent trailing metadata size exceeds peer limit'. I...

helenHlz

Hello, I am trying to run the model_analyzer on an xgboost model I have. I am able to load the docker sdk client container and submit a model analyzer command,...

dustinvanstee

Model Analyzer fails on Ensemble Model

6

model-analyzer profile --model-repository models --profile-models myensemblemodel --run-config-search-max-concurrency 1 --run-config-search-max-model-batch-size 8 --run-config-search-max-instance-count 2 I get this error: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/google/protobuf/json_format.py", line 559, in _ConvertFieldValuePair raise ParseError('Message type...

klappec-bsci

Model analyzer profile fails for multi input python BE models with different types or different shape dimensions

6

# Description Running model analyzer to profile a model fails if the model is a multi-input model with either different data_types (TYPE_UINT8 and TYPE_STRING) and/or different dimensions (3D and 1D)....

HarmitMinhas96

Run models concurrently

5

We know that the below command (with -n flag) benchmark the models in sequence - model-analyzer -m /models/ -n model1, model2 --batch-sizes 1,2,4,8,16 -c 1,2,3 My requirement is to benchmark...

naveengogineni

Dose model analyzer tool support Jetson nano?

3

the model analyzer is amazing tool. it is very useful when we do some model performance analysis. As I am deploying triton inference server on Jetson nano and window 10,...

liwenhust8282

Fail to analyze ensemble model: "inference.ModelConfig" should not have multiple "scheduling_choice" oneof fields

3

When I use model-analyzer to analyze a ensemble model with local luanch mode, it always fails with following error: ```bash root@dl:/inference# model-analyzer profile --checkpoint-directory checkpoints -m $PWD/model_repo --profile-models quartznet-ensemble --output-model-repository-path=/output_repo/temp...

riverliuc

Docs for --triton-launch-mode=c_api and local missing

4

Hi there, I'm trying to use the `model-analyzer` in `local` mode or with `c_api` but when I try to navigate to the links for more information, I either get a...

aishanibhalla

Removes the local monitor option. Leaves DCGM in place, TMA-958 is the new task to remove this from MA.

nv-braf

Failed to get the canonical path in python backend environment

1

Hi Folks, I have been trying to run the model-analyzer on my models but I am getting some errors. How I am doing to run? ```bash docker run -it --gpus...

PauloFavero