Artem Zaluzhnyi comments

Repositories
Issues
Comments

Results 3 comments of


                                            Artem Zaluzhnyi

[Triton] Inference Service with multiple models

Hey, I'm facing similar issue. I want to use kserve to streamline deployment of existing models with triton inference service which include some simple models and some complex models with...

Memory leak from grpcio

I was able to reproduce same issue on 22.04.1-Ubuntu using tritonclient==2.48.0. Suggested workaround helped me as well.

tritonclient version 2.61.0 not installing on macOS with UV due to perf-analyzer not having macOS arm64 wheels

I have the same issue using docker images for python:3.12-slim-bookworm, python:3.13-slim-bookworm, python:3.13-slim. Why perf_analyzer isn't an optional dependency?