client icon indicating copy to clipboard operation
client copied to clipboard

tritonclient version 2.61.0 not installing on macOS with UV due to perf-analyzer not having macOS arm64 wheels

Open martinkozle opened this issue 3 months ago • 9 comments

I am unable to install the latest version of tritonclient on my MacBook M4 using UV due to the following error:

> uv init .
> uv add 'tritonclient==2.61.0'
Resolved 8 packages in 35ms
error: Distribution `perf-analyzer==2.59.1 @ registry+https://pypi.org/simple` can't be installed because it doesn't have a source distribution or wheel for the current platform

hint: You're on macOS (`macosx_15_0_arm64`), but `perf-analyzer` (v2.59.1) only has wheels for the following platforms: `manylinux_2_38_aarch64`, `manylinux_2_38_x86_64`; consider adding your platform to `tool.uv.required-environments` to ensure uv resolves to a version with compatible wheels
> uv add 'tritonclient==2.60.0'
Resolved 7 packages in 35ms
Prepared 3 packages in 394ms
Installed 4 packages in 22ms
 + numpy==2.0.2
 + python-rapidjson==1.21
 + tritonclient==2.60.0
 + urllib3==2.5.0

Someone on macOS arm64 can try to check if it can be reproduced?

martinkozle avatar Oct 16 '25 11:10 martinkozle

Same error here with uv and tritonclient>=2.61.0

lz-chen avatar Oct 20 '25 11:10 lz-chen

This is expected behavior as perf_analyzer binary is supported only for the platforms mentioned in the error you are seeing.

ganeshku1 avatar Oct 20 '25 16:10 ganeshku1

This is expected behavior as perf_analyzer binary is supported only for the platforms mentioned in the error you are seeing.

Thanks @ganeshku1:) That makes sense. But why does tritonclient requires perf_analyzer? How does one run tritonclient on Mac in this case?

lz-chen avatar Oct 20 '25 17:10 lz-chen

It was added here: https://github.com/triton-inference-server/client/commit/133d96864a5478a92934fbcb26f59d8f8ec18a35 — why? The description doesn't say anything.

itai-delphos avatar Nov 01 '25 23:11 itai-delphos

This extra requirement breaks installs on macos and windows, can the perf-analyzer requirement be defined as an extra requirement or removed?

UnyieldingOrca avatar Nov 08 '25 21:11 UnyieldingOrca

this issue is also propagating to libraries that depend on tritonclient e.g. mlserver. If there was an option path for non Linux installations that would be great!

dtpryce avatar Nov 26 '25 12:11 dtpryce

this error even shows up on Ubuntu 22.04.

error: Distribution `perf-analyzer==2.59.1 @ [redacted]` can't be installed because it doesn't have a source distribution or wheel for the current platform

hint: You're on Linux (`manylinux_2_35_x86_64`), but `perf-analyzer` (v2.59.1) only has wheels for the following platforms: `manylinux_2_38_aarch64`, `manylinux_2_38_x86_64`; consider adding your platform to `tool.uv.required-environments` to ensure uv resolves to a version with compatible wheels

it seems strange that the OS requirements need to be this strict for something as basic as an inference client

abln-synth avatar Nov 26 '25 14:11 abln-synth

I have the same issue using docker images for python:3.12-slim-bookworm, python:3.13-slim-bookworm, python:3.13-slim. Why perf_analyzer isn't an optional dependency?

holyjackaiforia avatar Dec 02 '25 14:12 holyjackaiforia

I met the same error with uv, just use previous versions of the client

lgonzalezgrabit avatar Dec 03 '25 10:12 lgonzalezgrabit

2.60.0 doesn't have this dependency, I've downgraded, although this is really not an ideal solution. I would hope @ganeshku1 has someone gate it behind an extra like tritonclient[perf-analyzer].

Falven avatar Dec 17 '25 16:12 Falven