ome icon indicating copy to clipboard operation
ome copied to clipboard

fix: remove GPU node selector from benchmark jobs

Open abatilo opened this issue 5 months ago • 1 comments

Benchmark jobs execute performance tests against inference services and don't require GPU resources themselves. Removing the nvidia.com/gpu node selector allows these jobs to run on any available node, improving scheduling flexibility and resource utilization.

abatilo avatar Jul 06 '25 07:07 abatilo

GenAI-bench requires tokenizer That tokenizer is currently only available in GPU nodes the problem is probably how we handled getting the tokenizer benchmark controller

slin1237 avatar Jul 07 '25 13:07 slin1237