[Ecosystem] NIM inference with AIBrix

[gaocegege]

🚀 Feature Description and Motivation

I’m not entirely certain if this aligns with our goals. Some potential users are looking to integrate NIM (NVIDIA Inference Manager), which is already supported in Kserve. We might need to evaluate whether this fits into our roadmap.

• https://github.com/NVIDIA/nim-deploy/blob/main/kserve/nim-models/README.md
• https://blogs.nvidia.com/blog/kserve-nim-inference/

Use Case

Using NIM with AIBrix

Proposed Solution

No response

[gaocegege]

Here is a usage doc: https://catalog.ngc.nvidia.com/orgs/nim/resources/llm-nim-kserve