gateway icon indicating copy to clipboard operation
gateway copied to clipboard

Published 20 hours ago • verified publisher icon Portkey-AI

[Provider] Support for Nvidia NeMo

Open vrushankportkey opened this issue 1 year ago • 1 comments

vrushankportkey avatar Aug 06 '24 08:08 vrushankportkey

Models hosted using Nvidia's NeMo servers expose Nvidia's Triton inference API's, we have a PR for that already (currently only for text completions, not chat completions) https://github.com/Portkey-AI/gateway/pull/445 image https://docs.nvidia.com/nemo-framework/user-guide/latest/overview.html

narengogi avatar Aug 21 '24 09:08 narengogi