llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

Published 20 hours ago • verified publisher icon meta-llama

Portkey AI inference Provier support

Open siddharthsambharia-portkey opened this issue 10 months ago • 0 comments

🚀 Describe the new functionality needed

Ability to use Portkey AI wth Llama Stack to access opensource models across 40+ providers

💡 Why is this needed? What if we don't build it?

Portkey AI's integration allows you to get observability, governance, and guardrails on your Lllama stack app.

  • 40+ metrics dashboard with logs & traces view
  • Access 250+ LLMs directly through Portkey's unified SDK
  • Add guardrails to your AI requests
  • Enterprise-grade governance over your AI usage

Other thoughts

No response

siddharthsambharia-portkey avatar Dec 20 '24 13:12 siddharthsambharia-portkey