gateway icon indicating copy to clipboard operation
gateway copied to clipboard

Published 20 hours ago • verified publisher icon Portkey-AI

Portkey for Self Hosted LLMs in a VM?

Open AIAnytime opened this issue 10 months ago • 1 comments

What Happened?

Is Portkey compatible with a self hosted LLM running on a VM. I can't use Mistral API from Mistral Cloud or anywhere else?

What Should Have Happened?

No response

Relevant Code Snippet

No response

Your Twitter/LinkedIn

No response

AIAnytime avatar Apr 12 '24 14:04 AIAnytime

Hi @AIAnytime you can use Portkey with a self-hosted LLM. Check out this doc - https://portkey.ai/docs/welcome/integration-guides/byollm

vrushankportkey avatar Apr 25 '24 07:04 vrushankportkey

@AIAnytime closing this issue as it's resolved. Please feel free to reopen if you have any further questions!

vrushankportkey avatar Jun 05 '24 07:06 vrushankportkey