Marut Pandya
Marut Pandya
I have successfully installed gdrcopy on my host and completed its tests. Afterwards, I launched a container running my language model application, with a focus on profiling the loading of...
Need to have a alert & notification System.
Whenever the key is generated, table should be automatically be updated when key is generated
**Why this PR** We want to add [Runpod](https://www.runpod.io/) as remote inference provider for Llama-stack. [Runpod](https://www.runpod.io/) endpoints are OpenAI Compatible, hence it's recommended to use it with Runpod model serving endpoints....
Add Runpod as a inference provider for openAI compatible managed endpoints. Testing - Configured llama stack from scratch, set `remote::runpod` as a inference provider. - Added Runpod Endpoint URL and...