llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

Adding Snowflake Provider Support + Distribution Template

Open sfc-gh-alherrera opened this issue 1 year ago • 0 comments

Adds support for inference with Snowflake's Cortex endpoint. See docs for more background on Cortex:https://docs.snowflake.com/en/user-guide/snowflake-cortex/cortex-llm-rest-api

Testing

  • built a new stack from scratch using remote::snowflake for the Inference API
  • ran python -m llama_stack.apis.inference.client localhost
  • directly submitted request to the llama stack server
Screenshot 2024-10-31 at 7 20 35 PM Screenshot 2024-10-31 at 7 11 20 PM

sfc-gh-alherrera avatar Oct 31 '24 23:10 sfc-gh-alherrera