Sambanova inferene

[snova-edwardm]

trafficstars

What does this PR do?

This PR adds SambaNova as one of the Provider

• Add SambaNova as a provider

Test Plan

Test the functional command

pytest -s -v --providers inference=sambanova llama_stack/providers/tests/inference/ --env SAMBANOVA_API_KEY=<sambanova-api-key>

Test the distribution template:

# Docker
LLAMA_STACK_PORT=5001
docker run -it -p $LLAMA_STACK_PORT:$LLAMA_STACK_PORT \
  llamastack/distribution-sambanova \
  --port $LLAMA_STACK_PORT \
  --env SAMBANOVA_API_KEY=$SAMBANOVA_API_KEY

# Conda
llama stack build --template sambanova --image-type conda
llama stack run ./run.yaml \
  --port $LLAMA_STACK_PORT \
  --env SAMBANOVA_API_KEY=$SAMBANOVA_API_KEY

Source

SambaNova API Documentation

Before submitting

• [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• [Y] Ran pre-commit to handle lint / formatting issues.
• [Y] Read the contributor guideline, Pull Request section?
• [Y] Updated relevant documentation.
• [Y ] Wrote necessary unit or integration tests.