llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

feat: New OpenAI compat embeddings API

Open hardikjshah opened this issue 4 months ago • 0 comments

What does this PR do?

Adds a new endpoint that is compatible with OpenAI for embeddings api. /openai/v1/embeddings Added providers for OpenAI, LiteLLM and SentenceTransformer.

Test Plan

LLAMA_STACK_CONFIG=http://localhost:8321 pytest -sv tests/integration/inference/test_openai_embeddings.py --embedding-model all-MiniLM-L6-v2,text-embedding-3-small,gemini/text-embedding-004

hardikjshah avatar May 29 '25 23:05 hardikjshah