litellm icon indicating copy to clipboard operation
litellm copied to clipboard

[Feature]: Enable Vector Store API routes and Vector Store Files API routes

Open ashaka-netapp opened this issue 2 months ago • 4 comments

The Feature

We are looking for vector store functionalities that are tied to the Response API. We primarily need to add two new API endpoints:

  • List vector store files
  • Delete a specific vector store file
  • Delete a vector store

Motivation, pitch

Without these endpoints, users cannot programmatically:

  • Retrieve a list of all vector store files associated with a deployment
  • Remove unused vector store files to free up storage
  • Remove vector store to free up storage

Adding these APIs will enhance our vector store management feature set and improve overall usability.

LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

Twitter / LinkedIn details

No response

ashaka-netapp avatar Oct 23 '25 20:10 ashaka-netapp

Hi @ashaka-netapp does azure expose these endpoints?

krrishdholakia avatar Oct 24 '25 01:10 krrishdholakia

the azure openai vector store implementation seems quite limited.

i believe azure ai search seems better supported - able to directly query an index.

does this work?

  • https://learn.microsoft.com/en-us/azure/search/search-get-started-vector?tabs=keyless&pivots=rest
  • https://learn.microsoft.com/en-us/rest/api/searchservice/documents/get?view=rest-searchservice-2025-09-01&tabs=HTTP

krrishdholakia avatar Oct 24 '25 01:10 krrishdholakia

Hi @ashaka-netapp does azure expose these endpoints?

Yes, Azure does. We are looking for vector store functionalities that are tied to the Response API.

ashaka-netapp avatar Oct 24 '25 17:10 ashaka-netapp

@krrishdholakia The ask now is to extend https://github.com/BerriAI/litellm/pull/16643 and support azure as a provider

jeromeroussin avatar Nov 22 '25 16:11 jeromeroussin