vanna
vanna copied to clipboard
feat: pinecone vectorstore
This PR adds support for using Pinecone as a vector store. This is still a WIP as no tests have been written. From simple usage testing, it appears to all work together. Two things to note:
- This is using
fastembed
as there is no way to generate embeddings with pinecone directly. - There is also no way to get all vectors in an index / namespace (for
get_training_data
) so instead, I set the top_k to the max and provide an empty vector. - I havent tested using other fastembed models and would also like to add support for using something like
text-ada-embedding-2