PromptingTools.jl icon indicating copy to clipboard operation
PromptingTools.jl copied to clipboard

Pinecone integration

Open iuliadmtru opened this issue 6 months ago • 9 comments

This is an attempt to integrate Pinecone into PromptingTools. The preparation and retrieval steps are not necessary with Pinecone. The result of the Pinecone query serves as context in the RAGResult.

Questions

  • The new types have a PT prefix such as to not cause confusion with Pinecone.jl (there's already a PineconeIndex there, which is a different thing). That is not great.
  • I added a NoChunker type such that PTPineconeIndexer can still have a chunker. Is that best? Probably not.
  • I think the dispatch of find_tags might not be necessary.
  • Is it necessary to have a new abstract type (AbstractPTPineconeIndex)? Probably not.
  • I also added a new template, JuliaRAGAssistant, and I put that under persona-task. I'm not sure that's the best place.

iuliadmtru avatar Aug 06 '24 18:08 iuliadmtru