tensorzero icon indicating copy to clipboard operation
tensorzero copied to clipboard

Add a complete RAG example

Open GabrielBianconi opened this issue 1 year ago • 1 comments

GabrielBianconi avatar Sep 06 '24 22:09 GabrielBianconi

Start with a brief proposal

GabrielBianconi avatar Oct 11 '24 21:10 GabrielBianconi

Proposal: take the Wikipedia dataset from pinecone datasets and use it with either Qdrant or PGVector in a local container. Then run BeerQA against it with 2 functions for query rewriting and generation and then 1 more for evaluation.

Much like a single-iteration version of the work-in-progress beam search example but with a vector store instead of the live Wikipedia API

virajmehta avatar Oct 16 '24 18:10 virajmehta

pinecone-datasets is unlicensed so we can't use it as is. We should find something similar, or get permission from them.

Or we just generate them ourselves and share.

GabrielBianconi avatar Oct 16 '24 20:10 GabrielBianconi