evadb icon indicating copy to clipboard operation
evadb copied to clipboard

Accessing EvaDB tables using Postgres query engine

Open pchunduri6 opened this issue 1 year ago • 1 comments

Search before asking

  • [X] I have searched the EvaDB issues and found no similar feature requests.

Description

Currently, it is not clear whether we can access EvaDB tables using a different query engine like Postgres. This will be useful when we want to leverage Postgres features like window functions and string_agg on the output of EvaDB tables. One concrete workflow that benefits from this is RAG-based question-answering:

  1. Create vector index of a document in EvaDB.
  2. Use similarity to retrieve top-5 similar chunks to the user question.
  3. Concatenate all the retrieved chunks in Postgres using group by and string_agg.
  4. Run an LLM function on the concatenated output.

If this is not possible, we would need to add support for STRING_AGG and GROUP BY 'chunks' natively in EvaDB.

Use case

No response

Are you willing to submit a PR?

  • [ ] Yes I'd like to help by submitting a PR!

pchunduri6 avatar Nov 01 '23 16:11 pchunduri6

Claimed for EvaDB Project 2 @jarulraj

ryanmle2001 avatar Nov 03 '23 03:11 ryanmle2001