graphrag icon indicating copy to clipboard operation
graphrag copied to clipboard

[Feature Request]: indexing on PostgreSQL Graph database (Apache Age)

Open k2ai opened this issue 1 year ago • 5 comments

Do you need to file an issue?

  • [ ] I have searched the existing issues and this feature is not already filed.
  • [ ] My model is hosted on OpenAI or Azure. If not, please look at the "model providers" issue and don't file a new one here.
  • [ ] I believe this is a legitimate feature request, not just a question. If this is a question, please use the Discussions area.

Is your feature request related to a problem? Please describe.

Is there any development regarding the integration of an adapter to index .parquet data into a PostgreSQL graph database (Apache AGE) and enable indexing within PostgreSQL for faster query performance?

Describe the solution you'd like

No response

Additional context

No response

k2ai avatar Aug 18 '24 07:08 k2ai

Interested. I am looking for the exact functionality, being able to save the indexed results to an actual database would be great for both storing data and optimizing the queries.

tranthanhbinh1 avatar Aug 18 '24 09:08 tranthanhbinh1

I believe there should be a dedicated CLI command or API that handles all preprocessing tasks up to community building and stores the data in either a PostgreSQL graph database or Neo4j. After completing the data preprocessing, there should be another distinct CLI command or API to create the final index.

k2ai avatar Aug 18 '24 11:08 k2ai

It should also allow appending to an existing graph and able to delete nodes and relationships based on data changes. This will enable efficient processing by avoiding the need to reprocess the entire dataset, especially when dealing with large amounts of data.

9prodhi avatar Aug 22 '24 02:08 9prodhi

Any update on this?

basitanees avatar Jan 22 '25 18:01 basitanees

Hi, are there any plans for this feature?

basitanees avatar Feb 13 '25 15:02 basitanees

GraphRAG allows registration of custom storage implementations (See StorageFactory). We are limiting how many we officially support in order to keep maintenance manageable.

natoverse avatar Aug 28 '25 20:08 natoverse