age icon indicating copy to clipboard operation
age copied to clipboard

Suggest integrating AGE as a 'Graph Store' in LlamaIndex for AI/RAG applications

Open ztor2 opened this issue 10 months ago • 10 comments

Since graph-based RAG frameworks have gained attention recently, I propose integrating AGE into AI development frameworks such as LangChain or LlamaIndex to increase AGE's utility in the AI industry.

Below are graph stores already registered with LlamaIndex's Graph Store. https://docs.llamaindex.ai/en/stable/community/integrations/graph_stores/

I've already asked LlamaIndex for AGE integration and received the following response and template. https://github.com/run-llama/llama_index/issues/12517 run-llama/llama_index/blob/main/llama-index-core/llama_index/core/graph_stores/types.py

In addition, several dedicated contributors have listed Apache AGE on LangChain. https://python.langchain.com/docs/integrations/graphs/apache_age/

I've been conducting test for integration, but I'm worried it might take a while. I look forward to hearing your ideas, comments and suggestions for collaboration. thanks.

ztor2 avatar Apr 24 '24 01:04 ztor2

Surely integrating Apache AGE with these frameworks could enhance AGE's visibility in the AI sector, which could bring more contributors.

markgomer avatar Apr 24 '24 14:04 markgomer

@markgomer Thanks for you opinion. Existing graph stores included in these frameworks are commercial or difficult to use. AGE will be in high demand as a open source.

ztor2 avatar Apr 25 '24 00:04 ztor2

to @eyab ,

I would like to propose to create a sub-project of 'Integrate AGE with open-source projects' for this issue. For now, me and another contributor will be working on the project. Here's a brief project description, referencing the project template:

Description

Integrating Apache AGE as a 'Graph Store' in LlamaIndex

Required Skills

  • Mainly Python
  • Some background and experience with RAG or LLM, and an understanding of LlamaIndex.

TODO

Main required attributes:

  • connect to graph stores
  • ETL of triplet information from graph databases(get, get_rel_map, upsert, etc.)
  • save graph information as file(by using fsspec)
  • get schema of graph stores

Additional Details

https://docs.llamaindex.ai/en/stable/community/integrations/graph_stores/ run-llama/llama_index#12517 https://github.com/run-llama/llama_index/blob/main/llama-index-core/llama_index/core/graph_stores/types.py https://python.langchain.com/docs/integrations/graphs/apache_age/

ztor2 avatar Apr 29 '24 06:04 ztor2

@ztor2

Thank you for proposing to integrate Apache AGE with LlamaIndex. Your suggestion sounds like a valuable addition to our project, and I am excited to see how it develops.

I have created a designated space for you to work on the project. https://github.com/orgs/apache/projects/357

eyab avatar May 06 '24 20:05 eyab

@eyab

Thank you for your response and for creating the project. I will soon discuss and comment on the assignment for each task with the volunteer contributor.

ztor2 avatar May 08 '24 07:05 ztor2

I'm excited about this project and would love to contribute. I'm a database engineer with experience in python. Let me know which tasks I can assist with or in general how I can help.

dsvisualized avatar May 08 '24 19:05 dsvisualized

@eyab

Please refer to previous comment, and can you assign me( @ztor2 ) to task 1 and @dsvisualized to task 2 in the project each? https://github.com/orgs/apache/projects/357

ztor2 avatar May 11 '24 07:05 ztor2

This issue is stale because it has been open 60 days with no activity. Remove "Abondoned" label or comment or this will be closed in 14 days.

github-actions[bot] avatar Jul 11 '24 00:07 github-actions[bot]

Just commenting to prevent closure of the issue since it is one that I am also tracking!

derekja avatar Jul 17 '24 23:07 derekja

Also just commenting to prevent closure of the issue since it is one that I am also tracking!

Playerrrrr avatar Sep 12 '24 03:09 Playerrrrr