age icon indicating copy to clipboard operation
age copied to clipboard

AGE&Citus Integrationn-Project Planning and Requirements Gathering

Open eyab opened this issue 1 year ago • 6 comments

eyab avatar Aug 08 '23 22:08 eyab

Since, Citus is an extension to PostgreSQL that is used for horizontal scaling of PostgreSQL across multiple nodes. we can use it with AGE to improve the performance and scalability of graph queries by parallelizing the execution across the cluster.

farooquememon385 avatar Aug 14 '23 04:08 farooquememon385

Citus

In relation to its operational efficiency, Citus distributes tables into shards across a network of PostgreSQL nodes. This means that data is broken down into smaller pieces and stored on numerous nodes, enabling tasks to be carried out concurrently. This approach optimally harnesses the processing power, memory, storage, and input/output capabilities of the CPU.

Additionally

The system's distributed query engine effectively directs transactions throughout the cluster, simultaneously distributing analytical queries and batch processes across all available cores. Additionally, you retain the ability to utilize the familiar PostgreSQL features and tools.

M4rcxs avatar Aug 15 '23 20:08 M4rcxs

Citus, as a PostgreSQL extension, offers horizontal scalability. This can help manage AGE's data management and allow consistance performance. The data distribution in citus across multiple nodes boosts querry optimization and lessens response time. Also the data partioning will help AGE functionality by enhancing data organization and dta retrieval. So all in all in think by integrating citus with AGE it might just help push AGE beyond its current limits.

Hannan2910 avatar Aug 16 '23 16:08 Hannan2910

Citus Architecture

Talking about its architecture, in a citus cluster all servers run PostgreSQL with the citus extension plus any number of other extension installed. Citus uses the PostgreSQL extension APIs to change the behaviour of database in two ways.

  • It replicates database objects to all servers such as custom types and functions.
  • It adds two new table types that can be used to take advatange of additional servers.

MuhammadZeeshan03 avatar Aug 18 '23 18:08 MuhammadZeeshan03

AGE and Citus both are extensions to PostgresSQL, we can try to use it by installing both extensions on Postgres cluster

farooquememon385 avatar Aug 23 '23 15:08 farooquememon385

How to choose a shard ID on citus is a problem

GPF199541 avatar Aug 31 '23 01:08 GPF199541

This issue is stale because it has been open 45 days with no activity. Remove "Abondoned" label or comment or this will be closed in 7 days.

github-actions[bot] avatar May 11 '24 00:05 github-actions[bot]

This issue was closed because it has been stalled for further 7 days with no activity.

github-actions[bot] avatar May 19 '24 00:05 github-actions[bot]