blast icon indicating copy to clipboard operation
blast copied to clipboard

Syncing or integrating with existing PostgreSQL database

Open rrjanbiah opened this issue 5 years ago • 4 comments

Are there any recommended approach to sync with PostgreSQL? IOW, how do people using Blast integrate it with their existing PostgreSQL systems?

rrjanbiah avatar Dec 12 '19 12:12 rrjanbiah

Basically, send PostgreSQL data to Blast and index it. I haven't heard of Blast use cases yet.

mosuka avatar Dec 13 '19 02:12 mosuka

@mosuka Thank you so much for your reply. Hopefully debezium along with Kafka will help for real time sync.

rrjanbiah avatar Dec 13 '19 06:12 rrjanbiah

The other more scalable way is to use CDC on the SQL database

The change feed can then be used to update blast.

This is the pattern typically used because you can then update a myriad of systems when the data in the dB mutates It also means that you respect the transactions in the DB being committed or rollbacked

joeblew99 avatar Dec 24 '19 19:12 joeblew99

@joeblew99 Thanks for sharing your ideas. For Postgres, do you know any solution other than debezium ?

rrjanbiah avatar Dec 30 '19 07:12 rrjanbiah