conduit icon indicating copy to clipboard operation
conduit copied to clipboard

Connector: Surrealdb [Source/Destination]

Open nickchomey opened this issue 1 year ago • 3 comments

Resource name

Surrealdb

Resource link

https://surrealdb.com/

Connector type

Source/Destination

Expected connector behavior

Surrealdb is a new and very promising "multi-model" database that covers relational, nosql, graph, vector, full text search, and more. This allows for consolidating many databases/stores into one, as well as affords new functionality.

One of the main obstacles to its adoption, however, is actually importing the data from numerous sources. They have an existing discussion for adding cdc to surreal, where theyve been discussing rolling their own - which makes no sense at all when Conduit exists and supports all the major databases, data stores etc...

https://github.com/orgs/surrealdb/discussions/3

Surreal also has various mechanisms for receiving live updates from the database, so it could very well be a Conduit Source as well - to feed an event driven architecture or whatever.

nickchomey avatar May 15 '24 13:05 nickchomey

@nickchomey Thanks for opening this issue! SurrealDB looks like an interesting project.:) The team will definitely consider this connector. When it comes to the connectors that we implement ourselves, we prioritize based on interest shown by the dev community and based on our company's needs. However, if anybody else wants to start implementing the connector sooner than that, our team will be happy to assist with guidelines and advice.

hariso avatar May 16 '24 08:05 hariso

This would be quite awesome...

cope avatar Aug 26 '24 09:08 cope

I never provided a link, but here's an early WIP. I stopped working on it though because of a bunch of limitations in Surreal - lack of bulk delete/upsert, and poor performance across-the-board. I remain hopeful for it though.

https://github.com/nickchomey/conduit-connector-surrealdb

nickchomey avatar Dec 10 '24 23:12 nickchomey