gorse icon indicating copy to clipboard operation
gorse copied to clipboard

Kafka connector support

Open ukanwat opened this issue 4 years ago β€’ 2 comments

Is your feature request related to a problem? Please describe. I use Kafka for all of my data streaming requirements because most of the popular databases, data processing systems have Kafka connectors. It would be great if gorse could have such functionality because most of the big data architectures utilize Kafka or similar technology and using REST for data insertion could complicate their data ingestion pipelines. The Applications where gorse could be used for item recommendations are probably going have another database for items, user, etc information or properties, And a lot of them would have a search functionality (take any example like social networks, shopping websites, streaming websites, article websites like medium, etc) that means that the databases that they would use for search, querying, etc may need the same data as gorse. And due to this reason, most systems are going to use a data streaming platform rather than updating each database individually.

Describe the solution you'd like A Kafka sink connector to insert data into the gorse.

Describe alternatives you've considered I am currently adding data to my other databases using Kafka. And REST separately to insert data into the gorse.

Additional context

ukanwat avatar Dec 17 '21 14:12 ukanwat

Do you mean a Kafka cosumer?

zhenghaoz avatar Dec 19 '21 00:12 zhenghaoz

Bot detected the issue body's language is not English, translate it automatically. πŸ‘―πŸ‘­πŸ»πŸ§‘β€πŸ€β€πŸ§‘πŸ‘«πŸ§‘πŸΏβ€πŸ€β€πŸ§‘πŸ»πŸ‘©πŸΎβ€πŸ€β€πŸ‘¨πŸΏπŸ‘¬πŸΏ


Do you mean a Kafka consumer?

Issues-translate-bot avatar Dec 19 '21 00:12 Issues-translate-bot