unionml icon indicating copy to clipboard operation
unionml copied to clipboard

Integration: Kafka for streaming predictions

Open cosmicBboy opened this issue 2 years ago • 3 comments

We're planning on adding streaming support via AWS lambda https://github.com/unionai-oss/unionml/issues/19, but to support folks who use Kafka as their streaming DB, we'll need to think about how a UnionML app might be used to deploy a streaming endpoint.

This issue will track the problem statement, use case, and proposed solutions for doing this.

cosmicBboy avatar Jun 22 '22 16:06 cosmicBboy

I think adding support for Basic Kafka consumer would be fantastic - https://docs.confluent.io/kafka-clients/python/current/overview.html#delivery-guarantees. Would this work for other users?

kumare3 avatar Jun 22 '22 16:06 kumare3

https://developer.confluent.io/get-started/python/

cosmicBboy avatar Jun 22 '22 20:06 cosmicBboy

ya infact this one - https://developer.confluent.io/get-started/python/#build-consumer

kumare3 avatar Jun 23 '22 04:06 kumare3