nalgeon
Redis Streams support
Are there a plans to implement streams?
Redka Streams would be perfect replacement for Redis Streams in many Kafka use cases where disk storage is required and/or memory is restricted.
Yes, definitely.
Support for full streams API would allow me to switch from Kafka to Redka Streams for dev/ci/testing environments. Using Redis Streams currently doesn't have much sense to me, because of high requirements for a memory which is way more expensive than disk in a cloud. My use cases usually require long data retention but are fine with reduced performance.
If you only use Kafka in production (and Redis/Redka in dev/test), doesn't that mean that Kafka-related features don't get tested at all? Is that wise?
I'm using te same protocol on all environments. Currently it's Kafka. I could switch to Redis/Redka streams everywhere, if Redka supports streams. Then I could use Redka for dev/testing and some managed Redis solution for production.
I see, thanks for the explanation! I will look into streams after the 1.0 release.
I'll leave the issue open to see if anyone else is interested in this feature.
Streaming can be done relatively easily with NATS Jetstream. It's the classic Kafka replacement.
NATS Jetstream is open source apache and part of CNCF, so reliable long term.
https://github.com/nats-io/nats-server
NATS server can run embedded, not embedded and embedded in process. So it matches redka in that sense too. The streams can be durable or not durable.
Hope this is useful.
