arroyo
arroyo copied to clipboard
Build a Connector for Iggy
Iggy is the persistent message streaming platform written in Rust, supporting QUIC, TCP and HTTP transport protocols, capable of processing millions of messages per second. Considering Iggy is written in Rust, it would be interesting if there was a connector that was designed to take iggy messages and process them in arroyo.
You could stream iggy directly into DataFusion for processing (similar to Arroyo's architecture) but it would be nice to just build your producer in iggy and have Arroyo be the consumer for stream processing.
https://iggy.rs