arroyo icon indicating copy to clipboard operation
arroyo copied to clipboard

Build a Connector for Iggy

Open tbar4 opened this issue 11 months ago • 0 comments

Iggy is the persistent message streaming platform written in Rust, supporting QUIC, TCP and HTTP transport protocols, capable of processing millions of messages per second. Considering Iggy is written in Rust, it would be interesting if there was a connector that was designed to take iggy messages and process them in arroyo.

You could stream iggy directly into DataFusion for processing (similar to Arroyo's architecture) but it would be nice to just build your producer in iggy and have Arroyo be the consumer for stream processing.

https://iggy.rs

tbar4 avatar Jan 02 '25 23:01 tbar4