datayoga
datayoga copied to clipboard
datayoga-io
streaming data pipeline platform
to support interpolation of context properties like the 'data dir'
should include line number in the original yaml, name of the step that was trying to use
`read_redis_stream`, `read_kafka_stream`: consider not acking messages, but managing offsets instead
@zalmane - should be discussed.
`write_sql` should be a leaf block, `read_readis_stream` should be the first block, etc.