datayoga
datayoga copied to clipboard
datayoga-io
streaming data pipeline platform
Need to implement kafka auth methods https://docs.confluent.io/platform/current/kafka/overview-authentication-methods.html
Add a connector to the Amazon S3 bucket. To have such a block that writes records to an S3 bucket.
Currently, there are separate README files for both the CLI and core components. To streamline the development process, it is better to consolidate these two README files into a single...
`relational.write` - delete and insert strategy for upsert in databases without native merge support
Ability to send multiple records at once for APIs that support it, we probably should such a flag in the block.
In our system, we require the ability to specify a specific field such as last_updated, rowid, rownum, or any other relevant indicator. This designated field will serve as a reference...
two blocks: http to fetch data (webservices) http to post data as a sink