datayoga
datayoga copied to clipboard
`relational.write` - deduplication mechanism
When we get the same key in the same batch, the whole batch will probably fail.
First, add a test that verifies it and fails.
Then, add a dedup mechanism that groups the records by the key in the relational.write
block and takes only the latest record per key.