dagger icon indicating copy to clipboard operation
dagger copied to clipboard

Published 20 hours ago • verified publisher icon raystack

Implement BQ sink in Dagger using ODPF sink

Open gauravsinghania opened this issue 2 years ago • 0 comments

Acceptance Criteria

  • Add Basic BigQuery Sink using the sink-connector APIs.

  • Configure Proto/JSON Serialiser to convert Row into OdpfMessage

  • Call sink APIs to push messages to BQ.

Out of scope:

  • No batching

  • No checkpointing.

gauravsinghania avatar Apr 05 '22 13:04 gauravsinghania