airbyte icon indicating copy to clipboard operation
airbyte copied to clipboard

Destinations: Refreshes: Track stream statuses in async framework

Open edgao opened this issue 1 year ago • 2 comments

closes https://github.com/airbytehq/airbyte-internal-issues/issues/7608; closes #7621

  • track stream statuses
  • pass stream status into the StreamSyncSummary
  • AbstractStreamOperation skips overwriteFinalTable if the status was not COMPLETE

this PR has "safe" default behavior, i.e. if platform doesn't send a stream status message then we assume success. This is compatible with older platform versions. See https://github.com/airbytehq/airbyte/pull/38067 for how we switch to the backwards-incompatible behavior (which is required for no data downtime).

edgao avatar May 08 '24 21:05 edgao

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Jun 10, 2024 4:41pm

vercel[bot] avatar May 08 '24 21:05 vercel[bot]

  • #38067 Graphite: 2 dependent PRs (#38086 Graphite, #38622 Graphite)
  • #38331 Graphite
  • #38075 Graphite 👈
  • #38121 Graphite: 1 other dependent PR (#39107 Graphite)
  • #38770 Graphite
  • master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @edgao and the rest of your teammates on Graphite Graphite

edgao avatar May 08 '24 21:05 edgao

/publish-java-cdk

:clock2: https://github.com/airbytehq/airbyte/actions/runs/9452252277 :white_check_mark: Successfully published Java CDK version=0.37.1!

edgao avatar Jun 10 '24 16:06 edgao