airbyte icon indicating copy to clipboard operation
airbyte copied to clipboard

Perform catalog diff on get request

Open alovew opened this issue 2 years ago • 1 comments

Resolves https://github.com/airbytehq/oncall/issues/1413

Instead of checking whether there is a new source catalog id for a connection's source, perform a complete catalog diff to determine whether there are schema changes.

There is a bug where schema refreshes result in new actor_catalogs even when there are no schema changes present. This means users' connection pages tell them there are schema changes, and when they refresh their schemas, there are no changes to apply.

This PR changes the Connection Get endpoint so instead of checking whether there is a new actor_catalog available, we perform a full Catalog Diff between the connection's existing catalog and the most recently detected source catalog.

alovew avatar Feb 02 '23 00:02 alovew

Airbyte Code Coverage

There is no coverage information present for the Files changed

Total Project Coverage 24.53% :x:

github-actions[bot] avatar Feb 02 '23 02:02 github-actions[bot]