terraform-provider-airbyte icon indicating copy to clipboard operation
terraform-provider-airbyte copied to clipboard

datasource airbyte_connection fails to provide a list of selected fields

Open jonseymour opened this issue 5 months ago • 0 comments

Scenario

data "airbyte_connection" "extract" {
  connection_id = <some-connection-id>
}

Expected result

data.airbyte_connection.extract.configurations.streams.<stream>.selected_fields contains exactly the list of selected fields in the configured <stream> of the <some-connection-id> connection.

Actual Result

data.airbyte_connection.extract.selected_fields is the empty list, otherwise known as []

The empty list has these unhelpful properties:

  • it doesn't have any elements
  • it can't be used to distinguish between fields which are selected, but are INEXPLICABLY not in the list AND
  • fields that have not been selected and arguably, should not be in the list of selected fields

Therefore, as currently implemented, the selected_fields output SERVES NO USEFUL PURPOSE

If the provider is incapable of provising an accurate list of selected fields, it should not provide one at all. Then the consumers of the provider won't have to waste time attempting to usefully consume a list that is always empty and thus PROVIDES NO USEFUL, BUT HIGHLY MISLEADING output.

This makes this datasource beyond useless.

jonseymour avatar Sep 13 '24 03:09 jonseymour