Bug - Tableau Ingestion must throw an error when there are errors with code= BACKFILL_RUNNING

[nicor88]

Affected module Ingestion

Describe the bug When tableau metadata store is in backfilling mode, it could happen that data models and dashboards are removed and marked as deleted if markDeletedDashboards: false. This could lead to various issues:

• broken lineage
• missing data models
• missing dashboards

To Reproduce It's hard to reproduce, as it depends on tableau cloud running quarterly, and based on tableau instance it can take a week.

Expected behavior When the API or grapql is result contains:

{
  "errors": [
    {
      "message": "Still creating the Metadata API Store. Results from the query might be incomplete at this time.",
      "extensions": {
        "severity": "WARNING",
        "code": "BACKFILL_RUNNING"
      }
    }
  ],
  "data": {
    ....
  }
}

When errors contains code=BACKFILL_RUNNING I would like to have the ingestion throwing an error if markDeletedDashboards=True to avoid to have unexpected behaviours like relevant metadata removed from OM.

Version:

• OS: Linux
• Python version: 3.11
• OpenMetadata version: 1.3.2
• OpenMetadata Ingestion package version: 1.3.2.0

Additional context As a workaround I implemented the check above in my ingestion pipeline to avoid unexpected in the future.