OpenMetadata icon indicating copy to clipboard operation
OpenMetadata copied to clipboard

Quicksight ingestion error while fetching databases from Athena Database

Open AboutManuel opened this issue 1 year ago • 1 comments

Affected module Ingestion Framework

Describe the bug Hello Team. We are currently testing the connector to Quicksight. For this purpose I created a Dataset, Analysis and Dashboard there, that fetches the information directly from Athena (No customSQL). We want to specifically test the Lineage feature.

  • We ingested the Athena source using this name for the Service: Athena DataLake
  • We ingested Quicksight adding the same value Athena DataLake for Db Service Names
  • The dashboard shows in the Catalog but the lineage is empty and the DAG returns this:
Search

0 matches
Traceback (most recent call last):
  File "/home/airflow/.local/lib/python3.10/site-packages/metadata/ingestion/source/dashboard/quicksight/metadata.py", line 272, in yield_dashboard_lineage_details
    database_name=data_source_dict[db]["Database"],
KeyError: 'Database'

To Reproduce image image image

Expected behavior Fetch databases, show lineage from Athena source to Quicksight dashboard.

Version:

  • OS: Amazon Linux 2023
  • Python version: 3.9.16
  • OpenMetadata version: [v1.3.1]
  • OpenMetadata Ingestion package version: docker.getcollate.io/openmetadata/ingestion:1.3.1

Additional context Add any other context about the problem here.

AboutManuel avatar Apr 25 '24 18:04 AboutManuel

Hello! I'm experiencing the exact same issue.

pierrebzl avatar May 02 '24 17:05 pierrebzl