datahub icon indicating copy to clipboard operation
datahub copied to clipboard

[Ingestion] [Snowflake] Load `SNOWFLAKE` database

Open ssassi opened this issue 6 months ago • 0 comments

The Snowflake connector is filtering out the internal SNOWFLAKE database which could be really useful to load.

This query is filtering out such database

Proposal To add a new configuration key to optionally load this database

More Context We asked Snowflake support for help on this matter and they replied this:

Snowflake provides a system-defined, read-only shared database named SNOWFLAKE that contains metadata and historical usage data about the objects in your organization and accounts. Although the Snowflake database is technically a database in the account, it won't be shown in the DATABASES view within the information_schema. This could be either hardcoded into the product or the backend process does not include the database. If this discrepancy causes any issues in your workflow, I would highly encourage you to use the DATABASES view in the ACCOUNT_USAGE schema instead, as this view does include the SNOWFLAKE database. SELECT database_name AS "DATABASE_NAME", created AS "CREATED", last_altered AS "LAST_ALTERED", comment AS "COMMENT" from ACCOUNT_USAGE.DATABASES order by database_name;

ssassi avatar Jul 31 '24 13:07 ssassi