datahub
datahub copied to clipboard
[Ingestion] [Snowflake] Load `SNOWFLAKE` database
The Snowflake connector is filtering out the internal SNOWFLAKE
database which could be really useful to load.
This query is filtering out such database
Proposal To add a new configuration key to optionally load this database
More Context We asked Snowflake support for help on this matter and they replied this:
Snowflake provides a system-defined, read-only shared database named SNOWFLAKE that contains metadata and historical usage data about the objects in your organization and accounts. Although the Snowflake database is technically a database in the account, it won't be shown in the DATABASES view within the information_schema. This could be either hardcoded into the product or the backend process does not include the database. If this discrepancy causes any issues in your workflow, I would highly encourage you to use the DATABASES view in the ACCOUNT_USAGE schema instead, as this view does include the SNOWFLAKE database. SELECT database_name AS "DATABASE_NAME", created AS "CREATED", last_altered AS "LAST_ALTERED", comment AS "COMMENT" from ACCOUNT_USAGE.DATABASES order by database_name;