OpenMetadata

OpenMetadata copied to clipboard

Let's see if we can figure out a full-fledged query we can run to get all necessary table data etc. The less time we need to keep a connection open...

pmbrull

make sure that we are pushing the filter predicates down. Moreover, for Snowflake, validate if and how we can use ACCOUNT_USAGE instead of INFORMATION_SCHEMA. Same with BigQuery.

pmbrull

on how to run all the pieces for each connector. We need to migrate some more info from gitbook to the new docs

pmbrull

even if we comment them out

pmbrull

TeddyCr

Support pluggable parser for querylog source & Mysql & Postgres implmentations

1

The current query log parser expects a CSV like https://github.com/open-metadata/OpenMetadata/blob/main/ingestion/examples/sample_data/glue/query_log.csv. This works well for MySQL - but not for Postgres. https://openmetadata.slack.com/archives/C02B6955S4S/p1659545895833039?thread_ts=1659538699.033179&cid=C02B6955S4S Postgres is storing different columns in different structures. Set...

geoHeil

and make explicit that we need read write many for airflow https://openmetadata.slack.com/archives/C02B6955S4S/p1659534787307759

pmbrull

Docker compose file for Postgres deployment

4

**Feature** Currently, we only publish a docker-compose.yml file with mysql and getting a postgres deployment is not straightforward. It would be great to have separate docker compose for mysql and...

vivekratnavel

From the MSSQL Query: ``` SELECT db.NAME database_name, t.text query_text, s.last_execution_time start_time, DATEADD(ms, s.total_elapsed_time, s.last_execution_time) end_time, NULL schema_name, NULL query_type, NULL user_name, NULL aborted FROM sys.dm_exec_cached_plans AS p INNER JOIN...

pmbrull

Broken data quality tests possible could be posted to OM

1

**Affected module** Ingestion Framework **Describe the bug** For now it is possible to publish data quality tests with broken config. After that happens all profiler jobs fails because python OpenMetadata...

Curiosady