OpenMetadata
OpenMetadata copied to clipboard
Allow Usage Ingestion Without Displaying Queries
Current Behavior
When running a usage ingestion, All queries against a table display in the "queries" tab.
This can be problematic if queries contain sensitive data (I.E. select * from table where ssn='123-456-7890') as well as can reduce the functionality of the queries tab by cluttering it with trivial/recurring queries.
Preferred Solution
Option 1: allow the ingestion of usage statistics and query percentile without populating the "queries" tab with the contents of the queries.
Option 2: create a separate tab that shows "curated queries" that maintainers can put "sample/quickstart" queries to see how to query a data source, without the user having to see a feed of what is actually being run. (This also requires being able to hide the existing queries tab from users)