Explore Possibilities for other DB for system metrics

[TeddyCr]

Context In https://github.com/open-metadata/OpenMetadata/pull/10856 we added logic to "cache" system data for BQ and Snowflake, hence reducing the read to 1 for n table profiled. We should take a similar approach for Redshift

We shoud also take advantage of this issue to explore the possibility to surface this metrics for other DB.

A.C.

• [x] Redshift system data are cached and only 1 DB read is needed for n tables profiled
• Add additional DB to support system metrics (priority):
  • [x] Databricks
  • [ ] Hive
  • [x] MySQL
  • [ ] Postgres
  • [ ] AzureSQL
  • [ ] Athena

[harshach]

marking it as P0 for 1.6, as more and more users are asking for this. We should enable this for

1. Postgres 2. MySQL 3. Oracle as well
2. Allow users to pick the option of system level or query based row count for more accuracy

[TeddyCr]

Oracle and MySQL we are already supporting