Incremental Metadata Extraction is dispalyed for sources that are not supported

[sushi30]

trafficstars

Affected module Ingestion, UI

Describe the bug Incremental metadata extraction is supported only for some the database sources. Namely, those that store DDL and DML queries in some log. This configuration should not be available for databases that dont support it (like MySQL, Postgres, MSSQL).

When enabled for unsupported sources this configuration does not change the behavior of the ingestion process.

To Reproduce

Expected behavior A clear and concise description of what you expected to happen.

Version:

• OS: [e.g. iOS]
• Python version:
• OpenMetadata version: [e.g. 0.8]
• OpenMetadata Ingestion package version: [e.g. openmetadata-ingestion[docker]==XYZ]

Additional context Add any other context about the problem here.

[pmbrull]

as part of this, we should think how to generalize/improve ingestion config handling on the UI:

1. how to display/hide not supported options
2. how to better group configurations: Filters, Metadata, Security, Advanced Options
3. Improve Filters to be added instead of ocupying a big chunk of the page
4. We can try to handle better defaults in filtering. E.g., excluding INFORMATION_SCHEMA by default

Basically the configs now seem super complicated, we should simplify it while keeping it flexible for more advanced users

[harshach]

@chirag-madlani re-assing