Databricks Unity Catalog ingestion ignores `user_email_pattern` config

[vladimirivkovic]

Describe the bug The user_email_pattern config seems to be ignored during the Unity Catalog ingestion.

To Reproduce Steps to reproduce the behavior:

1. Go to Ingestion
2. Click on Create new source
3. Choose Databricks Unity Catalog
4. Open the YAML view
5. Add user_email_pattern: {deny: ['<my_user_email>']} in config section
6. Run the ingestion job (Next, Next, Save & Run)

Expected behavior Since include_usage_statistics and include_top_n_queries are enabled by default, it is expected to see statistics without a specified user in Stats > Top Users and without the user's queries in Queries tab.

Desktop (please complete the following information):

• OS: Ubuntu 22.04
• Browser: Firefox
• Version: 0.13

[github-actions[bot]]

This issue is stale because it has been open for 30 days with no activity. If you believe this is still an issue on the latest DataHub release please leave a comment with the version that you tested it with. If this is a question/discussion please head to https://slack.datahubproject.io. For feature requests please use https://feature-requests.datahubproject.io

[github-actions[bot]]

This issue was closed because it has been inactive for 30 days since being marked as stale.