Harshal Sheth comments

Results 177 comments of


                                            Harshal Sheth

draft: feat(iceberg): Bump version of pyiceberg to 0.6.0 to support SQL Catalog

@usmanovbf looks like CI is having some issues due to version conflicts

fix(ingest/mssql): remove lower() method from sql_common get_db_name

@sleeperdeep looks like this is causing some tests to fail

[Tableau] workbook fetches the `id` field when the rest of project/dashboard/chart fetches the `luid` field

@hhong96 the workbook urns are a guid generated by combining the platform, platform instance, and id (not luid). See usages of `WorkbookKey` in the code e.g. https://github.com/datahub-project/datahub/blob/e6e5c091ed7b7c8ca73b062cec92d0c3cacc02e7/metadata-ingestion/src/datahub/ingestion/source/tableau.py#L2425 I'd rather not...

fix(ingest/sagemaker): Adding option to control retry for any aws source

@treff7es looks like there's a lint issue + merge conflict here

Unable to ingest Elasticsearch data streams

> The [aliases API](https://github.com/datahub-project/datahub/blob/1b3bbf8234adf6c04b90fb6d0f62ce0254b7ec09/metadata-ingestion/src/datahub/ingestion/source/elastic_search.py#L372) no longer includes data stream indices. I'm not too familiar with the elastic source - what API should we be calling instead?

bigquery-beta shouldn't try to performance log based lineage when the recipe didn't enable lineage

@jinlintt the fixes for this bug have been released, so I'm closing the issue now.

UI ingestion for kafka-connect lacks of java

I believe this was fixed by #6365 or https://github.com/acryldata/datahub-actions/pull/15 - the latest datahub-actions image v0.0.9 should work. Please let me know if you still have issues @KulykDmytro and we can...

feat(ingestion): allow multiple metabase databases with same platform

@remisalmon In general we've been trying to move towards using platform instances and `platform_instance_map`, and are working on deprecating `database_alias` and similar fields. The reasoning is that platform instance services...

feat(ingestion): allow multiple metabase databases with same platform

Sounds good, thanks @remisalmon.

In the case of temp table, the redshift Lineage cannot be obtained accurately.

This was fixed by https://github.com/datahub-project/datahub/pull/9704