iceberg-python icon indicating copy to clipboard operation
iceberg-python copied to clipboard

Published 20 hours ago • verified publisher icon apache

Inconsistency in catalog.list_tables Behavior Across Python and Java: Returns Non-Iceberg Tables in Python Only

Open HonahX opened this issue 1 year ago • 4 comments

Feature Request / Improvement

I noticed that in python, hive, glue and dynamo list all tables, including non-Iceberg ones, in the namespace https://github.com/apache/iceberg-python/blob/acc934fb76aa6c6e2e32b60c8a99f9e2b2c627dd/pyiceberg/catalog/hive.py#L488-L504 https://github.com/apache/iceberg-python/blob/acc934fb76aa6c6e2e32b60c8a99f9e2b2c627dd/pyiceberg/catalog/glue.py#L584-L613

However, in java, we apply a filter to only return Iceberg tables in the given namespace: GlueCatalog.listTables HiveCatalog.listTables

I forgot if we discussed this before: Why do we choose to include non-iceberg tables in the result in python?

cc @Fokko

HonahX avatar Jan 29 '24 00:01 HonahX