[EPIC] Iceberg playground
Inspired by datafusion cli and pyiceberg cli, we want to have an interactive playground tool so that users could play around with iceberg tables using sql, backed by iceberg-rust and datafusion.
icebergcli is great, but as we discussed offline before, the name itself might be confusing. Users could mistake it for an official product provided by us and may submit numerous feature requests. Therefore, I suggest renaming it to "playground" to better reflect its purpose and position.
sdd: Reanme to iceberg-explorer
I believe there’s still value in maintaining an iceberg-cli integration separate from iceberg-playgroundor iceberg-explorer, which seem geared toward querying with SQL via DataFusion. A lightweight CLI could focus on exposing core Iceberg Rust functionality without overlapping with DataFusion-based query processing. Specifically I'm thinking of interactions with catalog or table APIs that are not scanning tables (e.g. list tables/namespaces, describe table and its schema, get/set properties on tables/namespaces, etc) which is similar to the PyIceberg CLI. Could we preserve iceberg-cli for such non-scanning operations and have a separate integration for this playground functionality that is similar to the DataFusion CLI?
I believe there’s still value in maintaining an
iceberg-cliintegration separate fromiceberg-playgroundoriceberg-explorer, which seem geared toward querying with SQL via DataFusion. A lightweight CLI could focus on exposing core Iceberg Rust functionality without overlapping with DataFusion-based query processing. Specifically I'm thinking of interactions with catalog or table APIs that are not scanning tables (e.g. list tables/namespaces, describe table and its schema, get/set properties on tables/namespaces, etc) which is similar to the PyIceberg CLI. Could we preserveiceberg-clifor such non-scanning operations and have a separate integration for this playground functionality that is similar to the DataFusion CLI?
Yeah, I agree with that, and that's why we rename it to iceberg-explorer. We could have another epic issue to track developing iceberg-cli, which this issue will focus on iceberg-explorer.
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
Feature to implement.