iceberg-rust icon indicating copy to clipboard operation
iceberg-rust copied to clipboard

[EPIC] Iceberg playground

Open liurenjie1024 opened this issue 8 months ago • 6 comments

Inspired by datafusion cli and pyiceberg cli, we want to have an interactive playground tool so that users could play around with iceberg tables using sql, backed by iceberg-rust and datafusion.

liurenjie1024 avatar Apr 02 '25 13:04 liurenjie1024

icebergcli is great, but as we discussed offline before, the name itself might be confusing. Users could mistake it for an official product provided by us and may submit numerous feature requests. Therefore, I suggest renaming it to "playground" to better reflect its purpose and position.

Xuanwo avatar Apr 17 '25 09:04 Xuanwo

sdd: Reanme to iceberg-explorer

liurenjie1024 avatar Apr 24 '25 15:04 liurenjie1024

I believe there’s still value in maintaining an iceberg-cli integration separate from iceberg-playgroundor iceberg-explorer, which seem geared toward querying with SQL via DataFusion. A lightweight CLI could focus on exposing core Iceberg Rust functionality without overlapping with DataFusion-based query processing. Specifically I'm thinking of interactions with catalog or table APIs that are not scanning tables (e.g. list tables/namespaces, describe table and its schema, get/set properties on tables/namespaces, etc) which is similar to the PyIceberg CLI. Could we preserve iceberg-cli for such non-scanning operations and have a separate integration for this playground functionality that is similar to the DataFusion CLI?

mrcnc avatar Apr 27 '25 15:04 mrcnc

I believe there’s still value in maintaining an iceberg-cli integration separate from iceberg-playgroundor iceberg-explorer, which seem geared toward querying with SQL via DataFusion. A lightweight CLI could focus on exposing core Iceberg Rust functionality without overlapping with DataFusion-based query processing. Specifically I'm thinking of interactions with catalog or table APIs that are not scanning tables (e.g. list tables/namespaces, describe table and its schema, get/set properties on tables/namespaces, etc) which is similar to the PyIceberg CLI. Could we preserve iceberg-cli for such non-scanning operations and have a separate integration for this playground functionality that is similar to the DataFusion CLI?

Yeah, I agree with that, and that's why we rename it to iceberg-explorer. We could have another epic issue to track developing iceberg-cli, which this issue will focus on iceberg-explorer.

liurenjie1024 avatar Apr 28 '25 06:04 liurenjie1024

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

github-actions[bot] avatar Oct 26 '25 00:10 github-actions[bot]

Feature to implement.

liurenjie1024 avatar Oct 27 '25 06:10 liurenjie1024