nessie icon indicating copy to clipboard operation
nessie copied to clipboard

[Feature]: Support UI to monitor the health status of Iceberg tables

Open nqvuong1998 opened this issue 1 year ago • 4 comments

Description

Nessie should be able to assess the health of a table and alert users to any issues. The assessment of a table's health may involve two factors:

  • File Status: This includes the condition of data files and metadata files in the table. Overly fragmented files and an excessive number of delete files can indicate poor query performance.
  • Data Quality: The data in the table should adhere to user-defined rules.

Expected Use Cases

To monitor Iceberg workloads

Requested Changes in public API

No response

nqvuong1998 avatar Aug 09 '24 10:08 nqvuong1998

cc @snazy @ajantha-bhat

nqvuong1998 avatar Aug 09 '24 10:08 nqvuong1998

Hi @nqvuong1998 : By "UI" do you mean the Nessie OSS UI or some general / custom UI?

dimas-b avatar Aug 09 '24 15:08 dimas-b

Hi @dimas-b , Currently, the Nessie OSS UI only supports displaying branches and commits. It would be beneficial to include table metrics such as snapshots, partitions, and files to assess the health of a table and alert users to potential issues.

nqvuong1998 avatar Aug 09 '24 16:08 nqvuong1998

Well, the Nessie OSS UI does not really have people who can improve it ATM :shrug: ... but contributions are certainly welcome.

For day-to-day activities, the new CLI is actually more feature-rich than the Web UI and hopefully easier to maintain.

dimas-b avatar Aug 09 '24 16:08 dimas-b