dataall icon indicating copy to clipboard operation
dataall copied to clipboard

Tables deleted in Glue appear in sharable items list

Open SofiaSazonova opened this issue 4 months ago • 0 comments

Describe the bug

  1. ShareObject is created, and all it's sharable items are created at the moment
  2. If we delete table from data.all (but it's still in Glue) this table will be deleted from sharable items (and from DB table)
  3. BUT, if we delete it from glue and sync tables, in data.all it's not deleted from DB, only has mark LastGlueTableStatus = Deleted, so it's disappears from UI (in dataset overview), but still appears in Sharable Items.
  4. If we try to share it, we got an error

How to Reproduce

  1. Create a dataset with 1 table
  2. Make a draft share, see that this table in sharable items
  3. Delete the table from AWS glue (via Lake formation)
  4. Sync tables, so the table disappear in dataset overview
  5. Check share. The table is still present in the sharable items list

Expected behavior

  1. Don't list tables with LastGlueTableStatus = Deleted as sharable items
  2. Check, that share is still healthy, if the already shared table is deleted from glue

Your project

No response

Screenshots

No response

OS

macOs Sonoma 14.2

Python version

3.11

AWS data.all version

2.6.0

Additional context

No response

SofiaSazonova avatar Oct 24 '24 13:10 SofiaSazonova