iceberg-python icon indicating copy to clipboard operation
iceberg-python copied to clipboard

Rewrite manifests

Open amitgilad3 opened this issue 10 months ago • 10 comments

This is an initial implementation of rewrite manifests, aiming to mimic the Java implementation as closely as possible. I’ve tried to follow the same structure and logic, but there are still some areas that might need refinement.

I’m looking for feedback and suggestions on: • Whether the approach aligns well with the existing design. • Any gaps or optimizations that could improve performance. • How best to proceed with completing this feature.

Would love any insights or guidance on the next steps! Thanks in advance for the review! 🙌

amitgilad3 avatar Feb 13 '25 20:02 amitgilad3

@amitgilad3 gentle ping, are you still interested in working on this?

Fokko avatar Apr 17 '25 13:04 Fokko

Hey @Fokko , yes i am very interested in finishing this, must of missed this (sorry) , will look at this later today :)

amitgilad3 avatar Apr 17 '25 14:04 amitgilad3

Looks like the CI is sad 😞

tests/integration/test_writes/test_rewrite_manifests.py:154: error: "rewrite_manifests" of "Table" does not return a value (it only ever returns None)  [func-returns-value]
tests/integration/test_writes/test_rewrite_manifests.py:227: error: "rewrite_manifests" of "Table" does not return a value (it only ever returns None)  [func-returns-value]

Fokko avatar May 16 '25 21:05 Fokko

Hey @Fokko - just wanted to say thanks for reviewing (really appreciate it) . I fixed all your comments and added a test to test v1 -> v2 , hope all pass now. let me know if i have more work todo :)

amitgilad3 avatar May 17 '25 14:05 amitgilad3

@Fokko gentle ping, was wondering if we still have any blockers ?

amitgilad3 avatar Jun 03 '25 12:06 amitgilad3

Hi @amitgilad3 - sorry for the delayed turn around. There's a question in slack regarding this PR, and I wanted to take a stab at helping merging this in, in Fokko's absence.

Are you still interested in working on this PR? Would you be available to resolve the conflicts?

sungwy avatar Jul 25 '25 13:07 sungwy

Wondering what the status of this PR is, happy to re-create if you're no longer able to work on it @amitgilad3

Anton-Tarazi avatar Sep 24 '25 03:09 Anton-Tarazi

Hey @sungwy , @Anton-Tarazi i missed the messages , will fix this week all issues

amitgilad3 avatar Sep 24 '25 20:09 amitgilad3

I have a local rebased version of this PR, if it's needed ...

aammar5 avatar Oct 15 '25 18:10 aammar5

@amitgilad3 any updates on this? Im happy to help if need :)

ForeverAngry avatar Nov 10 '25 20:11 ForeverAngry