Fokko Driesprong

Thanks for reporting this. I like it! We need to have support for lazy datasets before this becomes feasible.

@hililiwei I'm sorry, this also fell off my radar.

@vinjai Great, I've assigned it to you!

@vinjai Since we ignore the write-order today, I think proceeding is fine. Maybe raise a warning so the user knows the data isn't being sorted. Sorting in Python would be...

Let's pass this to the next release when we have all the transforms implemented using the Rust extension. cc @sungwy

@swapdewalkar Thanks for picking this up! I've just assigned it to you

@chinmay-bhat I think we can generalize this quite easily, since from the spec: > Once written, data and metadata files are immutable until they are deleted. I think we could...

@chinmay-bhat I don't think it is as easy as that. We should ensure that the `manifest_list` path is part of the cache. We could share the cache between calls, since...

@MehulBatra can you rebase?

@syun64 thanks for raising this. With the freshly merged write support, we can do: ```python cat = load_catalog('default') tbl = cat.load_table('default.some_table') tbl.overwrite(df: pa.Table) ``` The overwrite will create a new...