Robert Pack

Results 141 comments of Robert Pack

> Is there a document to explain the re-writing? Not a publicly accessible one yet. The basic logic is quite simple though. 1. We create a `LogSegment`, which contains the...

@PengLiVectra - about to start reviving this. To keep things smaller could we update the test table to not contain so many files and only the commits we need for...

> For example, we have commits 0, 1, 2, 4, 5, peek_next_commit(2) will return commit 4, skip the missed commit 3. this would be considered a seriously corrupted table. Did...

@emcake - thanks for taking care of this! Seems there is one more clippy error to address :).

Object store is coupled to datafusion. Had a first glance, and it seems like fixable problem, but may require some work.

Certainly ... `std::fs::rename` will [replace](https://doc.rust-lang.org/std/fs/fn.rename.html) the file at the target location if it already exists. The concurrency mechanics in delta heavily rely on that not happening :). The basic idea...

Well, we went over this several times, also with the core team and general consensus was that an a-priori check without any lock mechanism would not prevent any race conditions....

HEy @RobinLin666 @ion-elgreco, sorry for being MIA for a while. Since blob-fuse is a valid use case, I guess we have to do simething about it. generally I was hoping...

We may have some additional aspects into consideration when selecting the files to be vacuumed. As it stands I think we may accidentally delete deletion vector files for files that...

I haven't checked the codebase fully, but did some work on that recently. Specifically the S3 code is still quite messy. IIRC the priority issue should actually be that if...