lakeFS
lakeFS copied to clipboard
S3 blockstore Delete uses wait to verify object is gone
S3 should enable read after write - no need to wait for object to be deleted. This makes the call expensive and slow.
I know that I asked for this :-) But I'm having second thoughts. It probably needs to be optional because not all blockstores will be suitable. Maybe even default false.
While S3 is consistent like this, many other S3-"compatible" blockstores will not be compatible. For instance, MinIO on some NFS-mounted drives might not be consistent, or on Ext4. See this MinIO blog for how hard this can be. That blog also hints that some unnamed blockstores might not have {list,read}-after-write consistency.
This issue is now marked as stale after 90 days of inactivity, and will be closed soon. To keep it, mark it with the "no stale" label.
Closing this issue because it has been stale for 7 days with no activity.
Re-opening: there is potential for some modest performance gain here!
Re-opening: there is potential for some modest performance gain here!
@arielshaqed Care to explain? Why do we even wait in the first place?
In practice we no longer use Adapter.Remove. Closing this, in favour of removing Remove.