lakeFS icon indicating copy to clipboard operation
lakeFS copied to clipboard

KV Testing - When Scan fails, DeleteWhileIterating gets stuck

Open itaidavid opened this issue 2 years ago • 6 comments

Deadlock due to wrong usage of routines synchronization with channels - both routines report error on the (blocking) error channel, which is never listened, due to the main routine blocked on the sending channels

itaidavid avatar May 30 '22 20:05 itaidavid

Comment from @arielshaqed:

Please note that this kind of thing will be hard to fix precisely if you allow deletes while iterating. Ideally you could use partitions, and then allow deleting only entire partitions that are completely unused so without concurrent iteration. (Other things can be handled by writing a tombstone).

In really not optimistic about rapid iteration on KVs in the presence of concurrent delete operations.

itaidavid avatar May 30 '22 20:05 itaidavid

This issue is now marked as stale after 90 days of inactivity, and will be closed soon. To keep it, mark it with the "no stale" label.

github-actions[bot] avatar Nov 01 '23 14:11 github-actions[bot]

Closing this issue because it has been stale for 7 days with no activity.

github-actions[bot] avatar Nov 11 '23 01:11 github-actions[bot]

Is this still open? Sounds like a bug waiting to happen if it is...

arielshaqed avatar Nov 19 '23 08:11 arielshaqed

This issue is now marked as stale after 90 days of inactivity, and will be closed soon. To keep it, mark it with the "no stale" label.

github-actions[bot] avatar Feb 19 '24 01:02 github-actions[bot]

This will never go stale, but we might close it if we think about it hard enough and write the explanation here.

arielshaqed avatar Feb 19 '24 17:02 arielshaqed