leofs icon indicating copy to clipboard operation
leofs copied to clipboard

[leo_mq] Anti entropy activities should prioritize the item with a low redundancy

Open mocchira opened this issue 7 years ago • 0 comments

Now leo_mq consumes items one by one by simply iterating all items through eleveldb's iterator, however let's say a LeoFS running with N=3, R=W=D=2 and one node in the cluster has following 10,000 items in a leo_mq for recover object consistency item A0001 have 2 redundancy (missing 1 replicas), ... item A9999 have 2 redundancy (missing 1 replicas), item B0001 have 1 redundancy (missing 2 replica). In this case, the current IMPL will consume B0001 after fetching 9,999 items although should we consume B0001 at first in accordance with its low redundancy? otherwise the possibility of data lost could increase as the duration being low redundancy is too long more than necessary.

mocchira avatar Feb 16 '18 08:02 mocchira