ignite icon indicating copy to clipboard operation
ignite copied to clipboard

Consistent hashing algorithm leads to uneven distribution of partitions.

Open baimu7 opened this issue 4 months ago • 0 comments

Hello, we are using Ignite 2.15 in our project. In practice, we found that the partition assignment method RendezvousAffinityFunction, which is based on consistent hashing, has an issue with uneven distribution. For example, when assigning partitions to 120 nodes, the number of partitions assigned to each node varies significantly. Is there any way to solve this problem?

Alternatively, if our project does not need to consider backups or data migration caused by nodes joining or leaving the cluster, can we simply use a straightforward hash function instead of consistent hashing for partition assignment? If so, what potential issues might arise from this approach?

Image

RendezvousAffinityFunctionTest.java

baimu7 avatar Aug 25 '25 12:08 baimu7