alluxio icon indicating copy to clipboard operation
alluxio copied to clipboard

Excessive number of block reader threads in Alluxio worker.

Open humengyu2012 opened this issue 1 year ago • 6 comments

Alluxio Version:

2.9.3

Describe the bug

Our Alluxio cluster is not in the same data center as HDFS. When the dedicated inter-data center bandwidth is fully utilized, the number of block reader threads of the workers will increase significantly. Moreover, when the inter-data center bandwidth recovers to normal, the Alluxio worker will not automatically recover, which will affect clients and prevent them from reading data. To address this issue, we can only restore the system by restarting the worker. We have a alluxio cluster that has not experienced similar issues since the dedicated inter-data center bandwidth was expanded.

image

Expected behavior

When the dedicated inter-data center bandwidth recovers to normal, Alluxio worker will also recover automatically.

Urgency

Not very urgent.

humengyu2012 avatar Jun 04 '23 17:06 humengyu2012