alluxio
alluxio copied to clipboard
Excessive number of block reader threads in Alluxio worker.
Alluxio Version:
2.9.3
Describe the bug
Our Alluxio cluster is not in the same data center as HDFS. When the dedicated inter-data center bandwidth is fully utilized, the number of block reader threads of the workers will increase significantly. Moreover, when the inter-data center bandwidth recovers to normal, the Alluxio worker will not automatically recover, which will affect clients and prevent them from reading data. To address this issue, we can only restore the system by restarting the worker. We have a alluxio cluster that has not experienced similar issues since the dedicated inter-data center bandwidth was expanded.
Expected behavior
When the dedicated inter-data center bandwidth recovers to normal, Alluxio worker will also recover automatically.
Urgency
Not very urgent.