flink-remote-shuffle icon indicating copy to clipboard operation
flink-remote-shuffle copied to clipboard

Add more information about the ShuffleWorker in the ShuffleManagerClient

Open Aitozi opened this issue 2 years ago • 0 comments

By default, the shuffleManagerClient will print the log as below. But the worker Instance id is not human readable. It can not quick link to the target ShuffleWorker. We need to check the ShuffleManager.log first and then find the target problem worker's ip

2022-05-17 17:10:28,860 INFO  [shuffle-client-JobID{ID=F3918B137043C8D49EBDDBF68CD9D923}] com.alibaba.flink.shuffle.client.ShuffleManagerClientImpl    [] - Got unrelated shuffle worker: InstanceID{ID=31312E3132342E3137372E3136303A33353239392D43314436303544373745364330423843}
2022-05-17 17:10:28,860 INFO  [shuffle-client-JobID{ID=F3918B137043C8D49EBDDBF68CD9D923}] com.alibaba.flink.shuffle.client.ShuffleManagerClientImpl    [] - Got newly related shuffle worker: InstanceID{ID=31312E3132342E3136312E3232393A34353932352D43393734413030463338383239303638}

Aitozi avatar May 17 '22 09:05 Aitozi