devrivne

Faced the same issue. Spark hangs forever right after the writing to parquet stage ended. kubernetes-client-5.4.1 Server Version: version.Info{ > Major:"1", > Minor:"21+", > GitVersion:"v1.21.5-eks-bc4871b", > GitCommit:"5236faf39f1b7a7dabea8df12726f25608131aa9"

Yep, I had OOM issues that preceded the above error. Bumping up the version to 5.50 helped to catch it. No app hanging, just usual OOM crash.