mrjob icon indicating copy to clipboard operation
mrjob copied to clipboard

PipeMapRed.waitOutputThreads(): subprocess failed with code 1

Open sdiniz73 opened this issue 4 years ago • 0 comments

Hello,

When executing the script, the error below is generated: Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads (): subprocess failed with code 1 My environment is a cluster with 5 servers, 1 with the applications and the other forming a High Availability Hadoop cluster (2 NameNodes and 2 DataNodes).

I'm running the command where the source is in HDFS:

"python mr_word_freq_count.py hdfs:///mapred/u.data -r hadoop"

The script is executed from the application server.

But I've done everything and nothing works.

Locally runs normally.

I attach the Yarn log.

Thank you

Hadoop 3.2.0 Python 3.7.3

yarn_error.txt

sdiniz73 avatar Jun 23 '20 02:06 sdiniz73