initialization-actions icon indicating copy to clipboard operation
initialization-actions copied to clipboard

[oozie] intermittent error writing to HDFS during init action

Open cjac opened this issue 1 year ago • 1 comments

Some users may experience script failure when clusters start the oozie init action script prior to HDFS being fully online.

+ hadoop fs -put -f /tmp/oozie-install-m95M/share /user/oozie/
2023-08-07 20:41:35,938 WARN hdfs.DataStreamer: DataStreamer Exception
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/oozie/share/lib/pig/hadoop-yarn-client-3.3.3.jar._COPYING_ could only be written to 0 of the 1 minReplication nodes. There are 0 datanode(s) running and 0 node(s) are excluded in this operation.
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:2315)

cjac avatar Aug 14 '23 20:08 cjac