skein
skein copied to clipboard
java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/client/ClientRMProxy
Thanks for this project!
Python 3.7.6
skein 0.8.0
openjdk version "1.8.0_265"
Hadoop 3.2.1
After running the following command:
skein driver start --log-level debug --log log.txt
I get the error Error: Failed to start java process
with the following log output:
20/10/13 15:34:15 DEBUG skein.Driver: Starting Skein version 0.8.0
20/10/13 15:34:15 DEBUG skein.Driver: Logging in using ticket cache
20/10/13 15:34:17 ERROR skein.Driver: Error running Driver
java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/client/ClientRMProxy
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceStart(YarnClientImpl.java:233)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
at com.anaconda.skein.Driver.getYarnClient(Driver.java:313)
at com.anaconda.skein.Driver.run(Driver.java:282)
at com.anaconda.skein.Driver.main(Driver.java:175)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.client.ClientRMProxy
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 5 more