dongxuej
dongxuej
pytorch-on-angel用的是master的,spark是2.4.5U2,我们用的是纯cpu环境
angel现在用的也是master的,那个就是3.1.0的吧??还是非得下载branch3.1.0
这个classnotfound的问题已经解决了~我现在遇到了新的问题~ -------------------------------------------------------------- Exception in thread "main" java.lang.UnsatisfiedLinkError: no torch_angel in java.library.path 我给的参数如下: input=hdfs://jinrong-hadoop3-1v/home/hdp-jinrong-stargraph/fanqizha/subgraph/input/20191231/ output=hdfs://jinrong-hadoop3-1v/home/hdp-jinrong-stargraph/jiadongxue/angel/model/20191231_deepfm/ source ./spark-on-angel-env.sh echo "------------------" #JAVA_LIBRARY_PATH=/home/work/software/java/lib JAVA_LIBRARY_PATH=/home/work/software/angel/lib:/home/work/software/java/lib echo $JAVA_LIBRARY_PATH $SPARK_HOME/bin/spark-submit \ --conf spark.ps.instances=5 \ --conf spark.ps.cores=1 \...