spark-notes

spark-notes copied to clipboard

A JNI error has occurred

1

Error: A JNI error has occurred, please check your installation and try again Exception in thread "main" java.lang.NoClassDefFoundError: scala/collection/immutable/List at java.lang.Class.getDeclaredMethods0(Native Method) at java.lang.Class.privateGetDeclaredMethods(Class.java:2701) at java.lang.Class.privateGetMethodRecursive(Class.java:3048) at java.lang.Class.getMethod0(Class.java:3018) at java.lang.Class.getMethod(Class.java:1784)...

luckywind

您好。sequenceFile返回的RDD不能正常的persist，我想重写这个功能（比如sequenceFilePersist），最终目标是让返回RDD可以不通过map函数直接persist。想请问，我需要从继承或者扩展哪个类下手呢？十分感谢。

wangfeng1981

我在添加jars之前都和题主一样。但是添加完jars之后出现了以下错误，能不能帮我看看哪里出了问题 Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties 17/08/02 16:56:21 INFO SparkContext: Running Spark version 2.3.0-SNAPSHOT 17/08/02 16:56:22 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes...

Jiawen-huang