spark-knn

spark-knn copied to clipboard

Hi saurfang, I find the release [here](https://mvnrepository.com/artifact/saurfang/spark-knn/0.3.0), but the ``` // https://mvnrepository.com/artifact/saurfang/spark-knn libraryDependencies += "saurfang" % "spark-knn" % "0.3.0" ``` Not working for me.

zhenglin0

Exception occurred when initializing new KNNRegression()

6

val knn = new KNNRegression().setTopTreeSize(df.count().toInt / 500) .setFeaturesCol("features") .setPredictionCol("predicted") .setK(1) This throws the following exception, Caused by: java.lang.ClassNotFoundException: org.apache.spark.ml.param.shared.HasInputCols$class at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

ashanwijenayake

Getting K nearest neighbor for each data point

2

Would you please advise how to get K nearest neighbors for each data point using the python interface? I believe this is possible based on " KNN itself is also...

jnejati

spark 3.1.1

1

Upgrade to Spark 3.1.1

dzlab

CL: - Add check that `topTreeSize` parameter is greater than the input data size. Throws an exceptions stating this. Motivation behind the change was on this raised issue: https://github.com/saurfang/spark-knn/issues/21 about...

aaronquantexa

Nearest Neighbor between two dataframes

3

Hi, Thanks for the amazing work! I have two dataframes, A has about 200 Million points and B has about 10 Million points, I want to find the nearest neighbor...

rbhatia46

Model save support

5

I saved a model(KNNClassificationModel) using java serialization and when I use it later, I always get **_java.lang.IllegalArgumentException: Flat hash tables cannot contain null elements._** on the dataframe output of the...

davis-varghese

spark.jars and spark.driver.extraClassPath can‘t help me import pyspark_knn

JuyiShang

offline use in pyspark2.3.3

3

eterk

Can anybody help me with this? I used the python related part on README.md : ``` py4j.protocol.Py4JJavaError: An error occurred while calling None.org.apache.spark.ml.classification.KNNClassifier. : java.lang.NoSuchMethodError: org.apache.spark.ml.param.shared.HasInputCols.$init$(Lorg/apache/spark/ml/param/shared/HasInputCols;)V at org.apache.spark.ml.classification.KNNClassifier.(KNNClassifier.scala:23) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native...

sadransh