spark-solr icon indicating copy to clipboard operation
spark-solr copied to clipboard

How to full-import to solr and overwrite

Open kalouku opened this issue 6 years ago • 1 comments

i want to import solr use full-import because my fileds have same name(Productname) and automatically generated uniquekey(id) like -> 1(id) apple(Productname) 15(ProductCount) i try to use .mode(org.apache.spark.sql.SaveMode.Overwrite) to overwrite previous data ,but solr generate same data just different in id,now i have duplicate data.... how to import like full-import to overwrite previous data ? thanks for you help

kalouku avatar Jan 09 '19 03:01 kalouku

spark-solr behaves the same irrespective of the Overwrite mode right now. Make sure your id's match to overwrite the data

kiranchitturi avatar Mar 15 '20 05:03 kiranchitturi