sedona icon indicating copy to clipboard operation
sedona copied to clipboard

Install instructions Sedona/R for AWS EMR?

Open karmaal2010 opened this issue 2 years ago • 2 comments

Hi do you have instructions for installing Sedona for R use on AWS EMR?

karmaal2010 avatar Sep 20 '23 13:09 karmaal2010

@gregleleu Any suggestion?

jiayuasu avatar Sep 22 '23 17:09 jiayuasu

The "hard" part is setting up EMR with R, a few resources:

  • https://spark.rstudio.com/deployment/yarn-cluster-emr
  • https://aws.amazon.com/blogs/big-data/running-sparklyr-rstudios-r-interface-to-spark-on-amazon-emr/

Then you just need to make sure the cluster has the sedona jars. One way is to add the "spark.jars.packages": "" in the configuration. Maybe more details here: https://arunvelsriram.medium.com/adding-custom-jars-to-spark-jobs-on-aws-emr-ea0eb8507f5

gregleleu avatar Sep 24 '23 17:09 gregleleu