lehnerm

Hi @JoshRosen, thanks for your reply, here's a overview of our setup: - Spark 1.5.0 on YARN (Amazon EMR 4.1) - Spark-Redshift 0.5.2 - Scala 2.10 / Java 7 -...

Been doing some research on s3 consistency. From the S3 docs, one would expect that the observed behavior is not possible when dataFrame.save() in spark is a fully blocking operation....

Hi @JoshRosen, sorry for my late response, to answer your questions: Have you configured and Hadoop or Spark OutputCommitter settings to be different than their defaults? No Are you using...