BenMizrahiPlarium

Results 4 comments of BenMizrahiPlarium

Hi @jahstreet, I did the setup using the config section in Livy create session request - in other use cases I think that the jar artifacts downloaded from maven is...

I really think it’s because Spark has no shared file system between workers and driver. As a workaround for now - I solve it using gsfuse by mounting google bucket...

In don’t think that spark.kubernetes.file.upload.path is related to external maven dependencies- it’s related to the spark application jar uploaded to S3. Spark downloading maven dependencies into local maven repository and...