Jeremy Loscheider

icon company Panera Bread, Inc icon location St. Louis, MO icon location I'm a Data Scientist with Panera Bread focusing on operations and working in GCP. I also mentor four LiveProjects for Manning.

Results 1 issues of Jeremy Loscheider

Heap memory miscalculation?

1 comment

From: https://github.com/spoddutur/spark-notes/blob/master/distribution_of_executors_cores_and_memory_for_spark_application.md ``` Memory per executor = 64GB/3 = 21GB Counting off heap overhead = 7% of 21GB = 3GB. So, actual --executor-memory = 21 - 3 = 18GB ```...