apache-spark-internals

apache-spark-internals copied to clipboard

refine the pending `FIXME` in `addFile` function

2

## Want help refine the leaving `FIXME` in `addFile` function please help review, if you think there are some inappropriate interpretation , I will refine. ### Changes: Firstly, `addFile` validate...

xkx9431

Build (pdf?) for offline reading

3

Hey, is it possible to build an HTML or PDF (preferred) version of this book for offline reading? What would be the process to do that? Thanks

tadas-subonis

It seems that some styling is broken https://books.japila.pl/apache-spark-internals/overview/  https://books.japila.pl/apache-spark-internals/rdd/  

tadas-subonis

Hi, thanks for writing the notebooks. In the [introduction](https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-rdd-partitions.html) to RDD partitioning you mention that the `filter` operation does not preserve partitioning. But I'm looking at the [source code](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/rdd/RDD.scala#L387) where...

rtkaleta

I currently wonder what is a good configuration of spark in case a lot of memory is available (on a single node) http://stackoverflow.com/questions/43262870/spark-with-high-memory-use-multiple-executors-per-node Maybe you could put some clarifying hints...

geoHeil

Could you explain the usage of https://jaceklaskowski.gitbooks.io/mastering-apache-spark/content/spark-MemoryManager.html off heap memory better. For me http://stackoverflow.com/questions/43330902/spark-off-heap-memory-config-and-tungsten it is unclear if off heap is enabled automatically now (2.1.0) as tungsten is enabled by...

geoHeil

Hello, So reading the chapter: https://jaceklaskowski.gitbooks.io/mastering-apache-spark/content/spark-logging.html there is Log4J2 mentioned and linked (docs, etc.) However, I have found that Apache Spark (to my surprise) uses old Log4J1. Here is the...

atais