l.zonghai

cannot run css cluster

4

1. if I use all default settings, and start as `sbin/start-all.sh`, a Worker and a Master are running but when I submit a Spark app, it throw `Caused by: java.lang.RuntimeException:...

what may cause RssInvalidServerVersionException?

2

Hi, I am wondering: Q1. if `RssInvalidServerVersionException` will occur when RSS-i is restarted by a shell script as soon as it crashes due to some reasons meanwhile some applications are...

How to evaluate rss cluster size?

1

Hi, we have about `20,000` daily spark applications. All these apps produce `100TB` shuffle writes/reads data respectively. A peak app produces `6TB`, but most produce less than `100GB`. We ran...

Disk damage causes failure

10

Hi，`RSS_1` runs with ` -rootDir /data_01/rss-data/` ... `RSS_i `runs with ` -rootDir /data_i/rss-data/` . When a disk _eg_.`/data_03` is damaged, Spark app failed. The code shows that `spark.shuffle.rss.replicas` (default=1) is...

How long the shuffle data of each ShuffleStage will be stored in RSS nodes?

6

The char shows the shuffle stages of an application After `Stage-1` ShuffleWriting 349GB data, next 2 shuffle stages have no ShuffleWrite data, is the 349GB data will be cleaned when...