SONG JAECHANG
SONG JAECHANG
As mentioned by @shkhrgpt, this is caused by the inability to parse the SHS event log based on spark 2.x. SparkDataCollection class processes SHS event log based on spark 1.4,...
@ethanhunt07 To get spark aggregation metric values, you need to set spark.executor.instances and spark.executor.memory option. Did you set that options? If the spark.executor.instances and spark.executor.memory options are not present, the...
@Pravdeep Did you compile feature/support_spark_2.x branch? I used spark 2.1.2 and hadoop 2.3.0. Because my code use spark 2.x feature, spark version need to set 2.x+.
@Pravdeep By your log message, it seems that there is a problem with the certificate. You must add a valid certificate . If you google the error message, you will...
@Pravdeep The difference between my branch and dr-elephant master branch is nothing more than a library version. Certificate problems are mainly caused by your build environment problems. Perhaps it is...
@Windyhe if you can't set spark.executor.instances or spark.executor.memory value, aggregation don't work.