SONG JAECHANG

Results 6 comments of SONG JAECHANG

As mentioned by @shkhrgpt, this is caused by the inability to parse the SHS event log based on spark 2.x. SparkDataCollection class processes SHS event log based on spark 1.4,...

@ethanhunt07 To get spark aggregation metric values, you need to set spark.executor.instances and spark.executor.memory option. Did you set that options? If the spark.executor.instances and spark.executor.memory options are not present, the...

@Pravdeep Did you compile feature/support_spark_2.x branch? I used spark 2.1.2 and hadoop 2.3.0. Because my code use spark 2.x feature, spark version need to set 2.x+.

@Pravdeep By your log message, it seems that there is a problem with the certificate. You must add a valid certificate . If you google the error message, you will...

@Pravdeep The difference between my branch and dr-elephant master branch is nothing more than a library version. Certificate problems are mainly caused by your build environment problems. Perhaps it is...

@Windyhe if you can't set spark.executor.instances or spark.executor.memory value, aggregation don't work.