Michael Spector

I haven't had an idea yet.. I'll try to create an evaluation account in GCP and debug it there. On Mon, Feb 10, 2020, at 16:51, NormalScene wrote: > @spektom...

Hi, The script should collect metrics regardless of exit code. Please try the following: - Start your Spark streaming application with `--conf spark.streaming.stopGracefullyOnShutdown=true` - Let the application run, and collect...

Can you please try the latest version from master? (f66976e70)

Should be fixed with latest master.

Hi @yzhan-te, No special configuration is needed, it's added automatically by the script. What can be checked is: - Look into Spark UI of the running process, and inspect Java...

Can you look at the Java process command line (`ps -ef | grep java`) and see whether there are these Java properties?

This is the Spark client application command line. What's interesting is the driver and executor processes themselves. Could you get them as well? Thanks!