training
training copied to clipboard
Use screen, mosh, or another tool to help work around against dropped connections
Dropped connections can either leave your workspace in an unclean state (eg, with Shark/BlinkDB) or cause you to lose a lot of progress (with MLBase when you need to recreate all of your models, etc.). I recommend installing and adding instructions for using screen, mosh, or another tool that will allow for recovering after a disconnection.
Thanks for proposing this. I think it's a really great idea.
@shivaram, does the AMI have screen on it currently? It seems like it wouldn't be too confusing for folks if we added a step that has them launch screen and perhaps explain a few crucial screen commands.
I am not sure if we have it on the AMI, but I just added a yum install -y screen
to the launch scripts to make sure it is there.
FYI https://github.com/mesos/spark-ec2/commit/222e7275db3b91208ecb530a1d189c85658b0839