Nicholas Chammas

Results 194 comments of Nicholas Chammas

> Hi @nchammas , yes it's an official Amazon Linux 2 image Can you show me where exactly you are seeing that? I am not able to find mention of...

I'm not sure where `ami-0578f46b79ca9e3e7` is coming from, either. Please try an AMI returned by this list: ```sh aws ec2 describe-images \ --region eu-central-1 \ --owners amazon \ --filters \...

I will leave the issue open and re-title it to focus on this storage-related problem. Flintrock should handle it more gracefully, even if we don't support it.

This is a neat PR. @shivaram - What is the likelihood that a new set of spark-ec2 AMIs will ever be generated? Do we want to mark files like `create_image.sh`...

The way we solved this in [Flintrock](https://github.com/nchammas/flintrock) is to dynamically install Java 8 at launch time if it isn't detected on the instance. That avoids the lengthy process of needing...

For those still waiting for spark-ec2 to support Spark 2.2, I recommend taking a look at my project, [Flintrock](https://github.com/nchammas/flintrock). It's basically a faster spark-ec2 with a better user experience. If...

Getting Spark to use Python 3 is generally a simple matter of setting `PYSPARK_PYTHON=python3` or something similar. But this question is about including Python 3 in the pre-baked AMI, which...

Flintrock clusters have fewer out-of-the-box tools compared to spark-ec2. We don't install ganglia, for example. So the launch burden is lower, and it frees Flintrock to use the generic Amazon...

> I wonder if we can remove support for a bunch of them and make them optional via the run-command (i.e. we have a python-setup.sh in the spark-ec2 tree and...