Hadoop: Support for other versions

[opraveen]

I am particularly interested in a non-official Hadoop release based of 2.7.2, which supports some instrumentation).

Could someone provide directions to achieve this - can I just build this version from source on an instance from baseline AMI, and create a new AMI? Are there any general guidelines in this regard.

[opraveen]

I am able to install the hadoop version I am interested in and created a new AMI.

StarCluster could start a cluster (without hadoop plugin) using this AMI. However, I see this error while starting a hadoop cluster:

Configuring Hadoop... Adding user opraveen to hadoop group 1/1 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
!!! ERROR - Error occured while running plugin 'hadoop': !!! ERROR - error occurred in job (id=master): remote command 'source /etc/profile && gpasswd -a opraveen hadoop' failed with status 3: gpasswd: group 'hadoop' does not exist in /etc/group