Unable to fetch the target s3 file

[kraviteja]

From the docs, http://www.geomesa.org/documentation/tutorials/geodocker-geomesa-spark-on-aws.html#bootstrap-an-emr-cluster

Unable to launch the cluster, as bootstrap action is not working

aws emr create-cluster
--name "GeoDocker GeoMesa"
--release-label emr-5.2.0
--output text
--use-default-roles
--ec2-attributes KeyName=KEY_NAME
--applications Name=Hadoop Name=Zookeeper Name=Spark
--instance-groups
Name=Master,InstanceCount=1,InstanceGroupType=MASTER,InstanceType=m3.xlarge
Name=Workers,InstanceCount=3,InstanceGroupType=CORE,InstanceType=m3.xlarge
--bootstrap-actions
Name=BootstrapGeoMesa,Path=s3://geomesa-docker/bootstrap-geodocker-accumulo.sh,Args=[-t=geomesa-$VERSION-accumulo-1.8.0,-n=gis,-p=secret,-e=TSERVER_XMX=10G,-e=TSERVER_CACHE_DATA_SIZE=6G,-e=TSERVER_CACHE_INDEX_SIZE=2G]

[jnh5y]

@kraviteja sorry for the trouble; I believe I fixed this issue this morning. I know it has been 2 and a half months; lemme know if you retry and are successful.

[kraviteja]

@jnh5y Thank you for the fix, I could see the logs for the tablet servers. Can you please let me know where are the logs going for accumulo master.

[jnh5y]

The logs for the Accumulo master process would be on the master AWS node. If you ssh there, I'd check /var/log/accumulo and $ACCUMULO_HOME/logs. (I can remember where Accumulo puts its logs in the GeoDocker version of things...)

[kraviteja]

The issue is logs are not coming up in $ACCUMULO_HOME/logs directory. Can you let me know how do I fix that ?

On Thu, Oct 26, 2017 at 2:56 PM, James Hughes [email protected] wrote:

The logs for the Accumulo master process would be on the master AWS node. If you ssh there, I'd check /var/log/accumulo and $ACCUMULO_HOME/logs. (I can remember where Accumulo puts its logs in the GeoDocker version of things...)

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/geodocker/geodocker-geomesa/issues/3#issuecomment-339782699, or mute the thread https://github.com/notifications/unsubscribe-auth/AFDNoaZeVhP9Vw5MR7FON4jwCCglwG5iks5swOQGgaJpZM4MA7bx .

[jnh5y]

Hmm... where are you looking? You might have to attach a Bash shell to the Docker instance and check there... I'm not a Docker expert, you might be able to get a quicker answer here: https://gitter.im/geodocker/geodocker.

[jessepinkman9900]

I used the command

aws emr create-cluster                                \
    --name "GeoDocker GeoMesa"                        \
    --release-label emr-5.2.0                         \
    --output text                                     \
    --use-default-roles                               \
    --ec2-attributes KeyName=__KEY_NAME__             \
    --applications Name=Hadoop Name=Zookeeper Name=Spark \
    --instance-groups                                    \
      Name=Master,InstanceCount=1,InstanceGroupType=MASTER,InstanceType=m3.xlarge \
      Name=Workers,InstanceCount=3,InstanceGroupType=CORE,InstanceType=m3.xlarge  \
    --bootstrap-actions                                                                        \
      Name=BootstrapGeoMesa,Path=s3://geomesa-docker/bootstrap-geodocker-accumulo.sh,Args=\[-t=geomesa-$VERSION-accumulo-1.8.0,-n=gis,-p=secret,-e=TSERVER_XMX=10G,-e=TSERVER_CACHE_DATA_SIZE=6G,-e=TSERVER_CACHE_INDEX_SIZE=2G]

• facing the same issue that Master instance failed attempting to download bootstrap action 1 file from S3
• is the file in a new location?
  • aws s3 ls s3://geomesa-docker
  • throws error: An error occurred (NoSuchBucket) when calling the ListObjectsV2 operation: The specified bucket does not exist

can anyone point me to the bootstrap-geodocker-accumulo.sh file