gis-tools-for-hadoop icon indicating copy to clipboard operation
gis-tools-for-hadoop copied to clipboard

GP tools point-in-polygon-aggregation-mr not working

Open trumboosahil opened this issue 10 years ago • 12 comments

I followed your tutorial at gis-tools-for-hadoop / samples / point-in-polygon-aggregation-mr / gp / README.md but not Tool is not working and shows red X's on the GP Tools from the Hadoop Tools toolbox. However as suggested at same location to double click rectangle in the model and reset the location of the tool.

I acted accordingly after my double click it shows error dialog with "Unable to execute the selected tool." I tried to right click->edit on the "Run Sample Application" but nothing happens.

I'm using ArcGIS desktop 10.2 with Advances ArcInfo licenses

trumboosahil avatar Nov 20 '14 08:11 trumboosahil

The sample model requires the GP tools from https://github.com/Esri/geoprocessing-tools-for-hadoop. Put the model in the same folder as the tools.

climbage avatar Nov 20 '14 16:11 climbage

I did this already and as a matter of fact the documentation of this subject is good but needs lot of improvement

trumboosahil avatar Nov 20 '14 19:11 trumboosahil

I agree that the documentation on the GP tools can be improved.

climbage avatar Nov 21 '14 16:11 climbage

What error do you get when you view the toolbox in the Catalog window? (right click the toolbox, "check syntax") image

smambrose avatar Nov 24 '14 19:11 smambrose

Please check the screen shot in catalog window as under</B>

catalog

Please see the screen shot in ArctoolBox and also when I double - click on "Run Sample Application"

arctool

trumboosahil avatar Nov 25 '14 06:11 trumboosahil

Did you delete the files requests or webhdfs?

If not - are you able to view your model at all? (right click on model, edit).

smambrose avatar Nov 25 '14 15:11 smambrose

I didn't delete the file from requests or webhdfs when I right click on model at select edit option nothing happens

trumboosahil avatar Nov 26 '14 06:11 trumboosahil

I am not able to reproduce this yet.

  1. Were you at any point able to edit and see the model? (like in image 1)
  2. Did you try and verify and/or run your model while you still had model builder open?
  3. Was the model coloured in when you tried to run it - like : image ?
  4. Did you save any settings in the ArcToolbox (either to file or default)?
  5. Have you been able to run the tools not in the model builder (just standalone)?

smambrose avatar Nov 26 '14 16:11 smambrose

Thanks for your help I got it working

trumboosahil avatar Nov 27 '14 06:11 trumboosahil

After running the Oozei Job in armap the Job runs and goes on running:

image

And in oozei Dashboard I found please check bold text

2014-11-30 02:27:14,481 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@:start:] Start action [0000000-141130021902027-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2014-11-30 02:27:14,482 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@:start:] [_0000000-141130021902027-oozie-oozi-W@:start:]Action status=DONE 2014-11-30 02:27:14,482 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@:start:] [_0000000-141130021902027-oozie-oozi-W@:start:]Action updated in DB! 2014-11-30 02:27:15,846 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@eq-node] Start action [0000000-141130021902027-oozie-oozi-W@eq-node] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2014-11-30 02:47:30,833 WARN ActionStartXCommand:544 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W " @eq-node] Error starting action [eq-node]. ErrorType [TRANSIENT], ErrorCode [ JA006], Message [ JA006: Call From quickstart.cloudera/127.0.0.1 to quickstart.cloudera:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused] org.apache.oozie.action.ActionExecutorException: JA006: Call From quickstart.cloudera/127.0.0.1 to quickstart.cloudera:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412) at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:392) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:980) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1135) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63) at org.apache.oozie.command.XCommand.call(XCommand.java:281) at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323) at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.ConnectException: Call From quickstart.cloudera/127.0.0.1 to quickstart.cloudera:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused"

trumboosahil avatar Nov 30 '14 11:11 trumboosahil

And in continuation of above comment in oozei web console

image

trumboosahil avatar Nov 30 '14 11:11 trumboosahil

Have you had any luck with this? This seems like an issue with the Oozie setup on your Cloudera VM.

climbage avatar Dec 03 '14 22:12 climbage