gis-tools-for-hadoop icon indicating copy to clipboard operation
gis-tools-for-hadoop copied to clipboard

Need GP tool for executing mapreduce jobs using HCatalog

Open climbage opened this issue 10 years ago • 0 comments

Justification

  • Oozie has far too complicated of a set up for simply executing a a jar file
  • HCatalog is now part of Hive which comes standard with most Hadoop distributions
  • Simple rest interface
% curl -s -d user.name=ctdean \
   -d jar=wordcount.jar \
   -d class=org.myorg.WordCount \
   -d libjars=transform.jar \
    -d arg=wordcount/input \
    -d arg=wordcount/output \
    'http://localhost:50111/templeton/v1/mapreduce/jar'

See https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference+MapReduceJar.

climbage avatar Nov 20 '14 16:11 climbage