dctc icon indicating copy to clipboard operation
dctc copied to clipboard

Published 20 hours ago • verified publisher icon dataiku

Hadoop configuration

Open fdouetteau opened this issue 12 years ago • 2 comments

Hadoop parameters could be done the following way:

  • execute hadoop classpath to retrieve hadoop classpath (perhaps cache the result)
  • lookup for hadoop jars / core config in this classpath (perhaps cache the result)

fdouetteau avatar May 13 '13 21:05 fdouetteau

We could do that in addition to $HADOOP_HOME/$HADOOP_PREFIX. However, for jars, I think we need to have distribution detection, to only load the correct jars (and to set up native code paths). Loading all jars of mapr or cdh would probably lead to some conflicts.

cstenac avatar May 14 '13 04:05 cstenac

Hello,

I'm trying to use dctc with Cloudera Hadoop 4.8.0.

dctc complains about missing HADOOP_HOME But it seems to be deprecated as stated here: https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/cd_kOanmZKU

Which solution do I have now ?

jbfavre avatar Jan 13 '14 12:01 jbfavre