how to use glusterfs-hadoop plugin

[SWhite4han]

trafficstars

I want to build glusterfs-hadoop plugin on my hadoop system. I built hadoop0.20.0 and glusterFS3.3beta4 form source tarball on ubuntu12.04 and found the way to install glusterfs-hadoop plugin at "https://forge.gluster.org/hadoop/glusterfs-hadoop/blobs/master/README" , but I could not find "$GLUSTER_HOME/hdfs/0.20.2" at line39. Should I have to move the directory "hadoop/*" to "$GLUSTER_HOME/" ,or another way to solve this problem?

[jayunit100]

Hi, when you run "mvn package", will get a jar in target/. It won't match the exact version number in this readme of course. Maybe we should update the instructions . In any case...

Just take that jar from target and put it in /usr/lib/hadoop/lib and update /etc/hadoop/conf/ core-site and other XML files as instructed on the glusterforge Hadoop wiki set up pages.

[SWhite4han]

Thanks for your feedback. But I got test error when run "mvn package" under $GLUSTER_HOME/hdfs/hadoop-glusterfs-hadoop".

[INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 3.641s [INFO] Finished at: Tue Nov 11 16:28:45 CST 2014 [INFO] Final Memory: 10M/176M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.4.3:test (default-test) on project glusterfs-hadoop: There are test failures. [ERROR] [ERROR] Please refer to /opt/glusterfs-3.3.0beta4/hdfs/hadoop-glusterfs-hadoop/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

What did this error mean?

---

Im trying "sudo mvn package -Dmaven.surefire.debug" .The process stop at "Listening for transport dt_socket at address: 5005".

[SWhite4han]

I ran "sudo mvn -Dmaven.test.skip=true package" to slove this problem.

[INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 21.742s [INFO] Finished at: Thu Nov 20 10:30:03 CST 2014 [INFO] Final Memory: 11M/175M [INFO] ------------------------------------------------------------------------