storm-hdfs
storm-hdfs copied to clipboard
ptgoetz
Storm components for interacting with HDFS file systems
Hi there, Thanks much for this contrib. We kind of design a log aggregating system which collects logs from sources. The system puts all the log lines into a single...
[INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 23.296 s [INFO] Finished at: 2016-12-19T14:13:57+05:30 [INFO] Final Memory: 8M/153M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project chapter1:...
My Requirement is need to compress Hdfs loaded data. when tried to implement the code by extending the HdfsBolt. it was compressed data but when i tried to decompress the...
I am getting the following exception while executing a sample storm hdfs code in local mode 20311 [Thread-9-hdfs_bolt] WARN org.apache.hadoop.ipc.Client - Exception encountered while connecting to the server : java.lang.IllegalArgumentException:...
Hi, Using the github project we are able to write into APACHE hadoop. But when we are trying to write in Clouderra hadoop hdfs its failing. Its creating the file...
Thanks much for this contrib. First, could you confirm that the current HdfsState implementation is non-transactional state and so there is no guarantee that data gets written to HDFS exactly...
MoveFileRotation rotates even 0-sized files. For non-continous streams and especially when microbatching, the number of 0-sized files can become problematic. A modification to the MoveFileRotation to delete 0-sized files instead...
Storm now offers the ability to use forwardable, renewable tickets to authenticate to Hadoop. This commit makes it possible to use these tickets rather than fixed keytab files, which are...
master:/home/hadoop-1.1.2 # hadoop jar /home/mahout/mahout-distribution-0.8/mahout-examples-0.8-job.jar org.apache.mahout.clustering.syntheticcontrol.kmeans.Job Warning: $HADOOP_HOME is deprecated. 14/12/10 18:50:23 INFO kmeans.Job: Running with default arguments 14/12/10 18:50:23 INFO kmeans.Job: Preparing Input 14/12/10 18:50:24 WARN mapred.JobClient: Use GenericOptionsParser...
