filecrush
filecrush copied to clipboard
edwardcapriolo
Remedy small files by combining them into larger ones.
Bumps [plexus-utils](https://github.com/sonatype/plexus-utils) from 1.1 to 3.0.16. Commits See full diff in compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps jetty from 6.1.14 to 6.1.23. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
**LZO seems to almost work; I'm not sure if it's known to or if there is a slight bug. I hope I'm missing something everyone else can see** **When I...
Bumps [junit](https://github.com/junit-team/junit4) from 4.8.2 to 4.13.1. Release notes Sourced from junit's releases. JUnit 4.13.1 Please refer to the release notes for details. JUnit 4.13 Please refer to the release notes...
Hi, I am facing this issue while trying to crush the directory hadoop jar /home/cloudera-scm/sunny/filecrush-master/target/filecrush-2.2.2-SNAPSHOT.jar com.m6d.filecrush.crush.Crush home/cloudera-scm/sunny/OCNs/ /home/cloudera-scm/sunny/testing/ 20200901010101 Exception in thread "main" java.lang.IllegalArgumentException: The value of property avro.output.codec must...
When we run crusher on hive directory, it works like charm for first time.But for the next run, It cant move the original files. So we end up having both...
Does it support merging avro files? When I provide the following command, I get an error saying that FileInputFormat is invalid.. Command: hadoop jar filecrush-2.2.2-SNAPSHOT.jar com.m6d.filecrush.crush.Crush -Ddfs.block.size=134217728 \ --input-format="org.apache.avro.mapred.AvroInputFormat" \...
~/git/filecrush`[1131] $ hadoop jar target/filecrush-2.2.2-SNAPSHOT.jar com.m6d.filecrush.crush.Crush /user/arustamov/4 /user/arustamov/crush 20160701073112 16/07/01 07:31:50 INFO Configuration.deprecation: mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress 16/07/01 07:31:50 INFO Configuration.deprecation: mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type 16/07/01...
Can you mention maven build command for this project, sorry i am very new for maven
Metadata
Owner
Metadata
Remedy small files by combining them into larger ones.