filecrush

filecrush copied to clipboard

Dear devs, I wanted first to thank you for this piece of software, really great! I have one request I would like to raise with you, if possible. Could you...

ghost

does not compress output files

1

`$ hadoop jar target/filecrush-2.2.2-SNAPSHOT.jar com.m6d.filecrush.crush.Crush --info --verbose --threshold=0.1 --compress=gzip /user/arustamov/crush{17,18} $(date +%Y%m%d%H%M%S) outDir is: tmp/crush-a7ea6dac-c48a-483f-a652-1be09b8cfaff/out Using temporary directory tmp/crush-a7ea6dac-c48a-483f-a652-1be09b8cfaff16/07/01 09:56:51 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 16/07/01 09:56:51...

alrustamov

Hi Folks, This is not a bug as such - just that I am not sure the capabilities of the --regex and --replacement features. What I want is ideally to...

alexmc6

Better Logging needed when fileformat is in question

1

I managed to run filecrush for the first time and after everything _seemed_ to finish successfully I got this error. In fact although it reported loads of files to crush...

alexmc6

Add support for filecrushing on Elastic MapReduce

2

**Work-in-progress PR - do not pull yet** Hi @edwardcapriolo - this is an open pull request to add support for using filecrush on EMR. There are three main things to...

alexanderdean

It looks like there is no way to set the number of reduces with V2 style arguments. It seems this was supported with V1 style arguments. int maxTasks = Integer.parseInt(args[2]);...

prashs