dvryaboy

With Raghu's refactoring, we can set the inputFormat and outputFormat as follows: ``` job.setInputFormatClass( LzoProtobufB64LineInputFormat.getInputFormatClass(MyProtobufClass.class, conf) ); ``` We need to do the same for Writables, as this: job.setOutputValueClass(ThriftWritable.class); doesn't...

Docs/perf best practices update

4

Closes #(Insert issue number closed by this PR) ## Change Description Adds some more details to perf tips regarding reading directly from the backing object store, based on conversation in...

Compress indexes

4

I added an interface to index reading/writing and provided an alternate representation of the index, which should drop the size of our index files about 4x. Haven't tested on real...

Smaller lzo indexes: make #43 apply to current codebase

3

Make smaller lzo indexes by encoding the offsets instead of just writing them down naively. Note this does not address any of @rangadi's comments from 2 years ago on #43,...