corral
corral copied to clipboard
bcongdon
🐎 A serverless MapReduce framework written for AWS Lambda
Hello, Greetings of the day. First of I would like to thank you for sharing your marvelous work. It amazed me and I have just started exploring it. Though I...
I'm running the word count program over a 86GB dataset. The data is utf8, already sanitized with newlines and spaces. I already know that the total words is around 29000M...
As discussed in #6, it might be useful to have a flag that skips the compilation/deployment step for Lambda invocations. Pros: - If you have a really complicated job (code...
You mention ETL as a common use case - could you add an example that does something like ETL?
Is it worth adding the ability to change the record split function? Currently records are split by newline, and any split function would have to conform to the [bufio.SplitFunc](https://golang.org/pkg/bufio/#SplitFunc) signature,...
An analog of Hadoop's "Combiner" will reduce the amount of data needed to be written to the global map output for certain workloads. The combiner should have the same interface...