map-reduce topic

List map-reduce repositories

datastore-mapper

21
Stars
1
Forks
Watchers

Appengine Datastore Mapper in Go

gleam

3.4k
Stars
293
Forks
Watchers

Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.

prosto

89
Stars
4
Forks
Watchers

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

ThreadsX.jl

313
Stars
10
Forks
Watchers

Parallelized Base functions

Spark-with-Python

324
Stars
259
Forks
Watchers

Fundamentals of Spark with Python (using PySpark), code examples

poseidon

2.0k
Stars
428
Forks
Watchers

A search engine which can hold 100 trillion lines of log data.

python-bigdata

128
Stars
166
Forks
Watchers

Data science and Big Data with Python

pypar

69
Stars
15
Forks
Watchers

Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

flox

118
Stars
15
Forks
Watchers

Fast & furious GroupBy operations for dask.array