Awesome Distributed Systems

A curated list of awesome distributed systems papers, libraries, software, middleware, books, etc. Feel free to add your links!

Table of Contents:

• Consensus protocols
• Queues
• Distributed databases
• NoSQL
• Conflict-free replicated data type
• Distributed filesystems
• Classes
• Books
• Interviews
• Links & articles
• Blogs
• Videos

Consensus protocols:

• Paxos:
  • Lessons Learned from Implementing Paxos
  • Paxos made live: an engineering perspective
• Raft
• Gossip Protocol
• SERF

Used By:

• Zookeeper
• ETCD

Queues

• Kafka
• RabbitMQ
  • Introduction to RabbitMQ
  • Dissecting the rabbit: RabbitMQ Internal Architecture

Distributed databases:

• Cassandra
• Dynamo
• Riak
• Couchbase
• Data Access for Highly-Scalable Solutions: Using SQL, NoSQL, and Polyglot Persistence

NoSQL

• Couchbase
• MongoDB
• RavenDB

Conflict-free replicated data type

• Conflict-free replicated data type on Wikipedia
• A Look at Conflict-Free Replicated Data Types (CRDT)
• Operational transform
• Consistency levels for both read and writes in distributed databases like Cassandra
• CRDT provides an eventually consistent result so long as the data types available are used. Used by Riak distributed database and presence in Phoenix.

Distributed filesystems

• GlusterFS
• Apache Hadoop HDFS
• Ceph: A Linux petabyte-scale distributed file system
• InterPlanetary File System (IPFS)

Classes:

• MIT CSAIL schedule
• Class materials for a distributed systems lecture series
• Reliable Distributed Algorithms - Part 1
• MIT's Distributed Algorithms class by Lynch
  • Supplementary Reading List
  • Geambasu's Teaching

Books

• Distributed Systems(2017): [Free] Maarten van Steen, Andrew Tanenbaum.
• Designing Distributed Systems(2018): Brendan Burns. Cofounder of Kubernetes, illustrates some common pattern for distributed systems.

Interviews

• system-design-primer
• system-design-interview
• interactive-coding-challenges

Links and articles:

• Notes on Distributed Systems for Young Bloods(2013)
• Distributed systems theory for the distributed systems engineer
• Programming Models for Distributed Computing
• Jeff Dean's famous talk
• Testing distributed systems
• Self-contained systems (alternative to microservices)
• Pease stop calling databases CP or AP
• The quest for availability in the cloud
• CAP Twelve Years Later: How the "Rules" Have Changed

Blogs:

• All Things Distributed

Videos:

• Inside Azure Datacenter Architecture with Mark Russinovich : Build 2018
• Scaling Instagram Infrastructure
• How Modern SQL Databases Come up with Algorithms that You Would Have Never Dreamed Of