awesome-distributed-systems

A curated list of awesome distributed systems books, papers, resources and shiny things.

Bootcamp

• CAP Theorem
• Fallacies of Distributed Computing
• Distributed systems theory for the distributed engineer
  Chinese version: 面向分布式系统工程师的分布式系统理论

Books

• Distributed Systems for fun and profit
• Distributed Systems Concepts and Design(Fifth Edition) - George Coulouris
• Distributed Systems Principles and Paradigms - Andrew Tanenbaum
• 走向分布式
• Distributed Machine Learning Patterns - Yuan Tang, Practical patterns for scaling machine learning from your laptop to a distributed cluster.

Courses

• Cloud Computing Concepts, University of Illinois
• CMU: Distributed Systems in Go Programming Language
• Principles of Distributed Computing
• Distributed Systems Fall 2015
• Distributed Systems - MIT
• Introduction to Distributed System Design - Google Code University

Papers

Storage

• Dynamo: Amazon's Highly Available Key Value Store
• Bigtable: A Distributed Storage System for Structured Data
• The Google File System
• Cassandra: A Decentralized Structured Storage System
• Availability in Globally Distributed Storage Systems
• Sheepdog: Distributed Storage System for KVM
• PacificA: Replication in Log-Based Distributed Storage Systems
• Finding a needle in Haystack: Facebook’s photo storage
• Windows Azure Storage: A Highly Available Cloud Storage Service with Strong Consistency

Databases

• Spanner: Google’s Globally-Distributed Database
• Tera - 高性能、可伸缩的结构化数据库

Resource Management

• Apache Hadoop YARN: Yet Another Resource Negotiator
• Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center

Data Processing

• MapReduce: Simplified Data Processing on Large Clusters
• Pregel: A System for Large-Scale Graph Processing

Query Processing

• Design and Implementation of a Query Processor for a Trusted Distributed Data Base Management System

Messaging Systems

• The Log: What every software engineer should know about real-time data's unifying abstraction
  Chinese version 日志：每个软件工程师都应该知道的有关实时数据的统一概念
• Kafka: a Distributed Messaging System for Log Processin

Distributed Consensus

• The Part Time Parliament, Lamport's original Paxos paper, but it's a bit difficult to understand.
• Paxos Made Simple, a more terse readable Paxos paper by Lamport himself.
• The Chubby Lock Service for loosely coupled distributed systems
• Paxos made live - An engineering perspective
• Raft Consensus Algorithm
• Paxos vs Raft

Others

• Time, Clocks, and the Ordering of Events in a Distributed System

Blogs and other reading links

• What are some good resources for learning about distributed computing? Why?