关于分布式系统
怎么学
课程
6.824: Distributed Systems https://pdos.csail.mit.edu/6.824/
MIT: 纸上得来终觉浅,绝知此事要躬行
知乎
学习分布式系统需要怎样的知识?https://www.zhihu.com/question/23645117
老鸟讲怎么学习分布式系统
论文
The Google File System
惊异于如此简单,却如此强大,就这么实现了
MapReduce: Simplified Data Processing on Large Clusters
突破性的思想
The Chubby lock service for loosely-coupled distributed systems
paxos的实现
Bigtable: A Distributed Storage System for Structured Data
Spanner: Google’s Globally-Distributed Database
Finding a needle in Haystack: Facebook’s photo storage
文件metadata全部放在内容,减少磁盘读取
Dynamo: Amazon’s Highly Available Key-value Store
用户来解决一致性问题
Cassandra - A Decentralized Structured Storage System
Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing
从磁盘到内存,又一次思想突破
Windows Azure Storage – A Highly Available Cloud Storage Service with Strong Consistency
资源
一个神列表
想从事分布式系统,计算,hadoop等方面,需要哪些基础,推荐哪些书籍?
https://www.zhihu.com/question/19868791
分布式系统资源大汇总,多到看不完
Paxos
Quora:Distributed Systems: What is a simple explanation of the Paxos algorithm?
https://www.quora.com/Distributed-Systems-What-is-a-simple-explanation-of-the-Paxos-algorithm
讲解paxos算法的一些资源
博客
Consensus Protocols: Paxos
http://the-paper-trail.org/blog/consensus-protocols-paxos/深入浅出,厘清核心概念
The Raft Consensus Algorithm
https://raft.github.io/动画演示算法,生动
书籍
Distributed systems for fun and profit
http://book.mixu.net/distsys/
作者日本人,简单,你懂的
个人体悟
6.824: Distributed Systems应该来一把,边干边学,效果最佳,不然没人逼你,走马观花,终不得其要领。
这门课本身就是在读论文,干项目,最后完成一个简单的分布式文件系统