谈到分布式系统,就不得不提Google的三驾马车:Google fs[1],Mapreduce[2],Bigtable[3]。
虽然Google没有公布这三个产品的源码,但是他发布了这三个产品的详细设计论文。而且,Yahoo资助的Hadoop也有按照这三篇论文的开源Java实现:Hadoop对应Mapreduce, Hadoop Distributed File System (HDFS)对应Google fs,Hbase对应Bigtable。不过在性能上Hadoop比Google要差很多,参见表1。
Experiment |
HBase20070916 |
BigTable |
random reads |
272 |
1212 |
random reads (mem) |
Not implemented |
10811 |
random writes |
1460 |
8850 |
sequential reads |
267 |
4425 |
sequential writes |
1278 |
8547 |
Scans |
3692 |
15385 |