MapReduce 与 Cloud Dataflow, Caffeine, Dremel,Pregel 之间的关系

• MapReduce的继任者 -- Google Cloud Dataflow

At its core, Cloud Dataflow is Google’s successor to  MapReduce , which has been an experimental App Engine feature for quite a while now.   http://techcrunch.com/2014/06/25/google-launches-cloud-dataflow-a-managed-data-processing-service/

• MapReduce的有力补充（交互） -- Dremel：

作为MapReduce 的发起人，Google开发了Dremel将处理时间缩短到秒级，作为MapReduce的有力补充。

http://www.oschina.net/question/12_76159

• MapReduce的有力补充（图处理) -- Pregel

Inside Google,  MapReduce  is used for 80% of all the data processing needs. The other 20% is handled by a lesser known infrastructure called Pregel which is optimized to mine  relationships from graph.

http://www.royans.net/wp/2010/03/17/pregel-googles-other-data-processing-infrastructure/

• MapReduce的上层 搜索引擎  -- Google Caffeine

这次改动主要是重写了搜索引擎的底层架构，涉及到爬虫、索引库、排序规则等等很多方面。提升的方向主要是google一直以来追求的速度，而速度的提高会进一步带来准确性和全面性的提升。

http://www.semyj.com/archives/528