Hadoop in Action Note

最新推荐文章于 2023-01-08 16:28:44 发布

TigerYang414

最新推荐文章于 2023-01-08 16:28:44 发布

阅读量396

点赞数

分类专栏： Hadoop 文章标签： hadoop action mapreduce transactions processing class

本文链接：https://blog.csdn.net/TigerYang414/article/details/7625863

版权

7 篇文章 0 订阅

订阅专栏

MapReduce vs. Relational DataBase

scale out vs. scale up
key/value pairs vs. relational tables
functional programming vs. declarative query
offline batch processing vs. online transactions(MapReduce is more like warehouse)

New API vs. Old API

start from 0.20
classes moved from org.apache.haddop.mapred(.lib) to org.apache.haddop.mapreduce(.lib)
introduction of context object to unitify communication with framework
- with this way, map/reduce need not to be changed for further feature addition
- only some new method need to add to context object
JobClient and JobConf replaced by Configuration and Job class
- Configuration class configures a job
- Job class defines and controls execution of job