Hadoop-MapReduce Tutorial

MapReduce Tutorial

• Purpose//目的
• Prerequisites//属性
• Overview//概览
• Inputs and Outputs//输入输出
• Example: WordCount v1.0//workCount例子
  • Source Code
  • Usage//用途
  • Walk-through//???
• MapReduce - User Interfaces // 用户接口
  • Payload // 负荷
    • Mapper // mapper
    • Reducer // reducer
    • Partitioner // partitioner
    • Counter // counter
  • Job Configuration // Job配置
  • Task Execution & Environment // Task执行和环境
    • Memory Management
    • Map Parameters
    • Shuffle/Reduce Parameters
    • Configured Parameters
    • Task Logs
    • Distributing Libraries
  • Job Submission and Monitoring
    • Job Control
  • Job Input
    • InputSplit
    • RecordReader
  • Job Output
    • OutputCommitter
    • Task Side-Effect Files
    • RecordWriter
  • Other Useful Features
    • Submitting Jobs to Queues
    • Counters
    • DistributedCache
    • Profiling
    • Debugging
    • Data Compression
    • Skipping Bad Records
  • Example: WordCount v2.0
    • Source Code
    • Sample Runs
    • Highlights