Mapreduce读写Avro序列化文件

目录

(1)  MapReduce读取Avro格式文件

(2)  MapReduce写入Avro格式文件

---

以WordCount为例来简单说明一下MapReduce如何读写Avro格式的序列化文件，小白初学，如有错误，欢迎批评指正！

首先pom.xml文件中需要引入相关依赖

<properties>
    <arvo.version>1.8.2</arvo.version>
</properties>
<dependencies>
    <!-- Avro support BEGIN -->
    <dependency>
        <groupId>org.apache.avro</groupId>
        <artifactId>avro</artifactId>
        <version>${arvo.version}</version>
    </dependency>
    <dependency>
        <groupId>org.apache.avro</groupId>
        <artifactId>avro-ipc</artifactId>
        <version>${arvo.version}</version>
    </dependency>
    <dependency>
        <groupId>org.apache.avro</groupId>
        <artifactId>avro-mapred</artifactId>
        <version>${arvo.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.avro</groupId>
        <artifactId>avro-mapred</artifactId>
        <version>${arvo.version}</version>
    </dependency>
    <dependency>
        <groupId>org.codehaus.jackson</groupId>
        <artifactId>jackson-core-asl</artifactId>
        <version>1.9.9</version>
    </dependency>
</dependencies>

引入如下插件

<plugin>
    <groupId>org.apache.avro</groupId>
    <artifactId>avro-maven-plugin&