Hadoop windows 环境搭建与验证

环境、版本信息：

    Windows7旗舰版

    Hadoop2.8

    Java1.8.0_111

 

 

安装步骤：

1. 下载hadoop 2.8.0     http://archive.apache.org/dist/hadoop/core/hadoop-2.8.0/hadoop-2.8.0.tar.gz，然后解压
2. 配置文件：

​​​​​​​                 hadoop\etc\hadoop\core-site.xml

<configuration>
        <property>
                <name>fs.defaultFS</name>
                <value>hdfs://localhost:9000</value>
        </property>
</configuration>

                 hadoop\etc\hadoop\hdfs-site.xml

<configuration>
        <property>
                <name>dfs.replication</name>
                <value>1</value>
        </property>
        <property>
                <name>dfs.namenode.name.dir</name>
                <value>file:///D:/program/hadoop/hadoop-2.8.0/data/namenode</value>
        </property>
        <property>
                <name>dfs.datanode.data.dir</name>
                <value>file:///D:/program/hadoop/hadoop-2.8.0/data/datanode</value>
        </property>
</configuration>

                hadoop\etc\hadoop\mapred-site.xml

<configuration>
        <property>
           <name>mapreduce.framework.name</name>
           <value>yarn</value>
        </property>
</configuration>

                hadoop\etc\hadoop\yarn-site.xml

<configuration>
        <property>
           <name>yarn.nodemanager.aux-services</name>
           <value>mapreduce_shuffle</value>
        </property>
        <property>
           <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
           <value>org.apache.hadoop.mapred.ShuffleHandler</value>
        </property>
</configuration>

                hadoop\etc\hadoop\hadoop-env.cmd

                   只需要修改JAVA_HOME一个参数，将其设置为环境上对应的JAVA_HOME路径，需要注意路径不要带有空格，Program Files可以使用PROGRA~1代替

            3.  检查服务：

1. http://localhost:8088/cluster
2. http://localhost:50070/dfshealth.html#tab-overview