Windows笔记本上做大数据开发2: 配置环境2: Windows7下配置windows本地调试环境单机版Hadoop

1. 下载hadoop-2.7.7.tar.gz
2. 将其解压缩在一个路径下，例如E:\home\hadoop
3. Windows下环境变量配置，配置HADOOP_HOME
4. 添加bin文件夹进path
5. 修改E:\home\hadoop\etc\hadoop路径下的core-site.xml

     <configuration>
        <property>
            <name>hadoop.tmp.dir</name>
            <value>file:/home/hadoop/data/dfs/tmp</value>
        </property>
        <property>
            <name>dfs.name.dir</name>
            <value>file:/home/hadoop/data/dfs/name</value>
        </property>
        <property>
            <name>fs.default.name</name>
            <value>hdfs://localhost:9000</value>
        </property>
    </configuration>

6.新建E:\home\hadoop\etc\hadoop路径下的mapred-site.xml

 <configuration> 
    <property>
       <name>mapreduce.framework.name</name>
       <value>yarn</value>
    </property>
    <property>
       <name>mapred.job.tracker</name>
       <value>hdfs://localhost:9001</value>
    </property>
 </configuration>

7.修改E:\home\hadoop\etc\hadoop路径下的hdfs-site.xml

dfs.replication
1


dfs.namenode.name.dir
file:/home/hadoop/data/dfs/namenode


dfs.datanode.data.dir
file:/home/hadoop/data/dfs/datanode

8.修改E:\home\hadoop\etc\hadoop路径下的yarn-site.xml

<configuration>
    <property>
       <name>yarn.nodemanager.aux-services</name>
       <value>mapreduce_shuffle</value>
    </property>
    <property>
       <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
       <value>org.apache.hadoop.mapred.ShuffleHandler</value>
    </property>
</configuration>

9.修改E:\home\hadoop\etc\hadoop路径下的hadoop-env.cmd中的JAVA_HOME路径
10.下载winutils，并且拷贝相应版本的bin到hadoop目录的bin下
11.启动cmd
12.执行命令hdfs namenode -format
13.进入sbin目录，执行start-all.cmd
大功告成