- 本地安装jdk1.8,不赘叙。
- 下载hadoop2.7.7(https://download.csdn.net/download/zjcool2012/12132480),解压到文件目录,如D:\DMSPACE\hadoop-2.7.7。
- 下载winutil(https://download.csdn.net/download/zjcool2012/12132492),也可下载其他版本,win工具需对应hadoop的版本。解压本文件,覆盖在hadoop2.7.7的bin目录下,替换所有文件。
- 添加Hadoop环境变量,参考Java的,新建HADOOP_HOME 变量名同样是自己存放hadoop的位置,如D:\DMSPACE\hadoop-2.7.7, 并添加path路径:%HADOOP_HOME%\bin
- 创建nodename和datanode目录,用来保存数据,如: D:\DMSPACE\data\namenode D:\DMSPACE\data\datanode
- 博客搬家修改hadoop-2.7.7\etc\hadoop里修改4个配置文件:core-site.xml, hdfs-site.xml, mapred-site.xml, yarn-site.xml。
core-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
hdfs-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>/D:/DMSPACE/data/namenode</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>/D:/DMSPACE/data/datanode</value>
</property>
</configuration>
mapred-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>
yarn-site.xml
<?xml version="1.0"?>
<configuration>
<!-- Site specific YARN configuration properties -->
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>1024</value>
</property>
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>4096</value>
</property>
<property>
<name>yarn.nodemanager.resource.cpu-vcores</name>
<value>2</value>
</property>
</configuration>
7.配置完成,启动hadoop操作
(1)hdfs format操作 D:\DMSPACE\hadoop-2.7.7\bin>hdfs namenode -format
(2)Hadoop 启动命令 D:\DMSPACE\hadoop-2.7.7\bins>start-all.cmd
( 3 ) Hadoop 结束命令stop -all.cmd