hadoop2.7.1单机部署

一、设置主机名

127.0.0.1 test

二、配置免密登录。

[root@master ~]# ssh-keygen
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa): 
/root/.ssh/id_rsa already exists.
Enter passphrase (empty for no passphrase): 
Enter same passphrase again: 
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
d3:0b:e3:78:12:32:a9:b6:4c:36:d0:f0:cb:58:03:ff root@htzh208
The key's randomart image is:
+--[ RSA 2048]----+
|                 |
|                 |
|o                |
| *   .   .       |
|. * + . S .      |
| = = o + + .     |
|. O E o o .      |
| = o   o         |
|  o              |
+-----------------+

cd ~/.ssh

cat id_rsa.pub >> authorized_keys

三、安装Hadoop。

解压至目录 /data/

cd /data/hadoop-2.7.1/etc/hadoop

1.配置文件

    ①配置文件：core-site.xml

<configuration>
<property>
        <name>hadoop.tmp.dir</name>
        <value>/data/hadoop-data/hadoop/apps/temp/hadoop-${user.name}</value>
</property>
<property>
        <name>fs.default.name</name>
        <value>hdfs://127.0.0.1:9000</value>
</property>
</configuration>

       ②配置文件：yarn-site.xml

<property>
  <name>yarn.resourcemanager.address</name>
      <value>127.0.0.1:8032</value>
</property>
<property>
      <name>yarn.resourcemanager.scheduler.address</name>
      <value>127.0.0.1:8030</value>
</property>
<property>
      <name>yarn.resourcemanager.resource-tracker.address</name>
      <value>127.0.0.1:8031</value>
</property>
<property>
      <name>yarn.nodemanager.aux-services</name>
      <value>mapreduce_shuffle</value>
</property>

   ③配置文件：hdfs-site.xml

<configuration>
<property>
        <name>dfs.replication</name>
        <value>1</value>
</property>
<property>
        <name>dfs.name.dir</name>
        <value>/data/hadoop-data/hadoop/hdfs/name</value>  
</property>         
<property>
        <name>dfs.data.dir</name>                                                                                                                
        <value>/data/hadoop-data/hadoop/hdfs/data</value>
</property>
</configuration>

        ④配置文件：hadoop-env.sh

export JAVA_HOME=/usr/java/default  //修改为本机java目录

2.格式化

bin/hadoop namenode -format 

3.启动和停止

sbin/start-all.sh
sbin/stop-all.sh

4.看到以下进程则说明配置成功

5036 DataNode
5230 SecondaryNameNode
5538 NodeManager
14551 Jps
4894 NameNode
5414 ResourceManager