liunx下搭建hadoop单机环境 步骤详解

liunx需必备以下环境条件

我搭建所用的CentOS7。hadoop版本为2.6.0，如有需要请与我联系

1.安装jdk 并配置JAVA_HOME环境(必须配置在/root/.bashrc文件中)

JAVA_HOME=/app/tomcat/jdk/jdk1.8.0_11
PATH=$PATH:$JAVA_HOME/bin
CLASSPATH=.
export JAVA_HOME
export PATH
export CLASSPATH

保存退出
注：JAVA_HOME 为jdk解压后位置
配置后执行命令source .bashrc，更新环境

2.配置主机名和ip映射关系/etc/hosts文件

192.168.154.155 BaiBH

[admin@BaiBH ~]$ 如不知主机名可看输入命令行@字符后则为主机名，或输入homename命令查看

3.须配置本机SSH免密码认证

如未进行免密认证后面启动Hadoop时需多次提示输入密码

[root@BaiBH ~]# ssh-keygen -t rsa -P '' -f  /root/.ssh/id_rsa
[root@BaiBH ~]# cat .ssh/id_rsa.pub >> .ssh/authorized_keys
[root@BaiBH ~]# ssh BaiBH

4.上传hadoop-2.6.0.tar.gz并解压后配置HADOOP_HOME环境变量

[root@BaiBH ~]# tar -zxf hadoop-2.6.0.tar.gz -C /app/tomcat/hadoop/

添加hadoop环境变量

HADOOP_HOME=/app/tomcat/hadoop/hadoop-2.6.0
JAVA_HOME=/app/tomcat/jdk/jdk1.8.0_11
PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
CLASSPATH=.
export JAVA_HOME
export PATH
export CLASSPATH
export HADOOP_HOME

保存并退出后执行命令source .bashrc，更新环境

5. 修改hadoop三个配置文件core-site.xml|hdfs-site.xml|slave

[root@BaiBH hadoop-2.6.0]$ vi etc/hadoop/core-site.xml

<configuration>
        <property>
                <name>fs.defaultFS</name>
                <value>hdfs://BaiBH:9000</value>
        </property>
        <property>
                <name>hadoop.tmp.dir</name>
                <value>/app/tomcat/hadoop/hadoop-2.6.0/hadoop-${user.name}</value>
        </property>
</configuration>

fs.defaultFS官网解释 The name of the default file system. A URI whose scheme and authority determine the FileSystem implementation. The uri’s scheme determines the config property (fs.SCHEME.impl) naming the FileSystem implementation class. The uri’s authority is used to determine the host, port, etc. for a filesystem.
hadoop.tmp.dir 为hadoop按装路径 具体官网解释：A base for other temporary directories.

[root@BaiBH hadoop-2.6.0]# vi etc/hadoop/hdfs-site.xml

<configuration>
        <property>
                <name>dfs.replication</name>
                <value>1</value>
        </property>
</configuration>

dfs.replication 为hdfs的副本数 官网解释为：Default block replication. The actual number of replications can be specified when the file is created. The default is used if replication is not specified in create time.

[root@BaiBH hadoop-2.6.0]# vi etc/hadoop/slaves

添加主机名称

BaiBH

6.格式化NameNode（只在第一次搭建时执行一次）

[root@BaiBH hadoop-2.6.0]# hdfs namenode -format

7. 启动hadoop

[root@BaiBH hadoop-2.6.0]# start-dfs.sh

注：此命令可在任何目录下执行

jps命令查看组件是否都启动成功，包含NameNode，SecondaryNameNode，DataNode

[root@BaiBH hadoop-2.6.0]# jps
7072 NameNode
7179 DataNode
7484 Jps
7374 SecondaryNameNode

或者查看
http://192.168.154.155:50070/

50070为hadoop暴露端口，如失败需看下防火墙

如有不足之处欢迎各位大神指正