hadoop伪分布式环境的搭建

软件安装的目录：

/opt/modules/

安装

0）说明

1.系统：Centos 64位

2.关闭防火墙和SELinux

service iptables status

service iptables stop

永久关闭：chkconfig iptables off

vi /etc/sysconfig/selinux

设置SELinux-disabled

3.设置静态IP地址

vi/etc/sysconfig/network-scripts/ifcfg-eth0

4.修改hostname

hostname hadoop-yarn.dragon.org

vi /etc/sysconfig/network

5.IP与hostname绑定

vi /etc/hosts

192.168.1.117 hadoop-yarn.dragon.org hadoop-yarn

6.安装jdk

chmod u+x jdk1.7

rpm -qa|grep java

rpm -e --nodeps

设置环境变量

vi /etc/profile

添加

export JAVA_HOME=/opt/modules/jdk1.7

export PAHT =$PATH:$JAVA_HOME/bin

生效：

#source /etc/profile

------------------------------------------------------

1)解压tar包

tar -zxvf hadoop-2.5.0.tar.gz -C /opt/modules/

2)安装目录

hadoop_home=/opt/modules/hadoop-2.5.0

-----------------------------------------------------------

3）伪分布式的配置：

1.hsdoop-env.sh

export JAVA_HOME=/opt/modules/jdk1.7.0_79

2.yarn-env.sh

export JAVA_HOME=/opt/modules/jdk1.7.0_79

3.mapred-env.sh

export JAVA_HOME=/opt/modules/jdk1.7.0_79

4.core-site.xml

<configuration>

<property>

<name>fs.default.name</name>

<value>hdfs://hadoop-yarn.dragon.org:8020</value>

</property>

<property>

<name>hadoop.tmp.dir</name>

<value>/opt/modules/hadoop-2.5.0/data/tmp</value>

</property>

</configuration>

5.hdfs-site.xml

<configuration>

<property>

<name>dfs.replication</name>

<value>1</value>

</property>

</configuration>

6.yarn-site.xml

<configuration>

<property>

<name>yarn.nodemanager.aux-services</name>

<value>mapreduce_shuffle</value>

</property>

</configuration>

7.mapred-site.xml

<configuration>

<property>

<name>mapreduce.framework.name</name>

<value>yarn</value>

</property>

</configuration>

------------------------------------------------

4）启动

1.启动HDFS

NameNode,DataNode,SecondaryNameNode

*NameNode需要格式化

bin/hdfs namenode -format

*启动NameNode

sbin/hadoop-daemon.sh start namenode

*启动DataNode

sbin/hadoop-daemon.sh start datanode

*启动SecondaryNameNode

sbin/hadoop-daemon.sh start secondarynamenode

查看进程：jps

http://hadoop-yarn.dragon.org:50070/dfshealth.html