hadoop2.6.4伪分布式搭建

1、jdk的安装与配置

        解压jdk到我需要的目录

                tar -zxf jdk-8u333-linux-x64.tar.gz -C /home/hadoop/soft-install/bigdata/

        配置环境变量

                vi /etc/profile

                export JAVA_HOME=/home/hadoop/soft-install/bigdata/jdk1.8.0_333

                PATH=$PATH:$JAVA_HOME/bin

        刷新环境变量

                source /etc/profile

        测试jdk是否配置成功

                java -version

2、hadoop2.6.4安装与配置

        1、配置hadoop环境变量

                vi /etc/profile

                export HADOOP_HOME=/home/hadoop/soft-install/bigdata/hadoop-2.6.4

                 PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin

        刷新环境变量

                source /etc/profile

        到配置文件，目录

                cd /home/hadoop/soft-install/bigdata/hadoop-2.6.4/etc/hadoop

1、配置 hadoop-env.sh

vi hadoop-env.sh

export JAVA_HOME=/home/hadoop/soft-install/bigdata/jdk1.8.0_333

2、配置core-site.xml

vi core-site.xml

<property>

<name>hadoop.tmp.dir</name>

<value>/home/hadoop/soft-install/bigdata/hadoop-2.6.4/tmp</value>

//临时文件存放地点

</property>

<property>

<name>fs.default.name</name>

<value>hdfs://hadoop:9000</value>

</property>

3、配置hdfs-site.xml

vi hdfs-site.xml

<property>

<name>dfs.replication</name>

<value>1</value>

</property>

4、配置 mapred-site.xml

cp mapred-site.xml.template mapred-site.xml

vi mapred-site.xml

<property>

<name>mapreduce.framework.name</name>

<value>yarn</value>

</property>

5、配置yarn-site.xml

<property>

<name>yarn.resourcemanager.hostname</name>

<value>hadoop</value>

</property>

<property>

<name>yarn.nodemanager.aux-services</name>

<value>mapreduce_shuffle</value>

</property>

3、修改主机名

hostnamectl set-hostname hadoop

4、配置免密

ssh-keygen -t rsa

ssh-copy-id -i /root/.ssh/id_rsa.pub hadoop

5、格式化

hadoop namenode -format

6、启动hdfs

start-all.sh

7、进入客户端

http://hadoop:50070