Hadoop3.2学习-2.伪分布式安装

一.下载hadoop安装包

官方网址:http://hadoop.apache.org/

 

二.安装配置

1.解压

tar -xvf hadoop-3.2.0.tar.gz

2.修改hadoop-env.sh

export JAVA_HOME=/usr/local/jdk1.8.0_161

export HDFS_NAMENODE_USER=root

export HDFS_DATANODE_USER=root

export HDFS_SECONDARYNAMENODE_USER=root

3.修改core-site.xml

<property> 
    <name>fs.defaultFS</name> 
    <value>hdfs://hadoop-master:9820</value> 
</property>

副本存放目录:

<property> 
    <name>hadoop.tmp.dir</name> 
    <value>/opt/peseudo</value> 
</property>

4.修改hdfs-site.xml

<property> 
    <name>dfs.replication</name> 
    <value>1</value> 
</property>

配置secondary

<property>

    <name>dfs.namenode.secondary.http-address</name>

    <value>hadoop-master:9868</value>

</property>

 

5.修改workers

6.格式化namenode

/bin/hdfs namenode -format

7.启动

/sbin/start-dfs.sh

创建目录:

./bin/hdfs dfs -mkdir /temp

上传文件:

./bin/hdfs dfs -put /opt/hadoop-3.2.0.tar.gz /temp

8.查看节点

http://192.168.100.137:9870