大数据入门--Hadoop启动hadoop-3.1.4版本启动hdfs

配置文件修改

hadoop目录/home/hadoop/app/hadoop-3.1.4/etc/hadoop
修改 xml 文件 core-site.xml 和 hdfs-site.xml

cd /home/hadoop/app/hadoop-3.1.4/etc/hadoop

vi core-site.xml

core-site.xml 新增

<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>

vi hdfs-site.xml

core-site.xml 新增

<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
	<property>
	    <name>hadoop.tmp.dir</name>
	    <value>/home/hadoop/app/common/tmp</value>
	</property>
</configuration>

*修改 -env.sh文件 hadoop-env.sh 和 mapred-env.sh 和yarn-env.sh

 vi hadoop-env.sh 

 vi mapred-env.sh 

 vi yarn-env.sh 

全部新增

export JAVA_HOME=/usr/local/src/jdk/jdk1.8.0_11

配置启动项

配置用户角色

cd /home/hadoop/app/hadoop-3.1.4/sbin

vi start-dfs.sh

#!/usr/bin/env bash 下面增加

export HDFS_NAMENODE_USER=root
export HDFS_DATANODE_USER=root
export HDFS_SECONDARYNAMENODE_USER=root
export YARN_RESOURCEMANAGER_USER=root
export YARN_NODEMANAGER_USER=root

设置免密登录
第一种 dsa

ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys

第二种 rsa

ssh-keygen -t rsa

一路回车

ssh-copy-id -i ~/.ssh/id_rsa.pub localhost

验证免密登录

ssh localhost

不输入密码即为成功

启动hdfs

cd /home/hadoop/app/hadoop-3.1.4/sbin

start-dfs.sh

成功则显示

Starting namenodes on [localhost]
Last login: Thu Oct 29 16:42:19 CST 2020 from 127.0.0.1 on pts/6
Last failed login: Thu Oct 29 16:49:57 CST 2020 from **** on ssh:notty
There were 16 failed login attempts since the last successful login.
localhost: namenode is running as process 7294.  Stop it first.
Starting datanodes
Last login: Thu Oct 29 16:51:27 CST 2020 on pts/2
localhost: datanode is running as process 7472.  Stop it first.
Starting secondary namenodes [VM_0_13_centos]
Last login: Thu Oct 29 16:51:27 CST 2020 on pts/2
VM_0_13_centos: secondarynamenode is running as process 7694.  Stop it first.

验证

jps

显示则成功

7472 DataNode
32539 Jps
7694 SecondaryNameNode
7294 NameNode