配置文件修改
hadoop目录/home/hadoop/app/hadoop-3.1.4/etc/hadoop
修改 xml 文件 core-site.xml 和 hdfs-site.xml
cd /home/hadoop/app/hadoop-3.1.4/etc/hadoop
vi core-site.xml
core-site.xml 新增
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
vi hdfs-site.xml
core-site.xml 新增
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/app/common/tmp</value>
</property>
</configuration>
*修改 -env.sh文件 hadoop-env.sh 和 mapred-env.sh 和yarn-env.sh
vi hadoop-env.sh
vi mapred-env.sh
vi yarn-env.sh
全部新增
export JAVA_HOME=/usr/local/src/jdk/jdk1.8.0_11
配置启动项
配置用户角色
cd /home/hadoop/app/hadoop-3.1.4/sbin
vi start-dfs.sh
#!/usr/bin/env bash 下面增加
export HDFS_NAMENODE_USER=root
export HDFS_DATANODE_USER=root
export HDFS_SECONDARYNAMENODE_USER=root
export YARN_RESOURCEMANAGER_USER=root
export YARN_NODEMANAGER_USER=root
设置免密登录
第一种 dsa
ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
第二种 rsa
ssh-keygen -t rsa
一路回车
ssh-copy-id -i ~/.ssh/id_rsa.pub localhost
验证免密登录
ssh localhost
不输入密码即为成功
启动hdfs
cd /home/hadoop/app/hadoop-3.1.4/sbin
start-dfs.sh
成功则显示
Starting namenodes on [localhost]
Last login: Thu Oct 29 16:42:19 CST 2020 from 127.0.0.1 on pts/6
Last failed login: Thu Oct 29 16:49:57 CST 2020 from **** on ssh:notty
There were 16 failed login attempts since the last successful login.
localhost: namenode is running as process 7294. Stop it first.
Starting datanodes
Last login: Thu Oct 29 16:51:27 CST 2020 on pts/2
localhost: datanode is running as process 7472. Stop it first.
Starting secondary namenodes [VM_0_13_centos]
Last login: Thu Oct 29 16:51:27 CST 2020 on pts/2
VM_0_13_centos: secondarynamenode is running as process 7694. Stop it first.
验证
jps
显示则成功
7472 DataNode
32539 Jps
7694 SecondaryNameNode
7294 NameNode