hadoop环境配置与安装

一、机器添加互信

1.修改主机名

hostnamectl set-hostname 主机名

2.添加各个主机地址和主机名

vi /etc/hosts

3.生成密钥

ssh-keygen -t rsa -P ""

4.自己保存密钥

cat ~/.ssh/id_rsa.pub > ~/.ssh/authorized_keys

5.把密钥传给其他机器

ssh-copy-id -i ~/.ssh/id_rsa.pub root@hadoop100(主机名)

二、配置Hadoop

配置Hadoop ./etc/hadoop目录下的文件

hadoop-env.sh

core-site.xml

hdfs-site.xml

mapred-site.xml

yarn-site.xml

hadoop环境变量配置

vi /etc/profile

export JAVA_HOME=/home/software/jdk1.8.0_221
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin
export HADOOP_HOME=/opt/software/hadoop
export HADOOP_MAPRED_HOME=$HADOOP_HOME
export HADOOP_COMMON_HOME=$HADOOP_HOME
export HADOOP_HDFS_HOME=$HADOOP_HOME
export YARN_HOME=$HADOOP_HOME
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"
export PATH=$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$PATH

格式化HDFS

hadoop namenode -format

启动Hadoop

start-all.sh

访问Hadoop

http://192.168.56.137:50070 HDFS页面

http://192.168.56.137:8088 YARN的管理界面