关于在xshell中安装hadoop

                关于在xshell中安装hadoop

#################### APACHE SINGL##################

环境变量

在这里插入图片描述

配置完安装HADOOP

[root@singlelucky bin]# source /etc/profile
[root@singlelucky bin]# ./hdfs namenode -format
2021-06-03 13:29:31,644 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = singlelucky/192.168.19.130
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 3.1.3

2021-06-03 13:39:09,388 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at singlelucky/192.168.19.130
************************************************************/
[root@singlelucky hadoop]# start-all.sh
Starting namenodes on [singlelucky]
Last login: Thu Jun 3 13:33:48 CST 2021 on pts/2
Starting datanodes
Last login: Thu Jun 3 13:39:26 CST 2021 on pts/2
localhost: Warning: Permanently added ‘localhost’ (ECDSA) to the list of known hosts.
Starting secondary namenodes [singlelucky]
Last login: Thu Jun 3 13:39:28 CST 2021 on pts/2
Starting resourcemanager
Last login: Thu Jun 3 13:39:33 CST 2021 on pts/2
Starting nodemanagers
Last login: Thu Jun 3 13:39:40 CST 2021 on pts/2
[root@singlelucky hadoop]# jps
6821 NodeManager
6182 DataNode
6680 ResourceManager
6410 SecondaryNameNode
7150 Jps
6047 NameNode

#若出现以下问题，进入hadoop，检查文件中Java环境变量是否与系统中的Java环境变量相同，不同则配置
ERROR: JAVA_HOME /usr/lib/jvm/default-java does not exist. 运行Hadoop出现
[root@singlelucky ~]# cd /opt/software/hadoop/hadoop313/etc/hadoop/
[root@singlelucky hadoop]# ll
[root@singlelucky hadoop]# vim hadoop-env.sh

Many of the options here are built from the perspective that users

may want to provide OVERWRITING values on the command line.

For example:

JAVA_HOME=/opt/software/java/jdk180

Therefore, the vast majority (BUT NOT ALL!) of these defaults

are configured for substitution and not append. If append

is preferable, modify this file accordingly.