安装hadoop3.0版本踩坑

最新推荐文章于 2025-02-08 18:52:54 发布

前行中632

最新推荐文章于 2025-02-08 18:52:54 发布

阅读量1.6w

点赞数 4

分类专栏：面试大数据文章标签： hadoop3.0

本文链接：https://blog.csdn.net/qq_32635069/article/details/80859790

版权

本文档记录了在安装hadoop3.0过程中遇到的端口设置、配置文件变化、namenode格式化错误以及启动脚本报错等问题，并提供了详细的解决步骤，包括修改启动脚本和配置ssh免密码登录。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

1、hdfs的web页面默认端口是9870 yarn的web页面端口是8088
2、配置文件中的slaves文件没了，变成了workers文件，在里面配置datanode节点
3、在进行namenode格式化是有几个Fail，不要因此怀疑自己，只要common.Storage: Storage directory /usr/local/hadoop-3.0.2/hdfs/name has been successfully formatted. 这个提醒是存在的就没有问题
4、在启动时，start-dfs.sh start-yarn.sh时报错

Starting namenodes on [namenode]
ERROR: Attempting to operate on hdfs namenode as root
ERROR: but there is no HDFS_NAMENODE_USER defined. Aborting operation.
Starting datanodes
ERROR: Attempting to operate on hdfs datanode as root
ERROR: but there is no HDFS_DATANODE_USER defined. Aborting operation.
Starting secondary namenodes [datanode1]
ERROR: Attempting to operate on hdfs secondarynamenode as root
ERROR: but there is no HDFS_SECONDARYNAMENODE_USER defined. Aborting operation.
Starting resourcemanager
ERROR: Attempting to operate on yarn resourcemanager as root
ERROR: but there is no YARN_RESOURCEMANAGER_USER defined. Aborting operation.
Starting nodemanagers
ERROR: Attempting to operate on yarn nodemanager as root
ERROR: but there is no YARN_NODEMANAGER_USER defined. Aborting operation.