在安装好的hadoop里,安装教程可参考我的博客https://blog.csdn.net/huangbaokang/article/details/102895418
修改hadoop-env.sh
cd hadoop_hbk/
vi hadoop-env.sh
主要修改JAVA_HOME环境变量,根据个人jdk环境
export JAVA_HOME=/usr/java/jdk1.8.0_201-amd64/
编辑core-site.xml文件,增加如下内容
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://192.168.86.134:9999/</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/root/hbk/hdptmp</value>
</property>
</configuration>
初始化NAMENODE
将hadoop文件下的命令配置到环境变量中,方便我们执行相关命令
vi /etc/profile
# hadoop environment
export HADOOP_HOME=/root/hbk/hadoop-3.1.3/
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
让配置生效
source /etc/profile
执行初始化命令
hadoop namenode -format
出现如下方框,说明启动正常
2019-11-04 14:59:44,871 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
2019-11-04 14:59:44,871 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
2019-11-04 14:59:44,871 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25
2019-11-04 14:59:44,938 INFO namenode.FSNamesystem: Retry cache on namenode is enabled
2019-11-04 14:59:44,940 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2019-11-04 14:59:44,959 INFO util.GSet: Computing capacity for map NameNodeRetryCache
2019-11-04 14:59:44,959 INFO util.GSet: VM type = 64-bit
2019-11-04 14:59:44,961 INFO util.GSet: 0.029999999329447746% max memory 846.8 MB = 260.1 KB
2019-11-04 14:59:44,961 INFO util.GSet: capacity = 2^15 = 32768 entries
2019-11-04 14:59:45,094 INFO namenode.FSImage: Allocated new BlockPoolId: BP-1818618060-127.0.0.1-1572850785063
2019-11-04 14:59:45,152 INFO common.Storage: Storage directory /root/hbk/hdptmp/dfs/name has been successfully formatted.
2019-11-04 14:59:45,315 INFO namenode.FSImageFormatProtobuf: Saving image file /root/hbk/hdptmp/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression
2019-11-04 14:59:45,775 INFO namenode.FSImageFormatProtobuf: Image file /root/hbk/hdptmp/dfs/name/current/fsimage.ckpt_0000000000000000000 of size 391 bytes saved in 0 seconds .
2019-11-04 14:59:45,819 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
2019-11-04 14:59:45,837 INFO namenode.FSImage: FSImageSaver clean checkpoint: txid = 0 when meet shutdown.
2019-11-04 14:59:45,838 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at localhost/127.0.0.1
************************************************************/
使用jps命令查看NameNode进程号,并结合netstat找到访问地址端口9870
用浏览器访问如下:
启动我们的datanode,我们可以在导航出的datanodes查看到
hadoop-daemon.sh start datanode