![](https://img-blog.csdnimg.cn/20201014180756724.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
hadoop
风继续吹-小海
love or hate me,the one or another
展开
-
hadoop-2.6.0-cdh5.7.0 YARN 伪分布式安装
YARN on Single Node You can run a MapReduce job on YARN in a pseudo-distributed mode by setting a few parameters and running ResourceManager daemon and NodeManager daemon in addition. 注意:首先必须在hdfs成功安装...原创 2018-09-27 16:02:30 · 209 阅读 · 0 评论 -
hadoop-2.6.0-cdh5.7.0 HDFS 伪分布式安装
查看官方文档相关要求: http://archive.cloudera.com/ 搜索需要的版本 如果需要下载加上 .tar.gz 就可以 Required software for Linux include: Java™ must be installed. Recommended Java versions are described at HadoopJavaVersions. ssh...原创 2018-09-21 09:52:24 · 232 阅读 · 0 评论 -
hdfs进程启动 all on hostname
hdfs进程启动 all on hostname 默认启动方式: [hadoop@hadoop01 sbin]$ ./start-dfs.sh Starting namenodes on [hadoop01] hadoop01: starting namenode, logging to /home/hadoop/app/hadoop/logs/hadoop-hadoop-namenode-had...原创 2018-09-28 10:41:48 · 116 阅读 · 0 评论 -
jps命令
hadoop@abp-oggdb-002:/home/hadoop/app/hadoop>which jps /usr/java/jdk1.7.0_80/bin/jps 所以此命令是有java而来,显示的是java程序 不同用户呈现的不同结果: hadoop@abp-oggdb-002:/home/hadoop/app/hadoop>jps 73245 NameNode ...原创 2018-09-28 14:41:35 · 193 阅读 · 0 评论 -
hdfs的pid文件概述
cat hadoop-env.sh export HADOOP_PID_DIR=HADOOPPIDDIRexportHADOOPSECUREDNPIDDIR={HADOOP_PID_DIR} export HADOOP_SECURE_DN_PID_DIR=HADOOPPIDDIRexportHADOOPSECUREDNPIDDIR={HADOOP_PID_DIR} 默认的hadoop...原创 2018-10-22 14:48:17 · 286 阅读 · 0 评论 -
hdfs回收站机制
1.在 core-site.xml 中添加: <property> <name>fs.trash.interval</name> <value>4320</value> </property> fs.trash.interval参数的含义: Number of minutes after whi...原创 2018-11-13 15:17:22 · 273 阅读 · 0 评论 -
hdfs shell
命令: hdfs dfs -ls hdfs://hadoop01:9000/user hdfs dfs -ls /user -ls -ls <路径> 查看指定路径的当前目录结构 -lsr -lsr <路径> 递归查看指定路径的目录结构 -du -du <路径> 统计目录下个文件大小 -dus -dus <路径> 汇总统计目录下文件...原创 2018-11-14 14:49:47 · 133 阅读 · 0 评论