停止任务
yarn application -kill jobId
hdfs常用命令:
统计行数
hadoop fs -cat ‘/data/ioc/20200327/*’ | wc -l
查看文件前5行
hdfs dfs -text /data/ioc/20200317/ioc99.txt.csv |head -5
上传:
hadoop fs -put wp.txt /user
添加文件到hdfs上已经有的文件:
hadoop fs -appendToFile a.txt /user/wp.txt
hdfs删除文件:
hadoop fs -rm -r 路径
把一个目录下的文件mv到另一个目录
hadoop fs -mv /user/vpetest.cripac/source_data/result/ssd/20181020/* /user/vpetest.cripac/source_data/result/ssd2/20181020
重命名
hadoop fs -mv /user/vpetest.cripac/source_data/result/ssd2 /user/vpetest.cripac/source_data/result/ssd
查看hadoop 状态
hadoop dfsadmin -report
磁盘写满:
http://qindongliang.iteye.com/blog/2091989
http://www.linuxidc.com/Linux/2015-02/113638.