hadoop使用

修复hdfs 受损的block

检查hdfs block 是否因为租约问题无法读写

hadoop fsck /user/hive/warehouse/ods_aquarius30.db/orderinfo/st_date=20171018 -openforwrite | egrep -v ‘^\.+$‘ | egrep "MISSING|OPENFORWRITE" | grep -o "/[^ ]*" | sed -e "s/:$//"

yarn 本地jar 下载位置

/data/hadoop/yarn/local/usercache/hadoop/appcache/application_1554681102090_0003

列出正在运行的 job

$HADOOP_HOME/bin/yarn application -list 

杀死正在运行的job

$HADOOP_HOME/bin/yarn application -kill  jobid