1,因为经常提交任务,需要吧老任务kill掉,在提交新的任务,所以自己写了一个shell命令,支持yarn的ApplicatinName和ApplicationId任务kill,具体代码如下:
#!bin/bash/
#用法 sh kill_application.sh ComputeGpsInOutStation
for i in `yarn application -list | grep -w $1 | awk '{print $1}' | grep application_`;
do yarn application -kill $i;
done
2,也可以自己写个shell提交任务之前,调用 kill_application.sh,这样任务就不会重复提交了
#!bin/bash
sh /streaming/jobs/wpp/kill_application.sh TsLog2CK
/streaming/software/flink-1.9.0/bin/flink run -m yarn-cluster -yjm 900 -ytm 1024 -yn 1 -ynm TsLog2CK --class com.xxx.bigdata.clickhouse.TsLog2CK /streaming/jobs/wpp/$1.jar