捕获hive脚本异常: echo $?
写在每条hive命令执行后的下一行,错误例子(先自定义一个监控文件,专门记录监控日志):
正常情况下返回0,异常情况下一般返回11
监控方法:定期查看监控日志的情况,即可迅速发现异常。
[url]http://www.programfan.com/club/showtxt.asp?id=386994[/url]
hadoop fs -get /user/hive/warehouse/app_recommend_report/* /data/hadoop/android_log/app/app_recommend_report/
gzip -d /data/hadoop/android_log/app/app_recommend_report/000000_0.gz
sql="load data local infile '/data/hadoop/android_log/app/app_recommend_report/000000_0' ignore into table app_recommend_report_tmp character set 'utf8' fields terminated by ',' lines terminated by '\n';"
写在每条hive命令执行后的下一行,错误例子(先自定义一个监控文件,专门记录监控日志):
hql="show tabls;"
echo ${hql} | ${HIVE_PATH}/bin/hive
echo $? >> monitor.log
正常情况下返回0,异常情况下一般返回11
监控方法:定期查看监控日志的情况,即可迅速发现异常。
[url]http://www.programfan.com/club/showtxt.asp?id=386994[/url]
hadoop fs -get /user/hive/warehouse/app_recommend_report/* /data/hadoop/android_log/app/app_recommend_report/
gzip -d /data/hadoop/android_log/app/app_recommend_report/000000_0.gz
sql="load data local infile '/data/hadoop/android_log/app/app_recommend_report/000000_0' ignore into table app_recommend_report_tmp character set 'utf8' fields terminated by ',' lines terminated by '\n';"