azkaban定时脚本运行异常

最新推荐文章于 2024-07-24 14:59:47 发布

weixin_43290231

最新推荐文章于 2024-07-24 14:59:47 发布

阅读量294

点赞数

文章标签：大数据 hadoop hive

本文链接：https://blog.csdn.net/weixin_43290231/article/details/114103554

版权

博客内容提及了在Azkaban中遇到的Hive定时脚本运行异常，主要表现为连接超时。作者分析问题可能与'hive.spark.client.server.connect.timeout'参数有关，并指出可能需要在'hive-site.xml'中修改此参数。建议查阅Apache Hive官网以获取更多配置信息，通过增加超时参数的值来解决问题。在完成配置后，通过Hive界面检查参数值是否已更新。

摘要由CSDN通过智能技术生成

1、查看到页面报错信息如下

26-06-2019 11:35:48 CST ls_sales_class_record INFO - 2019-06-26 11:35:48,613 INFO  [RemoteDriver-stdout-redir-03d823ed-2fad-4f6e-95d5-eb7202f119b5 main] client.SparkClientImpl: 2019-06-26 11:35:48 INFO  Client:54 - Uploading resource file:/opt/app/hive/lib/hive-exec-3.0.0.jar -> hdfs://hfbigdata/user/bigdata/.sparkStaging/application_1553655146752_65633/hive-exec-3.0.0.jar
26-06-2019 11:37:10 CST ls_sales_class_record INFO - 2019-06-26 11:37:10,850 ERROR [03d823ed-2fad-4f6e-95d5-eb7202f119b5 main] client.SparkClientImpl: Timed out waiting for client to connect.
26-06-2019 11:37:10 CST ls_sales_class_record INFO - Possible reasons include network issues, errors in remote driver or the cluster has no available resources, etc.
26-06-2019 11:37:10 CST ls_sales_class_record INFO - Please check YARN or Spark driver's logs for further information.
26-06-2019 11:37:10 CST ls_sales_class_record INFO - java.util.concurrent.ExecutionException: java.util.con