今天运行hive导致sql运行不起来

今天出现了一个怪问题,就是hive在运行几个SQL的时候,始终无法正常运行,导致方法阻塞,然后CPU也100%。

通过打印几个进程的方法栈发现:

"Thread-8" id=20 idx=0x50 tid=3647 prio=5 alive, native_blocked
    at org/apache/hadoop/mapred/lib/CombineFileInputFormat.getMoreSplits(CombineFileInputFormat.java:339)
    at org/apache/hadoop/mapred/lib/CombineFileInputFormat.getSplits(CombineFileInputFormat.java:204)
    at org/apache/hadoop/hive/shims/HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:386)
    at org/apache/hadoop/hive/shims/HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:352)
    at org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:387)
    at org/apache/hadoop/mapred/JobClient.writeOldSplits(JobClient.java:989)
    at org/apache/hadoop/mapred/JobClient.writeSplits(JobClient.java:981)
    at org/apache/hadoop/mapred/JobClient.access$600(JobClient.java:174)
    at org/apache/hadoop/mapred/JobClient$2.run(JobClient.java:897)
    at org/apache/hadoop/mapred/JobClient$2.run(JobClient.java:850)
    at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)
    at javax/security/auth/Subject.doAs(Subject.java:396)
    at org/apache/hadoop/security/UserGroupInformation.doAs(UserGroupInformation.java:1121)
    at org/apache/hadoop/mapred/JobClient.submitJobInternal(JobClient.java:850)
    at org/apache/hadoop/mapred/JobClient.submitJob(JobClient.java:824)
    at org/apache/hadoop/hive/ql/exec/ExecDriver.execute(ExecDriver.java:435)
    at org/apache/hadoop/hive/ql/exec/MapRedTask.execute(MapRedTask.java:137)
    at org/apache/hadoop/hive/ql/exec/Task.executeTask(Task.java:134)
    at org/apache/hadoop/hive/ql/exec/TaskRunner.runSequential(TaskRunner.java:57)
    at org/apache/hadoop/hive/ql/exec/TaskRunner.run(TaskRunner.java:47)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)

都是在此方法进行阻塞。

最近一直碰到这种怪问题啊,继续努力解决!

 

评论 10
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值