hive:Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processin

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row

at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:494)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:148)
... 8 more

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to execute method public org.apache.hadoop.io.Text org.apache.hadoop.hive.ql.udf.UDFRegExpReplace.evaluate(org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text) on object org.apache.hadoop.hive.ql.udf.UDFRegExpReplace@1a28b346 of class org.apache.hadoop.hive.ql.udf.UDFRegExpReplace with arguments :org.apache.hadoop.io.Text, {:org.apache.hadoop.io.Text, :org.apache.hadoop.io.Text} of size 3
at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:1024)
at org.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge.evaluate(GenericUDFBridge.java:194)
at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:186)
at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77)
at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator D e f e r r e d E x p r O b j e c t . g e t ( E x p r N o d e G e n e r i c F u n c E v a l u a t o r . j a v a : 87 ) a t o r g . a p a c h e . h a d o o p . h i v e . q l . u d f . g e n e r i c . G e n e r i c U D F B r i d g e . e v a l u a t e ( G e n e r i c U D F B r i d g e . j a v a : 190 ) a t o r g . a p a c h e . h a d o o p . h i v e . q l . e x e c . E x p r N o d e G e n e r i c F u n c E v a l u a t o r . e v a l u a t e ( E x p r N o d e G e n e r i c F u n c E v a l u a t o r . j a v a : 186 ) a t o r g . a p a c h e . h a d o o p . h i v e . q l . e x e c . E x p r N o d e E v a l u a t o r . e v a l u a t e ( E x p r N o d e E v a l u a t o r . j a v a : 77 ) a t o r g . a p a c h e . h a d o o p . h i v e . q l . e x e c . E x p r N o d e G e n e r i c F u n c E v a l u a t o r DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:87) at org.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge.evaluate(GenericUDFBridge.java:190) at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:186) at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77) at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:87)atorg.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge.evaluate(GenericUDFBridge.java:190)atorg.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:186)atorg.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77)atorg.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluatorDeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:87)
at org.apache.hadoop.hive.ql.udf.generic.GenericUDFSplit.evaluate(GenericUDFSplit.java:66)
at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:186)
at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77)
at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:65)
at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:88)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:882)
at org.apache.hadoop.hive.ql.exec.LateralViewForwardOperator.process(LateralViewForwardOperator.java:39)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:882)
at org.apache.hadoop.hive.ql.exec.FilterOperator.process(FilterOperator.java:126)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:882)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:130)
at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:146)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:484)
… 9 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:998)
… 30 more
Caused by: java.util.regex.PatternSyntaxException: Illegal repetition
{
at java.util.regex.Pattern.error(Pattern.java:1969)
at java.util.regex.Pattern.closure(Pattern.java:3171)
at java.util.regex.Pattern.sequence(Pattern.java:2148)
at java.util.regex.Pattern.expr(Pattern.java:2010)
at java.util.regex.Pattern.compile(Pattern.java:1702)
at java.util.regex.Pattern.(Pattern.java:1352)
at java.util.regex.Pattern.compile(Pattern.java:1028)
at org.apache.hadoop.hive.ql.udf.UDFRegExpReplace.evaluate(UDFRegExpReplace.java:57)
… 35 more

解决方法:

set hive.vectorized.execution.enabled=false; 控制是否启用查询执行的向量模式。

但是:
向量化计算
https://cwiki.apache.org/confluence/display/Hive/Vectorized+Query+Execution
如果开启, sum(if(a=1,1,0))这样的语句跑不过

set hive.vectorized.execution.enabled=false;
set hive.vectorized.execution.reduce.enabled=false;
set hive.vectorized.groupby.checkinterval=4096;
set hive.vectorized.groupby.flush.percent=0.1;
动态分区相关

hive0.13有个bug, 开启这个配置会对所有字段排序

  • 1
    点赞
  • 2
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值