Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:494)
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:148)
... 8 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to execute method public org.apache.hadoop.io.Text org.apache.hadoop.hive.ql.udf.UDFRegExpReplace.evaluate(org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text) on object org.apache.hadoop.hive.ql.udf.UDFRegExpReplace@1a28b346 of class org.apache.hadoop.hive.ql.udf.UDFRegExpReplace with arguments :org.apache.hadoop.io.Text, {:org.apache.hadoop.io.Text, :org.apache.hadoop.io.Text} of size 3
at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:1024)
at org.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge.evaluate(GenericUDFBridge.java:194)
at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:186)
at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77)
at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator
D
e
f
e
r
r
e
d
E
x
p
r
O
b
j
e
c
t
.
g
e
t
(
E
x
p
r
N
o
d
e
G
e
n
e
r
i
c
F
u
n
c
E
v
a
l
u
a
t
o
r
.
j
a
v
a
:
87
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
h
i
v
e
.
q
l
.
u
d
f
.
g
e
n
e
r
i
c
.
G
e
n
e
r
i
c
U
D
F
B
r
i
d
g
e
.
e
v
a
l
u
a
t
e
(
G
e
n
e
r
i
c
U
D
F
B
r
i
d
g
e
.
j
a
v
a
:
190
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
h
i
v
e
.
q
l
.
e
x
e
c
.
E
x
p
r
N
o
d
e
G
e
n
e
r
i
c
F
u
n
c
E
v
a
l
u
a
t
o
r
.
e
v
a
l
u
a
t
e
(
E
x
p
r
N
o
d
e
G
e
n
e
r
i
c
F
u
n
c
E
v
a
l
u
a
t
o
r
.
j
a
v
a
:
186
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
h
i
v
e
.
q
l
.
e
x
e
c
.
E
x
p
r
N
o
d
e
E
v
a
l
u
a
t
o
r
.
e
v
a
l
u
a
t
e
(
E
x
p
r
N
o
d
e
E
v
a
l
u
a
t
o
r
.
j
a
v
a
:
77
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
h
i
v
e
.
q
l
.
e
x
e
c
.
E
x
p
r
N
o
d
e
G
e
n
e
r
i
c
F
u
n
c
E
v
a
l
u
a
t
o
r
DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:87) at org.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge.evaluate(GenericUDFBridge.java:190) at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:186) at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77) at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator
DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:87)atorg.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge.evaluate(GenericUDFBridge.java:190)atorg.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:186)atorg.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77)atorg.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluatorDeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:87)
at org.apache.hadoop.hive.ql.udf.generic.GenericUDFSplit.evaluate(GenericUDFSplit.java:66)
at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:186)
at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77)
at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:65)
at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:88)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:882)
at org.apache.hadoop.hive.ql.exec.LateralViewForwardOperator.process(LateralViewForwardOperator.java:39)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:882)
at org.apache.hadoop.hive.ql.exec.FilterOperator.process(FilterOperator.java:126)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:882)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:130)
at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:146)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:484)
… 9 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:998)
… 30 more
Caused by: java.util.regex.PatternSyntaxException: Illegal repetition
{
at java.util.regex.Pattern.error(Pattern.java:1969)
at java.util.regex.Pattern.closure(Pattern.java:3171)
at java.util.regex.Pattern.sequence(Pattern.java:2148)
at java.util.regex.Pattern.expr(Pattern.java:2010)
at java.util.regex.Pattern.compile(Pattern.java:1702)
at java.util.regex.Pattern.(Pattern.java:1352)
at java.util.regex.Pattern.compile(Pattern.java:1028)
at org.apache.hadoop.hive.ql.udf.UDFRegExpReplace.evaluate(UDFRegExpReplace.java:57)
… 35 more
解决方法:
set hive.vectorized.execution.enabled=false; 控制是否启用查询执行的向量模式。
但是:
向量化计算
https://cwiki.apache.org/confluence/display/Hive/Vectorized+Query+Execution
如果开启, sum(if(a=1,1,0))这样的语句跑不过
set hive.vectorized.execution.enabled=false;
set hive.vectorized.execution.reduce.enabled=false;
set hive.vectorized.groupby.checkinterval=4096;
set hive.vectorized.groupby.flush.percent=0.1;
动态分区相关
hive0.13有个bug, 开启这个配置会对所有字段排序