hbase 异常

在一个1.2TB大的表上做一些统计，抛出如下异常，ava.net.SocketTimeoutException: callTimeout=1200000

超时1200000毫秒，即20分钟.

2017-06-08 14:57:29,833 WARN  [hconnection-0x147a5d08-shared--pool2-t150] ipc.CoprocessorRpcChannel: Call failed on IOException

java.net.SocketTimeoutException: callTimeout=1200000, callDuration=1269557: Call to xxxxx/8.5.128.5:21302 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=9043, waitTime=60000, operationTimeout=60000 expired. row '@   ?q?' on table 'graphbase' at region=graphbase,@\x00\x00\x00\x06\xADq\xA8,1494076521419.b14b7b50558090bac32201f118c02384., hostname=xxxxx,21302,1495461214646, seqNum=11065711
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:176)
at org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:107)
at org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callMethod(CoprocessorRpcChannel.java:56)
at org.apache.hadoop.hbase.protobuf.generated.AggregateProtos$AggregateService$Stub.getRowNum(AggregateProtos.java:2113)
at org.apache.hadoop.hbase.client.coprocessor.AggregationClient$3.call(AggregationClient.java:326)
at org.apache.hadoop.hbase.client.coprocessor.AggregationClient$3.call(AggregationClient.java:320)
at org.apache.hadoop.hbase.client.HTable$15.call(HTable.java:1732)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Call to xxxxx/8.5.128.5:21302 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=9043, waitTime=60000, operationTimeout=60000 expired.
at org.apache.hadoop.hbase.ipc.AbstractRpcClient.wrapException(AbstractRpcClient.java:285)
at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1281)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:224)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:329)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.execService(ClientProtos.java:32887)
at org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1648)
at org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:104)
at org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel$1.call(RegionCoprocessorRpcChannel.java:94)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:138)

... 10 more

首先看yi个参数.

hbase.client.operation.timeout。

 
默认为1200000


显然知道那个参数设置问题了。