报错日志:
2020-03-13 22:34:34,826 INFO [main] mortbay.log: jetty-6.1.26
2020-03-13 22:34:35,959 INFO [main] mortbay.log: Started SelectChannelConnector@0.0.0.0:16010
2020-03-13 22:34:35,963 INFO [main] master.HMaster: hbase.rootdir=hdfs://master:9000/hbase, hbase.cluster.distributed=true
2020-03-13 22:34:36,018 INFO [main] master.HMaster: Adding backup master ZNode /hbase/backup-masters/master,16000,1584110066847
2020-03-13 22:34:36,374 INFO [master:16000.activeMasterManager] master.ActiveMasterManager: Deleting ZNode for /hbase/backup-masters/master,16000,1584110066847 from backup master directory
2020-03-13 22:34:36,406 INFO [master:16000.activeMasterManager] master.ActiveMasterManager: Registered Active Master=master,16000,1584110066847
2020-03-13 22:34:36,489 INFO [master/master/192.168.233.129:16000] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x71acdf40 connecting to ZooKeeper ensemble=master:2181,slave1:2181,slave2:2181,slave3:2181
2020-03-13 22:34:36,489 INFO [master/master/192.168.233.129:16000] zookeeper.ZooKeeper: Initiating client connection, connectString=master:2181,slave1:2181,slave2:2181,slave3:2181 sessionTimeout=90000 watcher=hconnection-0x71acdf400x0, quorum=master:2181,slave1:2181,slave2:2181,slave3:2181, baseZNode=/hbase
2020-03-13 22:34:36,524 INFO [master/master/192.168.233.129:16000-SendThread(slave2:2181)] zookeeper.ClientCnxn: Opening socket connection to server slave2/192.168.233.131:2181. Will not attempt to authenticate using SASL (unknown error)
2020-03-13 22:34:36,527 INFO [master/master/192.168.233.129:16000-SendThread(slave2:2181)] zookeeper.ClientCnxn: Socket connection established to slave2/192.168.233.131:2181, initiating session
2020-03-13 22:34:36,582 INFO [master/master/192.168.233.129:16000-SendThread(slave2:2181)] zookeeper.ClientCnxn: Session establishment complete on server slave2/192.168.233.131:2181, sessionid = 0x370d41997d10000, negotiated timeout = 40000
2020-03-13 22:34:36,605 FATAL [master:16000.activeMasterManager] master.HMaster: Failed to become active master
java.net.ConnectException: Call From master/192.168.233.129 to master:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730)
at org.apache.hadoop.ipc.Client.call(Client.java:1415)
at org.apache.hadoop.ipc.Client.call(Client.java:1364)
at org.apache.hadoop.ipc.ProtobufRpcEngine
I
n
v
o
k
e
r
.
i
n
v
o
k
e
(
P
r
o
t
o
b
u
f
R
p
c
E
n
g
i
n
e
.
j
a
v
a
:
206
)
a
t
c
o
m
.
s
u
n
.
p
r
o
x
y
.
Invoker.invoke(ProtobufRpcEngine.java:206) at com.sun.proxy.
Invoker.invoke(ProtobufRpcEngine.java:206)atcom.sun.proxy.Proxy15.setSafeMode(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at com.sun.proxy.$Proxy15.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:602)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hbase.fs.HFileSystem
1.
i
n
v
o
k
e
(
H
F
i
l
e
S
y
s
t
e
m
.
j
a
v
a
:
279
)
a
t
c
o
m
.
s
u
n
.
p
r
o
x
y
.
1.invoke(HFileSystem.java:279) at com.sun.proxy.
1.invoke(HFileSystem.java:279)atcom.sun.proxy.Proxy16.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264)
at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:986)
at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:970)
at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525)
at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:971)
at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:429)
at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:153)
at org.apache.hadoop.hbase.master.MasterFileSystem.(MasterFileSystem.java:128)
at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:693)
at org.apache.hadoop.hbase.master.HMaster.access$600(HMaster.java:189)
at org.apache.hadoop.hbase.master.HMaster
2.
r
u
n
(
H
M
a
s
t
e
r
.
j
a
v
a
:
1803
)
a
t
j
a
v
a
.
l
a
n
g
.
T
h
r
e
a
d
.
r
u
n
(
T
h
r
e
a
d
.
j
a
v
a
:
748
)
C
a
u
s
e
d
b
y
:
j
a
v
a
.
n
e
t
.
C
o
n
n
e
c
t
E
x
c
e
p
t
i
o
n
:
C
o
n
n
e
c
t
i
o
n
r
e
f
u
s
e
d
a
t
s
u
n
.
n
i
o
.
c
h
.
S
o
c
k
e
t
C
h
a
n
n
e
l
I
m
p
l
.
c
h
e
c
k
C
o
n
n
e
c
t
(
N
a
t
i
v
e
M
e
t
h
o
d
)
a
t
s
u
n
.
n
i
o
.
c
h
.
S
o
c
k
e
t
C
h
a
n
n
e
l
I
m
p
l
.
f
i
n
i
s
h
C
o
n
n
e
c
t
(
S
o
c
k
e
t
C
h
a
n
n
e
l
I
m
p
l
.
j
a
v
a
:
717
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
n
e
t
.
S
o
c
k
e
t
I
O
W
i
t
h
T
i
m
e
o
u
t
.
c
o
n
n
e
c
t
(
S
o
c
k
e
t
I
O
W
i
t
h
T
i
m
e
o
u
t
.
j
a
v
a
:
206
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
n
e
t
.
N
e
t
U
t
i
l
s
.
c
o
n
n
e
c
t
(
N
e
t
U
t
i
l
s
.
j
a
v
a
:
529
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
n
e
t
.
N
e
t
U
t
i
l
s
.
c
o
n
n
e
c
t
(
N
e
t
U
t
i
l
s
.
j
a
v
a
:
493
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
C
l
i
e
n
t
2.run(HMaster.java:1803) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493) at org.apache.hadoop.ipc.Client
2.run(HMaster.java:1803)atjava.lang.Thread.run(Thread.java:748)Causedby:java.net.ConnectException:Connectionrefusedatsun.nio.ch.SocketChannelImpl.checkConnect(NativeMethod)atsun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)atorg.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)atorg.apache.hadoop.net.NetUtils.connect(NetUtils.java:529)atorg.apache.hadoop.net.NetUtils.connect(NetUtils.java:493)atorg.apache.hadoop.ipc.ClientConnection.setupConnection(Client.java:606)
at org.apache.hadoop.ipc.Client
C
o
n
n
e
c
t
i
o
n
.
s
e
t
u
p
I
O
s
t
r
e
a
m
s
(
C
l
i
e
n
t
.
j
a
v
a
:
700
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
C
l
i
e
n
t
Connection.setupIOstreams(Client.java:700) at org.apache.hadoop.ipc.Client
Connection.setupIOstreams(Client.java:700)atorg.apache.hadoop.ipc.ClientConnection.access
2800
(
C
l
i
e
n
t
.
j
a
v
a
:
367
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
C
l
i
e
n
t
.
g
e
t
C
o
n
n
e
c
t
i
o
n
(
C
l
i
e
n
t
.
j
a
v
a
:
1463
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
C
l
i
e
n
t
.
c
a
l
l
(
C
l
i
e
n
t
.
j
a
v
a
:
1382
)
.
.
.
29
m
o
r
e
2020
−
03
−
1322
:
34
:
36
,
607
F
A
T
A
L
[
m
a
s
t
e
r
:
16000.
a
c
t
i
v
e
M
a
s
t
e
r
M
a
n
a
g
e
r
]
m
a
s
t
e
r
.
H
M
a
s
t
e
r
:
U
n
h
a
n
d
l
e
d
e
x
c
e
p
t
i
o
n
.
S
t
a
r
t
i
n
g
s
h
u
t
d
o
w
n
.
j
a
v
a
.
n
e
t
.
C
o
n
n
e
c
t
E
x
c
e
p
t
i
o
n
:
C
a
l
l
F
r
o
m
m
a
s
t
e
r
/
192.168.233.129
t
o
m
a
s
t
e
r
:
9000
f
a
i
l
e
d
o
n
c
o
n
n
e
c
t
i
o
n
e
x
c
e
p
t
i
o
n
:
j
a
v
a
.
n
e
t
.
C
o
n
n
e
c
t
E
x
c
e
p
t
i
o
n
:
C
o
n
n
e
c
t
i
o
n
r
e
f
u
s
e
d
;
F
o
r
m
o
r
e
d
e
t
a
i
l
s
s
e
e
:
h
t
t
p
:
/
/
w
i
k
i
.
a
p
a
c
h
e
.
o
r
g
/
h
a
d
o
o
p
/
C
o
n
n
e
c
t
i
o
n
R
e
f
u
s
e
d
a
t
s
u
n
.
r
e
f
l
e
c
t
.
N
a
t
i
v
e
C
o
n
s
t
r
u
c
t
o
r
A
c
c
e
s
s
o
r
I
m
p
l
.
n
e
w
I
n
s
t
a
n
c
e
0
(
N
a
t
i
v
e
M
e
t
h
o
d
)
a
t
s
u
n
.
r
e
f
l
e
c
t
.
N
a
t
i
v
e
C
o
n
s
t
r
u
c
t
o
r
A
c
c
e
s
s
o
r
I
m
p
l
.
n
e
w
I
n
s
t
a
n
c
e
(
N
a
t
i
v
e
C
o
n
s
t
r
u
c
t
o
r
A
c
c
e
s
s
o
r
I
m
p
l
.
j
a
v
a
:
62
)
a
t
s
u
n
.
r
e
f
l
e
c
t
.
D
e
l
e
g
a
t
i
n
g
C
o
n
s
t
r
u
c
t
o
r
A
c
c
e
s
s
o
r
I
m
p
l
.
n
e
w
I
n
s
t
a
n
c
e
(
D
e
l
e
g
a
t
i
n
g
C
o
n
s
t
r
u
c
t
o
r
A
c
c
e
s
s
o
r
I
m
p
l
.
j
a
v
a
:
45
)
a
t
j
a
v
a
.
l
a
n
g
.
r
e
f
l
e
c
t
.
C
o
n
s
t
r
u
c
t
o
r
.
n
e
w
I
n
s
t
a
n
c
e
(
C
o
n
s
t
r
u
c
t
o
r
.
j
a
v
a
:
423
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
n
e
t
.
N
e
t
U
t
i
l
s
.
w
r
a
p
W
i
t
h
M
e
s
s
a
g
e
(
N
e
t
U
t
i
l
s
.
j
a
v
a
:
783
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
n
e
t
.
N
e
t
U
t
i
l
s
.
w
r
a
p
E
x
c
e
p
t
i
o
n
(
N
e
t
U
t
i
l
s
.
j
a
v
a
:
730
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
C
l
i
e
n
t
.
c
a
l
l
(
C
l
i
e
n
t
.
j
a
v
a
:
1415
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
C
l
i
e
n
t
.
c
a
l
l
(
C
l
i
e
n
t
.
j
a
v
a
:
1364
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
P
r
o
t
o
b
u
f
R
p
c
E
n
g
i
n
e
2800(Client.java:367) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1463) at org.apache.hadoop.ipc.Client.call(Client.java:1382) ... 29 more 2020-03-13 22:34:36,607 FATAL [master:16000.activeMasterManager] master.HMaster: Unhandled exception. Starting shutdown. java.net.ConnectException: Call From master/192.168.233.129 to master:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730) at org.apache.hadoop.ipc.Client.call(Client.java:1415) at org.apache.hadoop.ipc.Client.call(Client.java:1364) at org.apache.hadoop.ipc.ProtobufRpcEngine
2800(Client.java:367)atorg.apache.hadoop.ipc.Client.getConnection(Client.java:1463)atorg.apache.hadoop.ipc.Client.call(Client.java:1382)...29more2020−03−1322:34:36,607FATAL[master:16000.activeMasterManager]master.HMaster:Unhandledexception.Startingshutdown.java.net.ConnectException:CallFrommaster/192.168.233.129tomaster:9000failedonconnectionexception:java.net.ConnectException:Connectionrefused;Formoredetailssee:http://wiki.apache.org/hadoop/ConnectionRefusedatsun.reflect.NativeConstructorAccessorImpl.newInstance0(NativeMethod)atsun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)atsun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)atjava.lang.reflect.Constructor.newInstance(Constructor.java:423)atorg.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)atorg.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730)atorg.apache.hadoop.ipc.Client.call(Client.java:1415)atorg.apache.hadoop.ipc.Client.call(Client.java:1364)atorg.apache.hadoop.ipc.ProtobufRpcEngineInvoker.invoke(ProtobufRpcEngine.java:206)
at com.sun.proxy.
P
r
o
x
y
15.
s
e
t
S
a
f
e
M
o
d
e
(
U
n
k
n
o
w
n
S
o
u
r
c
e
)
a
t
s
u
n
.
r
e
f
l
e
c
t
.
N
a
t
i
v
e
M
e
t
h
o
d
A
c
c
e
s
s
o
r
I
m
p
l
.
i
n
v
o
k
e
0
(
N
a
t
i
v
e
M
e
t
h
o
d
)
a
t
s
u
n
.
r
e
f
l
e
c
t
.
N
a
t
i
v
e
M
e
t
h
o
d
A
c
c
e
s
s
o
r
I
m
p
l
.
i
n
v
o
k
e
(
N
a
t
i
v
e
M
e
t
h
o
d
A
c
c
e
s
s
o
r
I
m
p
l
.
j
a
v
a
:
62
)
a
t
s
u
n
.
r
e
f
l
e
c
t
.
D
e
l
e
g
a
t
i
n
g
M
e
t
h
o
d
A
c
c
e
s
s
o
r
I
m
p
l
.
i
n
v
o
k
e
(
D
e
l
e
g
a
t
i
n
g
M
e
t
h
o
d
A
c
c
e
s
s
o
r
I
m
p
l
.
j
a
v
a
:
43
)
a
t
j
a
v
a
.
l
a
n
g
.
r
e
f
l
e
c
t
.
M
e
t
h
o
d
.
i
n
v
o
k
e
(
M
e
t
h
o
d
.
j
a
v
a
:
498
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
o
.
r
e
t
r
y
.
R
e
t
r
y
I
n
v
o
c
a
t
i
o
n
H
a
n
d
l
e
r
.
i
n
v
o
k
e
M
e
t
h
o
d
(
R
e
t
r
y
I
n
v
o
c
a
t
i
o
n
H
a
n
d
l
e
r
.
j
a
v
a
:
187
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
o
.
r
e
t
r
y
.
R
e
t
r
y
I
n
v
o
c
a
t
i
o
n
H
a
n
d
l
e
r
.
i
n
v
o
k
e
(
R
e
t
r
y
I
n
v
o
c
a
t
i
o
n
H
a
n
d
l
e
r
.
j
a
v
a
:
102
)
a
t
c
o
m
.
s
u
n
.
p
r
o
x
y
.
Proxy15.setSafeMode(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.
Proxy15.setSafeMode(UnknownSource)atsun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethod)atsun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)atsun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)atjava.lang.reflect.Method.invoke(Method.java:498)atorg.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)atorg.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)atcom.sun.proxy.Proxy15.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:602)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hbase.fs.HFileSystem
1.
i
n
v
o
k
e
(
H
F
i
l
e
S
y
s
t
e
m
.
j
a
v
a
:
279
)
a
t
c
o
m
.
s
u
n
.
p
r
o
x
y
.
1.invoke(HFileSystem.java:279) at com.sun.proxy.
1.invoke(HFileSystem.java:279)atcom.sun.proxy.Proxy16.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264)
at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:986)
at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:970)
at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525)
at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:971)
at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:429)
at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:153)
at org.apache.hadoop.hbase.master.MasterFileSystem.(MasterFileSystem.java:128)
at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:693)
at org.apache.hadoop.hbase.master.HMaster.access$600(HMaster.java:189)
at org.apache.hadoop.hbase.master.HMaster
2.
r
u
n
(
H
M
a
s
t
e
r
.
j
a
v
a
:
1803
)
a
t
j
a
v
a
.
l
a
n
g
.
T
h
r
e
a
d
.
r
u
n
(
T
h
r
e
a
d
.
j
a
v
a
:
748
)
C
a
u
s
e
d
b
y
:
j
a
v
a
.
n
e
t
.
C
o
n
n
e
c
t
E
x
c
e
p
t
i
o
n
:
C
o
n
n
e
c
t
i
o
n
r
e
f
u
s
e
d
a
t
s
u
n
.
n
i
o
.
c
h
.
S
o
c
k
e
t
C
h
a
n
n
e
l
I
m
p
l
.
c
h
e
c
k
C
o
n
n
e
c
t
(
N
a
t
i
v
e
M
e
t
h
o
d
)
a
t
s
u
n
.
n
i
o
.
c
h
.
S
o
c
k
e
t
C
h
a
n
n
e
l
I
m
p
l
.
f
i
n
i
s
h
C
o
n
n
e
c
t
(
S
o
c
k
e
t
C
h
a
n
n
e
l
I
m
p
l
.
j
a
v
a
:
717
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
n
e
t
.
S
o
c
k
e
t
I
O
W
i
t
h
T
i
m
e
o
u
t
.
c
o
n
n
e
c
t
(
S
o
c
k
e
t
I
O
W
i
t
h
T
i
m
e
o
u
t
.
j
a
v
a
:
206
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
n
e
t
.
N
e
t
U
t
i
l
s
.
c
o
n
n
e
c
t
(
N
e
t
U
t
i
l
s
.
j
a
v
a
:
529
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
n
e
t
.
N
e
t
U
t
i
l
s
.
c
o
n
n
e
c
t
(
N
e
t
U
t
i
l
s
.
j
a
v
a
:
493
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
C
l
i
e
n
t
2.run(HMaster.java:1803) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493) at org.apache.hadoop.ipc.Client
2.run(HMaster.java:1803)atjava.lang.Thread.run(Thread.java:748)Causedby:java.net.ConnectException:Connectionrefusedatsun.nio.ch.SocketChannelImpl.checkConnect(NativeMethod)atsun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)atorg.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)atorg.apache.hadoop.net.NetUtils.connect(NetUtils.java:529)atorg.apache.hadoop.net.NetUtils.connect(NetUtils.java:493)atorg.apache.hadoop.ipc.ClientConnection.setupConnection(Client.java:606)
at org.apache.hadoop.ipc.Client
C
o
n
n
e
c
t
i
o
n
.
s
e
t
u
p
I
O
s
t
r
e
a
m
s
(
C
l
i
e
n
t
.
j
a
v
a
:
700
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
C
l
i
e
n
t
Connection.setupIOstreams(Client.java:700) at org.apache.hadoop.ipc.Client
Connection.setupIOstreams(Client.java:700)atorg.apache.hadoop.ipc.ClientConnection.access
2800
(
C
l
i
e
n
t
.
j
a
v
a
:
367
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
C
l
i
e
n
t
.
g
e
t
C
o
n
n
e
c
t
i
o
n
(
C
l
i
e
n
t
.
j
a
v
a
:
1463
)
a
t
o
r
g
.
a
p
a
c
h
e
.
h
a
d
o
o
p
.
i
p
c
.
C
l
i
e
n
t
.
c
a
l
l
(
C
l
i
e
n
t
.
j
a
v
a
:
1382
)
.
.
.
29
m
o
r
e
2020
−
03
−
1322
:
34
:
36
,
608
I
N
F
O
[
m
a
s
t
e
r
:
16000.
a
c
t
i
v
e
M
a
s
t
e
r
M
a
n
a
g
e
r
]
r
e
g
i
o
n
s
e
r
v
e
r
.
H
R
e
g
i
o
n
S
e
r
v
e
r
:
S
T
O
P
P
E
D
:
U
n
h
a
n
d
l
e
d
e
x
c
e
p
t
i
o
n
.
S
t
a
r
t
i
n
g
s
h
u
t
d
o
w
n
.
2020
−
03
−
1322
:
34
:
36
,
912
I
N
F
O
[
m
a
s
t
e
r
/
m
a
s
t
e
r
/
192.168.233.129
:
16000
]
r
e
g
i
o
n
s
e
r
v
e
r
.
H
R
e
g
i
o
n
S
e
r
v
e
r
:
C
l
u
s
t
e
r
I
d
:
0
d
d
0199
a
−
e
6
a
2
−
4
a
82
−
8
b
f
1
−
b
30
a
f
3
e
4
c
4
d
a
2020
−
03
−
1322
:
34
:
36
,
912
I
N
F
O
[
m
a
s
t
e
r
/
m
a
s
t
e
r
/
192.168.233.129
:
16000
]
r
e
g
i
o
n
s
e
r
v
e
r
.
H
R
e
g
i
o
n
S
e
r
v
e
r
:
S
t
o
p
p
i
n
g
i
n
f
o
S
e
r
v
e
r
2020
−
03
−
1322
:
34
:
37
,
166
I
N
F
O
[
m
a
s
t
e
r
/
m
a
s
t
e
r
/
192.168.233.129
:
16000
]
m
o
r
t
b
a
y
.
l
o
g
:
S
t
o
p
p
e
d
S
e
l
e
c
t
C
h
a
n
n
e
l
C
o
n
n
e
c
t
o
r
@
0.0.0.0
:
160102020
−
03
−
1322
:
34
:
37
,
175
I
N
F
O
[
m
a
s
t
e
r
/
m
a
s
t
e
r
/
192.168.233.129
:
16000
]
r
e
g
i
o
n
s
e
r
v
e
r
.
H
R
e
g
i
o
n
S
e
r
v
e
r
:
s
t
o
p
p
i
n
g
s
e
r
v
e
r
m
a
s
t
e
r
,
16000
,
15841100668472020
−
03
−
1322
:
34
:
37
,
175
I
N
F
O
[
m
a
s
t
e
r
/
m
a
s
t
e
r
/
192.168.233.129
:
16000
]
c
l
i
e
n
t
.
C
o
n
n
e
c
t
i
o
n
M
a
n
a
g
e
r
2800(Client.java:367) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1463) at org.apache.hadoop.ipc.Client.call(Client.java:1382) ... 29 more 2020-03-13 22:34:36,608 INFO [master:16000.activeMasterManager] regionserver.HRegionServer: STOPPED: Unhandled exception. Starting shutdown. 2020-03-13 22:34:36,912 INFO [master/master/192.168.233.129:16000] regionserver.HRegionServer: ClusterId : 0dd0199a-e6a2-4a82-8bf1-b30af3e4c4da 2020-03-13 22:34:36,912 INFO [master/master/192.168.233.129:16000] regionserver.HRegionServer: Stopping infoServer 2020-03-13 22:34:37,166 INFO [master/master/192.168.233.129:16000] mortbay.log: Stopped SelectChannelConnector@0.0.0.0:16010 2020-03-13 22:34:37,175 INFO [master/master/192.168.233.129:16000] regionserver.HRegionServer: stopping server master,16000,1584110066847 2020-03-13 22:34:37,175 INFO [master/master/192.168.233.129:16000] client.ConnectionManager
2800(Client.java:367)atorg.apache.hadoop.ipc.Client.getConnection(Client.java:1463)atorg.apache.hadoop.ipc.Client.call(Client.java:1382)...29more2020−03−1322:34:36,608INFO[master:16000.activeMasterManager]regionserver.HRegionServer:STOPPED:Unhandledexception.Startingshutdown.2020−03−1322:34:36,912INFO[master/master/192.168.233.129:16000]regionserver.HRegionServer:ClusterId:0dd0199a−e6a2−4a82−8bf1−b30af3e4c4da2020−03−1322:34:36,912INFO[master/master/192.168.233.129:16000]regionserver.HRegionServer:StoppinginfoServer2020−03−1322:34:37,166INFO[master/master/192.168.233.129:16000]mortbay.log:StoppedSelectChannelConnector@0.0.0.0:160102020−03−1322:34:37,175INFO[master/master/192.168.233.129:16000]regionserver.HRegionServer:stoppingservermaster,16000,15841100668472020−03−1322:34:37,175INFO[master/master/192.168.233.129:16000]client.ConnectionManagerHConnectionImplementation: Closing zookeeper sessionid=0x370d41997d10000
2020-03-13 22:34:37,222 INFO [master/master/192.168.233.129:16000] zookeeper.ZooKeeper: Session: 0x370d41997d10000 closed
2020-03-13 22:34:37,222 INFO [master/master/192.168.233.129:16000-EventThread] zookeeper.ClientCnxn: EventThread shut down
2020-03-13 22:34:37,225 INFO [master/master/192.168.233.129:16000] regionserver.HRegionServer: stopping server master,16000,1584110066847; all regions closed.
2020-03-13 22:34:37,225 INFO [master/master/192.168.233.129:16000] hbase.ChoreService: Chore service for: master,16000,1584110066847 had [] on shutdown
2020-03-13 22:34:37,286 INFO [master/master/192.168.233.129:16000] ipc.RpcServer: Stopping server on 16000
2020-03-13 22:34:37,287 INFO [RpcServer.listener,port=16000] ipc.RpcServer: RpcServer.listener,port=16000: stopping
2020-03-13 22:34:37,341 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: stopped
2020-03-13 22:34:37,341 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: stopping
2020-03-13 22:34:37,373 INFO [master/master/192.168.233.129:16000] zookeeper.ZooKeeper: Session: 0x270d4199b500001 closed
2020-03-13 22:34:37,373 INFO [master/master/192.168.233.129:16000] regionserver.HRegionServer: stopping server master,16000,1584110066847; zookeeper connection closed.
2020-03-13 22:34:37,373 INFO [master/master/192.168.233.129:16000] regionserver.HRegionServer: master/master/192.168.233.129:16000 exiting
2020-03-13 22:34:37,373 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down
出现了HMaster进程,但是执行hbase shell报错,如下:
以上出现的原因--------个人分析:
在部署hbase集群时需要关闭自身的ZooKeeper使用外部的ZooKeeper,以上出现的问题主要是hbase与ZooKeeper之间的通信出现了问题。
解决方法:
1、在网上搜索一通,大部分都是下解决方案,应该能解决有些问题,但是没有解决我的;
https://blog.csdn.net/zhangchen124/article/details/92801139
2、我主要出现的问题是
hbase 的配置文件hbase-site.xml 中的 hbase.rootdir 值要与hadoop 配置文件core-site.xml 的dfs.Deafult 配置没有保持一致。
更改对应配置文件如下
core-site.xml中
hbase-site.xml中
重新启动hbase,start-hbase.sh
zookeeper-hbase启动报错
最新推荐文章于 2023-05-06 21:00:00 发布