转载一篇关于EOFException异常的描述

最新推荐文章于 2024-04-26 08:53:06 发布

fish_cool

最新推荐文章于 2024-04-26 08:53:06 发布

阅读量3.6k

点赞数

分类专栏： hadoop

hadoop 专栏收录该内容

75 篇文章 0 订阅

订阅专栏

I’ve noticed that occasionally a data node will be reported in the namenode web ui as “dead” for a minute or two and then move back to live. This morning I found this in the data node log

2011-08-30 06:41:54,538 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: writeBlock blk_7836987981877259019_6951898 received exception java.io.EOFException: while trying to read 65557 bytes

2011-08-30 06:41:54,538 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.1.10.40:50010, storageID=DS-148472958-127.0.0.1-50010-1306244056289, infoPort=50075, ipcPort=50020):DataXceiver

java.io.EOFException: while trying to read 65557 bytes

at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.readToBuf(BlockReceiver.java:270)

at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.readNextPacket(BlockReceiver.java:314)

at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:378)

at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:534)

at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:417)

at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:122)

2011-08-30 06:41:57,447 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Datanode 9 got response for connect ack from downstream datanode with firstbadlink as10.1.10.46:50010

2011-08-30 06:41:57,448 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Datanode 9 forwarding connect ack to upstream firstbadlink is 10.1.10.46:50010

2011-08-30 06:41:57,487 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in receiveBlock for block blk_-8495252012538377530_6951901 java.io.EOFException: while trying to read 65557 bytes

2011-08-30 06:41:57,560 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: IOException in BlockReceiver.run():

java.nio.channels.ClosedByInterruptException

at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:184)

at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:341)

at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:55)

at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)

at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:146)

at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:107)

at java.io.DataOutputStream.writeLong(DataOutputStream.java:207)

at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$PipelineAck.write(DataTransferProtocol.java:133)

at org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1003)

at java.lang.Thread.run(Thread.java:662)

2011-08-30 06:41:57,561 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: checkDiskError: exception: