hadoop群集get文件的时候出现报错

最新推荐文章于 2022-09-17 22:55:38 发布

TURING.DT

最新推荐文章于 2022-09-17 22:55:38 发布

阅读量3k

点赞数

分类专栏： HADOOP

本文链接：https://blog.csdn.net/levy_cui/article/details/51143043

版权

HADOOP 专栏收录该内容

81 篇文章 3 订阅

订阅专栏

今天hadoop群集get文件的时候出现报错，如下：
$hdfs dfs -get /test/part-r-00000.gz ./

15/09/15 09:20:33 INFO hdfs.DFSClient: Access token was invalid when connecting to /192.168.2.42:50010 : org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51440, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
15/09/15 09:20:33 WARN hdfs.DFSClient: Failed to connect to /192.168.2.42:50010 for block, add to deadNodes and continue. org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51441, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51441, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
    at org.apache.hadoop.hdfs.RemoteBlockReader2.checkSuccess(RemoteBlockReader2.java:425)
    at org.apache.hadoop.hdfs.RemoteBlockReader2.newBlockReader(RemoteBlockReader2.java:397)
    at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReader(BlockReaderFactory.java:786)
    at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:665)
    at org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:325)

获取不到Block文件，后来发现有人大量的使用put命令进行文件的上传，导致hdfs拥堵，所以下载不了文件，kill到put进程，就恢复正常了。