Protocol message end-group tag did not match expected tagHost Details local host is destination host

问题:

	Exception in thread "main" java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.; Host Details : local host is: "wangzhen-bio/192.168.137.1"; destination host is: "bioyuanA":9000; 
		at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
		at org.apache.hadoop.ipc.Client.call(Client.java:1474)
		at org.apache.hadoop.ipc.Client.call(Client.java:1401)
		at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
		at com.sun.proxy.$Proxy21.getFileInfo(Unknown Source)
		at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:752)
		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.lang.reflect.Method.invoke(Method.java:498)
		at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
		at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
		at com.sun.proxy.$Proxy22.getFileInfo(Unknown Source)
		at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1977)
		at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1118)
		at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1114)
		at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
		at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1114)
		at org.apache.hadoop.fs.Globber.getFileStatus(Globber.java:57)
		at org.apache.hadoop.fs.Globber.glob(Globber.java:252)
		at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1644)
		at org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:257)
		at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:228)
		at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:313)
		at org.apache.spark.rdd.HadoopRDD.getPartitions(HadoopRDD.scala:200)
		at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:253)
		at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:251)
		at scala.Option.getOrElse(Option.scala:121)
		at org.apache.spark.rdd.RDD.partitions(RDD.scala:251)
		at org.apache.spark.rdd.MapPartitionsRDD.getPartitions(MapPartitionsRDD.scala:46)
		at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:253)
		at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:251)
		at scala.Option.getOrElse(Option.scala:121)
		at org.apache.spark.rdd.RDD.partitions(RDD.scala:251)
		at org.apache.spark.SparkContext.runJob(SparkContext.scala:2099)
		at org.apache.spark.rdd.RDD$$anonfun$foreach$1.apply(RDD.scala:927)
		at org.apache.spark.rdd.RDD$$anonfun$foreach$1.apply(RDD.scala:925)
		at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
		at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
		at org.apache.spark.rdd.RDD.withScope(RDD.scala:363)
		at org.apache.spark.rdd.RDD.foreach(RDD.scala:925)
		at readHive.ReadHdfs$.main(ReadHdfs.scala:20)
		at readHive.ReadHdfs.main(ReadHdfs.scala)
	Caused by: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.
		at com.google.protobuf.InvalidProtocolBufferException.invalidEndTag(InvalidProtocolBufferException.java:94)
		at com.google.protobuf.CodedInputStream.checkLastTagWas(CodedInputStream.java:124)
		at com.google.protobuf.AbstractParser.parsePartialFrom(AbstractParser.java:202)
		at com.google.protobuf.AbstractParser.parsePartialDelimitedFrom(AbstractParser.java:241)
		at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:253)
		at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:259)
		at com.google.protobuf.AbstractParser.parseDelimitedFrom(AbstractParser.java:49)
		at org.apache.hadoop.ipc.protobuf.RpcHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcHeaderProtos.java:3167)
		at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1074)
		at org.apache.hadoop.ipc.Client$Connection.run(Client.java:968)

问题解决:
在大数据集群中执行如下命令,查看远程端口
hdfs getconf -confKey fs.default.name
然后使用如下命令测试:port为上一步的结果
hdfs dfs -ls hdfs://bioyuanA:port/

  • 1
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值