阿里云服务器部署分布式hadoop 2.7时,NameNode启动报Problem binding to [master:9000]问题

版权声明:本文为博主原创文章,遵循 CC 4.0 by-sa 版权协议,转载请附上原文出处链接和本声明。
本文链接:https://blog.csdn.net/f12105212/article/details/78465800
今天在阿里云服务器上部署hadoop时,master上执行jps时,只有secondarynamenode和jps进程,并无ResourceManager和NameNode的进程,仔细看了一下log,发现错误是Problem binding to [master:9000],以为是某个进程占用了9000端口,经查发现并无进程使用9000,后来google下得知问题出现在阿里云服务器的ip上,一般我们认为hosts上设置master的ip应该为公网ip,但是在实际使用中却只能使用内网的ip才能启动,原因我暂时没想明白,有知道的同学可以留言告之,谢谢。在此记录一笔,以免以后不再趟这个坑。
展开阅读全文

Problem binding to [master:9000] java.net.BindException: Cannot assign requested

08-01

3台云服务器搭建的集群rn在start-all.sh时jps主机只有一个jps进程。。。求大神帮助。。。rnjava.net.BindException: Problem binding to [master:9000] java.net.BindException: Cannot assign requested address; For more details see: http://wiki.apache.org/harndoop/BindExceptionrn at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)rn at org.apache.hadoop.ipc.Server.bind(Server.java:419)rn at org.apache.hadoop.ipc.Server$Listener.(Server.java:561)rn at org.apache.hadoop.ipc.Server.(Server.java:2166)rn at org.apache.hadoop.ipc.RPC$Server.(RPC.java:897)rn at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:505)rn at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)rn at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)rn at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.(NameNodeRpcServer.java:311)rn at org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:614)rn at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:587)rn at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:751)rn at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:735)rn at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1407)rn at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1473)rn2017-08-01 09:39:13,605 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1rn2017-08-01 09:39:13,611 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: rn/************************************************************rnSHUTDOWN_MSG: Shutting down NameNode at master/47.93.10.102rnrn[hadoop@master logs]$ cat /etc/hostsrni::1 localhost localhost.localdomain localhost6 localhost6.localdomainrn127.0.0.1 localhostrn47.93.10.102 masterrn118.89.106.74 slave1rn115.159.50.76 slave2rnrn rn yarn.nodemanager.aux-services.mapreduce.shuffle.classrn org.apache.hadoop.mapred.ShuffleHandlerrn rn rn yarn.resourcemanager.addressrn 47.93.10.102:8032rn rn rn yarn.resourcemanager.scheduler.addressrn 47.93.10.102:8030rn rn rn yarn.resourcemanager.resource-tracker.addressrn 47.93.10.102:8035rn rn rn yarn.resourcemanager.admin.addressrn 47.93.10.102:8033rn rn rn yarn.resourcemanager.webapp.addressrn 47.93.10.102:8088rn rn rn yarn.nodemanager.aux-servicesrn mapreduce_shufflernrnrn yarn.nodemanager.env-whitelistrnrn JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOMErnrnrn http://www.apache.org/licenses/LICENSE-2.0rnrn Unless required by applicable law or agreed to in writing, softwarern distributed under the License is distributed on an "AS IS" BASIS,rn WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.rn See the License for the specific language governing permissions andrn limitations under the License. See accompanying LICENSE file.rn-->rnrnrnrnrn rn fs.defaultFSrn hdfs://47.93.10.102:9000rn rn rn io.file.buffer.sizern 131072rn rn rn hadoop.tmp.dirrn file:/home/hadoop/chadoop/hadoop/hadoop-2.5.0/tmprn Abasefor other temporary directories.rn rn rn hadoop.proxyuser.spark.hostsrn *rn rnrn hadoop.proxyuser.spark.groupsrn *rn rnrnrnrnrnrn rn dfs.namenode.secondary.http-addressrn 47.93.10.102:9011rn 备份namenode的http地址rn rnrn rn dfs.namenode.name.dirrn file:/home/hadoop/chadoop/hadoop/hadoop-2.5.0/dfs/namern namenode的目录位置rn rnrn rn dfs.datanode.data.dirrn file:/home/hadoop/chadoop/hadoop/hadoop-2.5.0/dfs/datarn datanode's addressrn rnrn rn dfs.replicationrn 3rn hdfs系统的副本数量rn rnrn rn dfs.webhdfs.enabledrn truern rnrnrnrnrnrnrnrnrnrnrnrnproperty>rn mapreduce.framework.namern yarnrn 指明mapreduce的调度框架为yarnrn rn rn mapreduce.jobhistory.addressrn 47.93.10.102:10020rn 指明mapreduce的作业历史地址rn rn rn mapreduce.jobhistory.webapp.addressrn 47.93.10.102:19888rn 指明mapreduce的作业历史web地址rn rnrnrn这些应该是主要的配置文件了,小白一个,求各路大佬指教,谢谢了rn 论坛

hadoop 启动异常。jobtracker和namenode启动

03-04

master上jps,结果为rn15740 SecondaryNameNodern15906 Jpsrnrnslave上jps,结果为rn7315 TaskTrackerrn7218 DataNodern7427 Jpsrnrn#start-all.sh执行显示rnstarting namenode, logging to /var/log/hadoop/hadoop/hadoop-hadoop-namenode-vz-121-xinhailong.outrn10.1.1.112: starting datanode, logging to /var/log/hadoop/hadoop/hadoop-hadoop-datanode-localhost.localdomain.outrn10.1.9.121: starting secondarynamenode, logging to /var/log/hadoop/hadoop/hadoop-hadoop-secondarynamenode-vz-121-xinhailong.outrnstarting jobtracker, logging to /var/log/hadoop/hadoop/hadoop-hadoop-jobtracker-vz-121-xinhailong.outrn10.1.1.112: starting tasktracker, logging to /var/log/hadoop/hadoop/hadoop-hadoop-tasktracker-localhost.localdomain.outrnrn#stop-all.sh 显示rnno jobtracker to stoprn10.1.1.112: stopping tasktrackerrnno namenode to stoprn10.1.1.112: stopping datanodern10.1.9.121: stopping secondarynamenodernrn配置文件如下rn#vim /etc/hadoop/core-site.xml rn rn (注意,请先在 hadoopinstall 目录下建立 tmp 文件夹)rn rn hadoop.tmp.dirrn /home/hadoop/project/tmprn A base for other temporary directories.rn rnrn rn fs.default.namern hdfs://ip_master_node:50070rn rnrnrn#vim /etc/hadoop/hdfs-site.xmlrnrn dfs.name.dirrn /home/hadoop/project/hadoop/hdfs/namernrnrn dfs.data.dirrn /home/hadoop/project/hadoop/hdfs/datarnrnrn dfs.replicationrn 1rnrnrn#vim /etc/hadoop/mapred-site.xmlrnrn mapred.job.trackerrn ip_master_node:50030rnrn请问是什么原因导致的? 论坛

没有更多推荐了,返回首页