Cannot assign requested address: Service 'sparkMaster' failed after 16 retries (starting from 7077)!

spark-2.1.1-bin-hadoop2.7安装完成在启动时出现:“ Exception in thread “main” java.net.BindException: Cannot assign requested address: Service ‘sparkMaster’ failed after 16 retries (starting from 7077)! Consider explicitly setting the appropriate port for the service ‘sparkMaster’ (for example spark.ui.port for SparkUI) to an available port or increasing spark.port.maxRetries”

错误日志:

[bigdata@linux logs]$ cat spark-bigdata-org.apache.spark.deploy.master.Master-1-linux.out.2
Spark Command: /home/bigdata/cluster/jdk1.8.0_181/bin/java -cp /home/bigdata/cluster/spark/conf/:/home/bigdata/cluster/spark/jars/* -Xmx1g org.apache.spark.deploy.master.Master --host linux.localdomain --port 7077 --webui-port 8080
========================================
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
18/11/20 17:21:56 INFO Master: Started daemon with process name: 2097@linux
18/11/20 17:21:56 INFO SignalUtils: Registered signal handler for TERM
18/11/20 17:21:56 INFO SignalUtils: Registered signal handler for HUP
18/11/20 17:21:56 INFO SignalUtils: Registered signal handler for INT
18/11/20 17:21:56 WARN MasterArguments: SPARK_MASTER_IP is deprecated, please use SPARK_MASTER_HOST
18/11/20 17:21:58 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
18/11/20 17:21:58 INFO SecurityManager: Changing view acls to: bigdata
18/11/20 17:21:58 INFO SecurityManager: Changing modify acls to: bigdata
18/11/20 17:21:58 INFO SecurityManager: Changing view acls groups to: 
18/11/20 17:21:58 INFO SecurityManager: Changing modify acls groups to: 
18/11/20 17:21:58 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(bigdata); groups with view permissions: Set(); users  with modify permissions: Set(bigdata); groups with modify permissions: Set()
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7077. Attempting port 7078.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7078. Attempting port 7079.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7079. Attempting port 7080.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7080. Attempting port 7081.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7081. Attempting port 7082.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7082. Attempting port 7083.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7083. Attempting port 7084.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7084. Attempting port 7085.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7085. Attempting port 7086.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7086. Attempting port 7087.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7087. Attempting port 7088.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7088. Attempting port 7089.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7089. Attempting port 7090.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7090. Attempting port 7091.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7091. Attempting port 7092.
18/11/20 17:21:59 WARN Utils: Service 'sparkMaster' could not bind on port 7092. Attempting port 7093.
Exception in thread "main" java.net.BindException: Cannot assign requested address: Service 'sparkMaster' failed after 16 retries (starting from 7077)! Consider explicitly setting the appropriate port for the service 'sparkMaster' (for example spark.ui.port for SparkUI) to an available port or increasing spark.port.maxRetries.
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:433)
	at sun.nio.ch.Net.bind(Net.java:425)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
	at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:127)
	at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:501)
	at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1218)
	at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:506)
	at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:491)
	at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:965)
	at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:210)
	at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:353)
	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:408)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:455)
	at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:140)
	at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:144)
	at java.lang.Thread.run(Thread.java:748)

spark-env.sh配置文件如下:

export JAVA_HOME=/home/bigdata/cluster/jdk1.8.0_181
export SPARK_MASTER_HOST=192.168.159.7
export SPARK_MASTER_PORT=7078    #将端口从7077修改为7078
export SPARK_MASTER_WEBUI_PORT=8080

根据日志,是说不能从7077端口启动spark server,故修改该端口。然后重启spark server ,发现能正常启动。
在这里插入图片描述
通过webui访问spark :
在这里插入图片描述

  • 1
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值