idea spark java_IDEA的java代码远程连接spark问题

IDEA的java单词计数代码远程连接spark,日志没有报错,却一直在显示提交。

10:09:41.164 [dispatcher-event-loop-0] INFO org.apache.spark.storage.BlockManagerMaster - Removal of executor 84 requested

10:09:41.164 [dispatcher-event-loop-0] INFO org.apache.spark.scheduler.cluster.CoarseGrainedSchedulerBackend$DriverEndpoint - Asked to remove non-existent executor 84

10:09:41.164 [dispatcher-event-loop-2] INFO org.apache.spark.scheduler.cluster.StandaloneSchedulerBackend - Granted executor ID app-20200305100612-0039/85 on hostPort 172.17.0.14:39162 with 2 core(s), 1024.0 MB RAM

10:09:41.165 [dispatcher-event-loop-7] INFO org.apache.spark.deploy.client.StandaloneAppClient$ClientEndpoint - Executor updated: app-20200305100612-0039/85 is now RUNNING

10:09:41.901 [dispatcher-event-loop-3] DEBUG org.apache.spark.scheduler.TaskSchedulerImpl - parentName: , name: TaskSet_0.0, runningTasks: 0

10:09:42.315 [Timer-0] WARN org.apache.spark.scheduler.TaskSchedulerImpl - Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

10:09:42.902 [dispatcher-event-loop-5] DEBUG org.apache.spark.scheduler.TaskSchedulerImpl - parentName: , name: TaskSet_0.0, runningTasks: 0

10:09:43.573 [dispatcher-event-loop-6] INFO org.apache.spark.deploy.client.StandaloneAppClient$ClientEndpoint - Executor updated: app-20200305100612-0039/85 is now EXITED (Command exited with code 1)

10:09:43.573 [dispatcher-event-loop-6] INFO org.apache.spark.scheduler.cluster.StandaloneSchedulerBackend - Executor app-20200305100612-0039/85 removed: Command exited with code 1

10:09:43.573 [dispatcher-event-loop-6] DEBUG org.apache.spark.scheduler.cluster.CoarseGrainedSchedulerBackend$DriverEndpoint - Asked to remove executor 85 with reason Command exited with code 1

10:09:43.573 [dispatcher-event-loop-6] INFO org.apache.spark.storage.BlockManagerMaster - Removal of executor 85 requested

10:09:43.573 [dispatcher-event-loop-6] INFO org.apache.spark.scheduler.cluster.CoarseGrainedSchedulerBackend$DriverEndpoint - Asked to remove non-existent executor 85

10:09:43.573 [dispatcher-event-loop-6] INFO org.apache.spark.storage.BlockManagerMasterEndpoint - Trying to remove executor 85 from BlockManagerMaster.

10:09:43.575 [dispatcher-event-loop-1] INFO org.apache.spark.deploy.client.StandaloneAppClient$ClientEndpoint - Executor added: app-20200305100612-0039/86 on worker-20200304161428-172.17.0.14-39162 (172.17.0.14:39162) with 2 core(s)

10:09:43.575 [dispatcher-event-loop-1] INFO org.apache.spark.scheduler.cluster.StandaloneSchedulerBackend - Granted executor ID app-20200305100612-0039/86 on hostPort 172.17.0.14:39162 with 2 core(s), 1024.0 MB RAM

10:09:43.583 [dispatcher-event-loop-2] INFO org.apache.spark.deploy.client.StandaloneAppClient$ClientEndpoint - Executor updated: app-20200305100612-0039/86 is now RUNNING

10:09:43.902 [dispatcher-event-loop-7] DEBUG org.apache.spark.scheduler.TaskSchedulerImpl - parentName: , name: TaskSet_0.0, runningTasks: 0

10:09:44.901 [dispatcher-event-loop-3] DEBUG org.apache.spark.scheduler.TaskSchedulerImpl - parentName: , name: TaskSet_0.0, runningTasks: 0

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值