spark
笨笨v猪
爱好:台球
展开
-
idea下通过yarn-client远程调试spark,并从hive中获取数据
1、集群环境: spark2.2.2(独立安装),hadoop3.0.0(CDH搭建) 1、修改windows用户,在本地host,C:\Windows\System32\drivers\etc下host中加入集群节点 192.168.1.180 gw-master 192.168.1.181 gw-slave1 192.168.1.182 gw-sla...原创 2019-04-11 13:46:37 · 1741 阅读 · 1 评论 -
spark-client 一直 accepted,org.apache.spark.SparkException: Failed to connect to driver!
AM Container for appattempt_1555480141477_0003_000002 exited with exitCode: 10 Failing this attempt.Diagnostics: [2019-04-17 14:01:27.662]Exception from container-launch. Container id: container_1555...原创 2019-04-17 14:46:58 · 2917 阅读 · 0 评论