报错

最新推荐文章于 2021-09-11 15:11:33 发布
最新推荐文章于 2021-09-11 15:11:33 发布
阅读量4.3k 收藏 1
点赞数
分类专栏： 报错 文章标签： 大数据
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/m0_44946672/article/details/107283512
版权

一路上的报错

hadoop中的报错

mismatch

报错如下：

INFO mapreduce.Job：Task Id：attempt_1589445736284_0017_m_000000_0, Status ： FAILED
Error: java.io.IOException：Type mismatch in key from map：expected org.apache.hadoop.io.Text, received org.example.sort2.FlowBean
	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1074)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java：715)
	at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java：89)
	at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java：112)
	at org.example.sort2.FlowCountSort$FlowCountSortMapper.map(FlowCountSort.java：37)
	at org.example.sort2.FlowCountSort$FlowCountSortMapper.map(FlowCountSort.java：18)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java：146)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java：787)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java：341)
	at org.apache.hadoop.mapred．YarnChild$2.run(YarnChild.java：164)
	at java.security.AccessControIIer.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java：422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java：1758)
	at org.apache.hadoop.mapred．YarnChild.main(YarnChild.java:158)

解析:想要一个Text却给了一个FlowBean，类型不匹配，输出类型不对
解决办法：修改代码中的输出类型

spark中的报错

JAVA_HOME is not set

hrbu30: failed to launch: nice -n 0 /opt/wdp/spark/bin/spark-class org.apache.spark.deploy.worker.Worker --webui-port 8081 spark://hrbu30: 7077
hrbu30 :JAVA HOME is not set
hrbu30: full log in /opt/wdp/spark/logs/spark-hadoop-org.apache.spark,deploy.worker.Worker-1-hrbu30.out
hrbu31: failed to launch: nice -n 0 /opt/wdp/spark/bin/spark-class org.apache.spark.deploy.worker.Worker --webui-port 8081 spark://hrbu30: 7077
hrbu31 :JAVA HOME is not set
hrbu31: full log in /opt/wdp/spark/logs/ spark-hadoop-org.apache.spark.deploy.worker.Worker-1-hrbu31. out
hrbu32: failed to launch: nice -n 0 /opt/wdp/ spark/bin/spark-class org.apache.spark.deploy.worker.Worker --webui-port 8081 spark:/ /hrbu30: 7077
hrbu32:JAVA HOME is not set
hrbu32: full log in /opt/wdp/spark/logs/spark-hadoop-org.apache.spark.deploy worker.Worker-1-hrbu32. out

解析：遇到 “JAVA_HOME not set” 异常
解决办法：在spark的sbin目录下的spark-config.sh 文件中加入如下配置：

export JAVA_HOME=XXXX

我的jdk在/opt/wdp/jdk下，所以应该配置为

export JAVA_HOME=/opt/wdp/jdk

UnknownHostException:mycluster

scala> sc.textFile("hdfs://mycluster/data/wc.txt").flatMap(_.split(" ")).map((_,1)).reduceByKey(_+_).collect
java.lang.IllegalArgumentException: java.net.UnknownHostException:mycluster
	at eorg.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:378)
	at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:310)
	at org apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:176)
	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:678)
	at org.apache.hadoop.hdfs.DFSclient.<init>(DFSClient.java:619)
	at org.apache.hadoop.hdfs.DistributedFileSystem.initialize (DistributedFileSystem.java:149)at org.apache.hadoop.fs.FileSystem.CreateFileSystem(FileSysem.java: 2669)

解析：不认识自己配置的双namenode名字（mycluster）
解决办法：将配置双namenode的ha中的core-site.xml、hdfs-site.xml复制一份到/opt/wdp/spark/conf/中
配置如下：

cd /opt/ha/hadoop/etc/hadoop
[hadoop@hrbu30 hadoop]$ cp core-site.xml /opt/wdp/spark/conf/
[hadoop@hrbu30 hadoop]$ cp hdfs-site.xml /opt/wdp/spark/conf/

Master must either be yarn or start with spark, mesos, k8s, or local

[hadoop@hrbu30 spark]$ bin/spark-submit \
> --class org.apache.spark.examples.SparkPi \
> --master yarn\
> --deploy-mode client \
> ./examples/jars/spark-examples_2.11-2.4.6.jar \
> 100

报错如下：

Exception in thread "main" org.apache.spark.SparkException: Master must either be yarn or start with spark, mesos, k8s, or local
	at org.apache.spark.deploy.SparkSubmit.error(SparkSubmit.scala:853)
	at org.apache.spark.deploy.SparkSubmit.prepareSubmitEnvironment(SparkSubmit.scala:223)
	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:774)
	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

解析：第三行–master yarn\的yarn和\之间少一个空格
解决办法：添加上空格即可

2.2 GB of 2.1 GB virtual memory used

[hadoop@hrbu30 spark]$ bin/spark-submit \
> --class org.apache.spark.examples.SparkPi \
> --master yarn \
> --deploy-mode client \
> ./examples/jars/spark-examples_2.11-2.4.6.jar \
> 100
20/06/20 07:30:22 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
20/06/20 07:30:22 INFO spark.SparkContext: Running Spark version 2.4.6
20/06/20 07:30:22 INFO spark.SparkContext: Submitted application: Spark Pi
20/06/20 07:30:22 INFO spark.SecurityManager: Changing view acls to: hadoop
20/06/20 07:30:22 INFO spark.SecurityManager: Changing modify acls to: hadoop
20/06/20 07:30:22 INFO spark.SecurityManager: Changing view acls groups to: 
20/06/20 07:30:22 INFO spark.SecurityManager: Changing modify acls groups to: 
20/06/20 07:30:22 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(hadoop); groups with view permissions: Set(); users  with modify permissions: Set(hadoop); groups with modify permissions: Set()
20/06/20 07:30:23 INFO util.Utils: Successfully started service 'sparkDriver' on port 47931.
20/06/20 07:30:23 INFO spark.SparkEnv: Registering MapOutputTracker
20/06/20 07:30:23 INFO spark.SparkEnv: Registering BlockManagerMaster
20/06/20 07:30:23 INFO storage.BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
20/06/20 07:30:23 INFO storage.BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
20/06/20 07:30:23 INFO storage.DiskBlockManager: Created local directory at /tmp/blockmgr-eb43ff83-f5d4-4eaa-8eff-7d25116dda55
20/06/20 07:30:23 INFO memory.MemoryStore: MemoryStore started with capacity 366.3 MB
20/06/20 07:30:23 INFO spark.SparkEnv: Registering OutputCommitCoordinator
20/06/20 07:30:23 INFO util.log: Logging initialized @3332ms
20/06/20 07:30:23 INFO server.Server: jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
20/06/20 07:30:23 INFO server.Server: Started @3476ms
20/06/20 07:30:23 WARN util.Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
20/06/20 07:30:23 INFO server.AbstractConnector: Started ServerConnector@2ba5e810{HTTP/1.1,[http/1.1]}{0.0.0.0:4041}
20/06/20 07:30:23 INFO util.Utils: Successfully started service 'SparkUI' on port 4041.
20/06/20 07:30:23 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1db0ec27{/jobs,null,AVAILABLE,@Spark}
20/06/20 07:30:23 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@50cf5a23{/jobs/json,null,AVAILABLE,@Spark}
20/06/20 07:30:23 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@450794b4{/jobs/job,null,AVAILABLE,@Spark}
20/06/20 07:30:23 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@30457e14{/jobs/job/json,null,AVAILABLE,@Spark}
20/06/20 07:30:23 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1af1347d{/stages,null,AVAILABLE,@Spark}
20/06/20 07:30:23 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@632aa1a3{/stages/json,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@20765ed5{/stages/stage,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1e8823d2{/stages/stage/json,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@c1a4620{/stages/pool,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@76b0ae1b{/stages/pool/json,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@130a0f66{/storage,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4c432866{/storage/json,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@12365c88{/storage/rdd,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6105f8a3{/storage/rdd/json,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2237bada{/environment,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@77e2a6e2{/environment/json,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5710768a{/executors,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@199e4c2b{/executors/json,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6e0d4a8{/executors/threadDump,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@64d7b720{/executors/threadDump/json,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@30272916{/static,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@74518890{/,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4c5204af{/api,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@30865a90{/jobs/job/kill,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6134ac4a{/stages/stage/kill,null,AVAILABLE,@Spark}
20/06/20 07:30:24 INFO ui.SparkUI: Bound SparkUI to 0.0.0.0, and started at http://hrbu30:4041
20/06/20 07:30:24 INFO spark.SparkContext: Added JAR file:/opt/wdp/spark/./examples/jars/spark-examples_2.11-2.4.6.jar at spark://hrbu30:47931/jars/spark-examples_2.11-2.4.6.jar with timestamp 1592609424167
20/06/20 07:30:41 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
20/06/20 07:30:41 INFO yarn.Client: Requesting a new application from cluster with 3 NodeManagers
20/06/20 07:30:41 INFO yarn.Client: Verifying our application has not requested more than the maximum memory capability of the cluster (8192 MB per container)
20/06/20 07:30:41 INFO yarn.Client: Will allocate AM container, with 896 MB memory including 384 MB overhead
20/06/20 07:30:41 INFO yarn.Client: Setting up container launch context for our AM
20/06/20 07:30:41 INFO yarn.Client: Setting up the launch environment for our AM container
20/06/20 07:30:41 INFO yarn.Client: Preparing resources for our AM container
20/06/20 07:30:41 WARN yarn.Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
20/06/20 07:30:44 INFO yarn.Client: Uploading resource file:/tmp/spark-52b70399-9b17-4eba-b7c8-516af721bab2/__spark_libs__7835543021843581423.zip -> hdfs://mycluster/user/hadoop/.sparkStaging/application_1592460818872_0003/__spark_libs__7835543021843581423.zip
20/06/20 07:30:50 INFO yarn.Client: Uploading resource file:/tmp/spark-52b70399-9b17-4eba-b7c8-516af721bab2/__spark_conf__8681154760836187739.zip -> hdfs://mycluster/user/hadoop/.sparkStaging/application_1592460818872_0003/__spark_conf__.zip
20/06/20 07:30:50 INFO spark.SecurityManager: Changing view acls to: hadoop
20/06/20 07:30:50 INFO spark.SecurityManager: Changing modify acls to: hadoop
20/06/20 07:30:50 INFO spark.SecurityManager: Changing view acls groups to: 
20/06/20 07:30:50 INFO spark.SecurityManager: Changing modify acls groups to: 
20/06/20 07:30:50 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(hadoop); groups with view permissions: Set(); users  with modify permissions: Set(hadoop); groups with modify permissions: Set()
20/06/20 07:30:51 INFO yarn.Client: Submitting application application_1592460818872_0003 to ResourceManager
20/06/20 07:30:52 INFO impl.YarnClientImpl: Submitted application application_1592460818872_0003
20/06/20 07:30:52 INFO cluster.SchedulerExtensionServices: Starting Yarn extension services with app application_1592460818872_0003 and attemptId None
20/06/20 07:30:53 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:30:53 INFO yarn.Client: 
	 client token: N/A
	 diagnostics: N/A
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: default
	 start time: 1592609546684
	 final status: UNDEFINED
	 tracking URL: http://hrbu31:8088/proxy/application_1592460818872_0003/
	 user: hadoop
20/06/20 07:30:54 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:30:55 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:30:56 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:30:57 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:30:58 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:30:59 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:00 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:01 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:02 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:03 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:04 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:05 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:06 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:07 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:08 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:09 INFO yarn.Client: Application report for application_1592460818872_0003 (state: ACCEPTED)
20/06/20 07:31:10 INFO yarn.Client: Application report for application_1592460818872_0003 (state: FAILED)
20/06/20 07:31:10 INFO yarn.Client: 
	 client token: N/A
	 diagnostics: Application application_1592460818872_0003 failed 2 times due to AM Container for appattempt_1592460818872_0003_000002 exited with  exitCode: -103
For more detailed output, check application tracking page:http://hrbu31:8088/cluster/app/application_1592460818872_0003Then, click on links to logs of each attempt.
Diagnostics: Container [pid=64506,containerID=container_e13_1592460818872_0003_02_000001] is running beyond virtual memory limits. Current usage: 71.6 MB of 1 GB physical memory used; 2.2 GB of 2.1 GB virtual memory used. Killing container.
Dump of the process-tree for container_e13_1592460818872_0003_02_000001 :
	|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
	|- 64510 64506 64506 64506 (java) 167 80 2268135424 18008 /opt/wdp/jdk//bin/java -server -Xmx512m -Djava.io.tmpdir=/opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/tmp -Dspark.yarn.app.container.log.dir=/opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001 org.apache.spark.deploy.yarn.ExecutorLauncher --arg hrbu30:47931 --properties-file /opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/__spark_conf__/__spark_conf__.properties 
	|- 64506 64504 64506 64506 (bash) 0 0 108609536 333 /bin/bash -c /opt/wdp/jdk//bin/java -server -Xmx512m -Djava.io.tmpdir=/opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/tmp -Dspark.yarn.app.container.log.dir=/opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001 org.apache.spark.deploy.yarn.ExecutorLauncher --arg 'hrbu30:47931' --properties-file /opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/__spark_conf__/__spark_conf__.properties 1> /opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/stdout 2> /opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/stderr 

Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
Failing this attempt. Failing the application.
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: default
	 start time: 1592609546684
	 final status: FAILED
	 tracking URL: http://hrbu31:8088/cluster/app/application_1592460818872_0003
	 user: hadoop
20/06/20 07:31:10 INFO yarn.Client: Deleted staging directory hdfs://mycluster/user/hadoop/.sparkStaging/application_1592460818872_0003
20/06/20 07:31:10 ERROR cluster.YarnClientSchedulerBackend: The YARN application has already ended! It might have been killed or the Application Master may have failed to start. Check the YARN application logs for more details.
20/06/20 07:31:10 ERROR spark.SparkContext: Error initializing SparkContext.
org.apache.spark.SparkException: Application application_1592460818872_0003 failed 2 times due to AM Container for appattempt_1592460818872_0003_000002 exited with  exitCode: -103
For more detailed output, check application tracking page:http://hrbu31:8088/cluster/app/application_1592460818872_0003Then, click on links to logs of each attempt.
Diagnostics: Container [pid=64506,containerID=container_e13_1592460818872_0003_02_000001] is running beyond virtual memory limits. Current usage: 71.6 MB of 1 GB physical memory used; 2.2 GB of 2.1 GB virtual memory used. Killing container.
Dump of the process-tree for container_e13_1592460818872_0003_02_000001 :
	|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
	|- 64510 64506 64506 64506 (java) 167 80 2268135424 18008 /opt/wdp/jdk//bin/java -server -Xmx512m -Djava.io.tmpdir=/opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/tmp -Dspark.yarn.app.container.log.dir=/opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001 org.apache.spark.deploy.yarn.ExecutorLauncher --arg hrbu30:47931 --properties-file /opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/__spark_conf__/__spark_conf__.properties 
	|- 64506 64504 64506 64506 (bash) 0 0 108609536 333 /bin/bash -c /opt/wdp/jdk//bin/java -server -Xmx512m -Djava.io.tmpdir=/opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/tmp -Dspark.yarn.app.container.log.dir=/opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001 org.apache.spark.deploy.yarn.ExecutorLauncher --arg 'hrbu30:47931' --properties-file /opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/__spark_conf__/__spark_conf__.properties 1> /opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/stdout 2> /opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/stderr 

Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
Failing this attempt. Failing the application.
	at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.waitForApplication(YarnClientSchedulerBackend.scala:94)
	at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:63)
	at org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:188)
	at org.apache.spark.SparkContext.<init>(SparkContext.scala:501)
	at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
	at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:930)
	at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:921)
	at scala.Option.getOrElse(Option.scala:121)
	at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:921)
	at org.apache.spark.examples.SparkPi$.main(SparkPi.scala:31)
	at org.apache.spark.examples.SparkPi.main(SparkPi.scala)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
20/06/20 07:31:10 INFO server.AbstractConnector: Stopped Spark@2ba5e810{HTTP/1.1,[http/1.1]}{0.0.0.0:4041}
20/06/20 07:31:10 INFO ui.SparkUI: Stopped Spark web UI at http://hrbu30:4041
20/06/20 07:31:10 WARN cluster.YarnSchedulerBackend$YarnSchedulerEndpoint: Attempted to request executors before the AM has registered!
20/06/20 07:31:10 INFO cluster.YarnClientSchedulerBackend: Shutting down all executors
20/06/20 07:31:10 INFO cluster.YarnSchedulerBackend$YarnDriverEndpoint: Asking each executor to shut down
20/06/20 07:31:10 INFO cluster.SchedulerExtensionServices: Stopping SchedulerExtensionServices
(serviceOption=None,
 services=List(),
 started=false)
20/06/20 07:31:10 INFO cluster.YarnClientSchedulerBackend: Stopped
20/06/20 07:31:10 INFO spark.MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
20/06/20 07:31:10 INFO memory.MemoryStore: MemoryStore cleared
20/06/20 07:31:10 INFO storage.BlockManager: BlockManager stopped
20/06/20 07:31:10 INFO storage.BlockManagerMaster: BlockManagerMaster stopped
20/06/20 07:31:10 WARN metrics.MetricsSystem: Stopping a MetricsSystem that is not running
20/06/20 07:31:10 INFO scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
20/06/20 07:31:10 INFO spark.SparkContext: Successfully stopped SparkContext
Exception in thread "main" org.apache.spark.SparkException: Application application_1592460818872_0003 failed 2 times due to AM Container for appattempt_1592460818872_0003_000002 exited with  exitCode: -103
For more detailed output, check application tracking page:http://hrbu31:8088/cluster/app/application_1592460818872_0003Then, click on links to logs of each attempt.
Diagnostics: Container [pid=64506,containerID=container_e13_1592460818872_0003_02_000001] is running beyond virtual memory limits. Current usage: 71.6 MB of 1 GB physical memory used; 2.2 GB of 2.1 GB virtual memory used. Killing container.
Dump of the process-tree for container_e13_1592460818872_0003_02_000001 :
	|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
	|- 64510 64506 64506 64506 (java) 167 80 2268135424 18008 /opt/wdp/jdk//bin/java -server -Xmx512m -Djava.io.tmpdir=/opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/tmp -Dspark.yarn.app.container.log.dir=/opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001 org.apache.spark.deploy.yarn.ExecutorLauncher --arg hrbu30:47931 --properties-file /opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/__spark_conf__/__spark_conf__.properties 
	|- 64506 64504 64506 64506 (bash) 0 0 108609536 333 /bin/bash -c /opt/wdp/jdk//bin/java -server -Xmx512m -Djava.io.tmpdir=/opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/tmp -Dspark.yarn.app.container.log.dir=/opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001 org.apache.spark.deploy.yarn.ExecutorLauncher --arg 'hrbu30:47931' --properties-file /opt/ha/hadoop/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/__spark_conf__/__spark_conf__.properties 1> /opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/stdout 2> /opt/ha/hadoop/logs/userlogs/application_1592460818872_0003/container_e13_1592460818872_0003_02_000001/stderr 

Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
Failing this attempt. Failing the application.
	at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.waitForApplication(YarnClientSchedulerBackend.scala:94)
	at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:63)
	at org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:188)
	at org.apache.spark.SparkContext.<init>(SparkContext.scala:501)
	at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
	at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:930)
	at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:921)
	at scala.Option.getOrElse(Option.scala:121)
	at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:921)
	at org.apache.spark.examples.SparkPi$.main(SparkPi.scala:31)
	at org.apache.spark.examples.SparkPi.main(SparkPi.scala)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
20/06/20 07:31:10 INFO util.ShutdownHookManager: Shutdown hook called
20/06/20 07:31:10 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-52b70399-9b17-4eba-b7c8-516af721bab2
20/06/20 07:31:10 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-71dff535-325e-4d42-8272-e95cab4730ae

解析：不是内存不够的问题，是yarn的检查机制没关，（修改过hadoop配置文件yarn-site.xml,添加内容后未重新启动yarn）
解决办法：
1）如果没有修改过hadoop配置文件yarn-site.xml：
（1）修改hadoop配置文件yarn-site.xml,添加如下内容：

[hadoop@hrbu30 hadoop]$ vi yarn-site.xml

添加

        <!--是否启动一个线程检查每个任务正使用的物理内存量，如果任务超出分配值，则直接将其杀掉，默认是true -->
        <property>
                <name>yarn.nodemanager.pmem-check-enabled</name>
                <value>false</value>
        </property>
        <!--是否启动一个线程检查每个任务正使用的虚拟内存量，如果任务超出分配值，则直接将其杀掉，默认是true -->
        <property>
                <name>yarn.nodemanager.vmem-check-enabled</name>
                <value>false</value>
        </property>

2）如果修改过hadoop配置文件yarn-site.xml：
（1）重启yarn，代码如下：

[hadoop@hrbu30 hadoop]$ stop-yarn.sh

[hadoop@hrbu30 hadoop]$ start-yarn.sh
喜欢到处游荡的家伙
关注
  • 0
    点赞
  • 踩
  • 1
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
专栏目录
exception in thread main org.apache.spark.sparkexception:A master URL must be set in your
gongxuan92的专栏
10-31 3559
传递给spark的master url可以有如下几种： local 本地单线程 local[K] 本地多线程（指定K个内核） local[*] 本地多线程（指定所有可用内核） spark://HOST:PORT 连接到指定的 Spark standalone cluster master，需要指定端口。 mesos://HOST:PORT 连接到指定的 Mesos 集群，需要指定
org.apache.spark.SparkException: A master URL must be set in your configuration
weixin_43562234的博客
03-28 688
以下方法亲测有效！！！ 在运行spark的测试程序SparkPi时，点击运行，出现了如下错误： Exception in thread “main” org.apache.spark.SparkException: A master URL must be set in your configuration at org.apache.spark.SparkContext.(SparkContex...
大数据常见错误（持续更新中）
Demon的博客
04-10 1017
1、Exception in thread "main" org.apache.spark.SparkException: Only one SparkContext may be running in this JVM (see SPARK-2243). To ignore this error, set spark.driver.allowMultipleContexts = true. Th...
Spark on Yarn 提交流程源码解析
qq_24186017的博客
09-11 688
源码版本：spark-3.1.2 spark提交命令 bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn ./examples/jars/spark-examples_2.12-3.1.2.jar 10 进入到spark-submit 可以程序入口类SparkSubmit if [ -z "${SPARK_HOME}" ]; then source "$(dirname "$0")"/..
idea中使用scala运行spark出现Exception in thread "main" java.lang.NoClassDefFoundError: scala/collection/Gen...
dddp75921的博客
01-20 1081
idea中使用scala运行spark出现： 　　 Exception in thread "main" java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class 查看build.sbt: 　　 name := "ScalaSBT" version := "1....
android @override 报错解决方案
09-05
android @override 报错:就是说Java 1.5的编译器默认对父类的方法进行覆盖，采用@Override进行说明；但1.6已经扩展到对接口的方法；所以如果还是以Java 1.5的编译器来编译的话，会出现错误
解决maven启动Spring项目报错的问题
08-28
解决 Maven 启动 Spring 项目报错的问题 Maven 是一个流行的 Java 项目管理和构建工具，而 Spring 是一个广泛使用的 Java 框架。然而，在使用 Maven 启动 Spring 项目时，可能会遇到一些报错的问题。今天，我们将...
linux 环境 mysql写入中文报错
09-15
本篇文章主要介绍了linux 环境 mysql写入中文报错的相关知识。具有很好的参考价值。下面跟着小编一起来看下吧
Spring Cloud Feign报错问题解决
08-25
"Spring Cloud Feign报错问题解决" Spring Cloud Feign是一个基于HTTP的声明式服务调用接口，通过使用Feign可以将服务调用封装成一个接口，使得服务调用变得更加简洁和高效。在实际开发中，可能会遇到一些报错问题...
php 启动时报错的简单解决方法
10-26
php启动时报错的情况，想必很多朋友都有遇到吧，下面为大家介绍下比较不错的解决方法
java Scala thread,idea中使用scala运行spark出现Exception in thread "main" java.lang.NoClassDefFoundError: sc...
weixin_36172296的博客
03-11 311
idea中使用scala运行spark出现：Exception in thread "main" java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class查看build.sbt:name := "ScalaSBT"version := "1.0"scalaVersion := "2.11.8"libraryD...
CDH SparkOnYarn执行中executor内存限制问题
YZJ8819的博客
03-08 996
因为配置了spark如下参数，启动spark-shell报错 export SPARK_WORKER_CORES=5 export SPARK_WORKER_INSTANCES=4 export SPARK_WORKER_MEMORY=50G export SPARK_WORKER_WEBUI_PORT=8081 export SPARK_EXECUTOR_CORES=2 ...
spark on yarn 配置及异常解决
主要分享大数据相关的知识，如Spark、Hudi
05-08 1065
转载请务必注明原创地址为：http://dongkelun.com/2018/04/16/sparkOnYarnConf/ 前言 YARN 是在Hadoop 2.0 中引入的集群管理器，它可以让多种数据处理框架运行在一个共享的资源池上，并且通常安装在与Hadoop 文件系统（简称HDFS）相同的物理节点上。在这样配置的YARN 集群上运行Spark 是很有意义的，它可以让Spark 在存储数据...
spark学习-35-Spark的Map任务输出跟踪器MapOutputTracker
九师兄
11-22 4481
1。在sparkEnv的初始化中有这样一段代码来初始化Map任务输出跟踪器MapOutputTracker　　　mapOutputTracker用于跟踪map阶段任务的输出状态，此状态便于reduce阶段任务获取地址以及中间输出结果。每个map任务或者 reduce任务都会有唯一的标识。分别为mapId和reduceId.每个reduce任务的输入可能是多个map任务的输出，reduce会到各个ma
Spark任务输出追踪器MapOutputTracker详解
SmallCatBaby的博客
07-01 928
一.什么是shuffle MapOutputTrancker用于跟踪map任务的输出状态，此状态便于reduce任务定位到map输出结果所在的节点地址，进而获取中间输出结果，每个map任务或者reduce任务，都会有其唯一的标识，分别为mapid和reduceid，每个reduce任务的输入可能是多个map任务的输出，因为reduce可能会到多个map任务...
spark用submit提交程序遇到的错误（机器内存较小）
热门推荐
season的专栏
04-23 1万+
部署使用的spark版本是spark1.3.0部署环境： 主节点centos7操作系统 2g内存   从节点debian系统1g内存（2个） spark-env.sh的设置如下： export SCALA_HOME=/usr/local/scala-2.10.4 export SPARK_MASTER_IP=master export SPARK_LOCAL_IP=master
SPARK常见报错
innersense的专栏
04-28 1213
在driver端报： [2020-04-28 10:55:16][main]-[ERROR][org.apache.spark.internal.Logging$class.logError(Logging.scala:91)] Error initializing SparkContext. org.apache.spark.SparkException: Yarn applicatio...
MnltipartFile报错
最新发布
09-10
MultipartFile报错通常是在使用Spring MVC时处理文件上传时遇到的问题。MultipartFile是Spring MVC提供的用于处理文件上传的类。报错可能是由于以下几个原因引起的： 1. 缺少文件上传配置：在Spring MVC中，需要在配置文件中正确配置文件上传的相关属性，如最大文件大小、临时存储路径等。如果没有正确配置这些属性，可能会导致MultipartFile报错。 2. 请求类型错误：文件上传请求应该使用POST方法，而不是GET方法。如果使用了错误的请求方法，MultipartFile可能无法正常获取文件数据，从而导致报错。 3. 请求头缺少"Content-Type"字段：当进行文件上传时，请求头中应包含"Content-Type: multipart/form-data"字段。如果缺少这个字段，Spring MVC可能无法正确解析请求，导致MultipartFile报错。 4. 文件大小超过限制：在配置文件中可以设置最大文件大小限制。如果上传的文件大小超过了这个限制，Spring MVC会抛出异常，导致MultipartFile报错。 如果遇到MultipartFile报错，可以检查以上几个方面是否有问题，并进行相应的调整和修正。

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值