hive on tez java.lang.NumberFormatException: For input string: “30s“

不搬砖的程序员不是好程序员

已于 2022-09-02 11:20:19 修改

阅读量1.1k

点赞数

文章标签： hive

于 2022-09-02 11:10:45 首次发布

本文链接：https://blog.csdn.net/weixin_38751513/article/details/126658704

版权

2022-09-02 11:01:03,983 [INFO] [main] |app.DAGAppMaster|: Creating DAGAppMaster for applicationId=application_1658852014961_0068, attemptNum=1, AMContainerId=container_1658852014961_0068_01_000001, jvmPid=8152, userFromEnv=ucmed, cliSessionOption=true, pwd=/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001, localDirs=/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068, logDirs=/usr/local/src/hadoop/hadoop-3.3.1/logs/userlogs/application_1658852014961_0068/container_1658852014961_0068_01_000001
2022-09-02 11:01:04,417 [INFO] [main] |app.DAGAppMaster|: Created DAGAppMaster for application appattempt_1658852014961_0068_000001, versionInfo=[ component=tez-dag, version=0.9.2, revision=10cb3519bd34389210e6511a2ba291b52dcda081, SCM-URL=scm:git:https://gitbox.apache.org/repos/asf/tez.git, buildTime=2019-03-19T20:51:15Z ]
2022-09-02 11:01:04,457 [INFO] [main] |app.DAGAppMaster|: 
/************************************************************
[system properties]
os.name: Linux
os.version: 3.10.0-514.el7.x86_64
java.home: /usr/local/src/jdk/jdk1.8.0_311/jre
java.runtime.version: 1.8.0_311-b11
java.vendor: Oracle Corporation
java.version: 1.8.0_311
java.vm.name: Java HotSpot(TM) 64-Bit Server VM
java.class.path: /opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/hive-exec-3.1.2-50b0545693ae9392559584116a172ee32922e57ae9ea0eb7dc120290c217c2d5.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/hadoop-shim-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-api-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-build-tools-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-common-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-runtime-internals-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-runtime-library-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-mapreduce-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-examples-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-dag-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-tests-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-ext-service-tests-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-protobuf-history-plugin-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-yarn-timeline-history-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-yarn-timeline-history-with-acls-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-history-parser-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-job-analyzer-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/tez-javadoc-tools-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/hadoop-shim-2.7-0.9.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/slf4j-api-1.7.10.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-yarn-api-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-lang-2.6.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/guava-11.0.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jsr305-3.0.0.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-logging-1.1.3.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/protobuf-java-2.5.0.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-common-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-annotations-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-cli-1.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-math3-3.1.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/xmlenc-0.52.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-codec-1.4.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-io-2.4.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-net-3.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-collections-3.2.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jersey-json-1.9.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jettison-1.3.4.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jaxb-impl-2.2.3-1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jaxb-api-2.2.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/stax-api-1.0-2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/activation-1.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jackson-core-asl-1.9.13.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jackson-mapper-asl-1.9.13.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jackson-jaxrs-1.9.13.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jackson-xc-1.9.13.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/log4j-1.2.17.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-configuration-1.6.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-digester-1.8.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-beanutils-1.7.0.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-beanutils-core-1.8.0.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/slf4j-log4j12-1.7.10.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/avro-1.7.4.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/paranamer-2.3.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/snappy-java-1.0.4.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-compress-1.4.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/xz-1.0.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/gson-2.2.4.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-auth-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/httpclient-4.2.5.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/httpcore-4.2.4.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/apacheds-i18n-2.0.0-M15.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/api-asn1-api-1.0.0-M20.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/api-util-1.0.0-M20.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/zookeeper-3.4.6.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/netty-3.6.2.Final.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/curator-framework-2.7.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/curator-client-2.7.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/curator-recipes-2.7.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/htrace-core-3.1.0-incubating.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/stax-api-1.0.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-yarn-common-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/servlet-api-2.5.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jetty-util-6.1.26.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jersey-core-1.9.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jersey-client-1.9.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/guice-servlet-3.0.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/guice-3.0.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/javax.inject-1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/aopalliance-1.0.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jersey-guice-1.9.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-yarn-client-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/commons-collections4-4.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jetty-6.1.26.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/netty-all-4.0.23.Final.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/xercesImpl-2.9.1.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/xml-apis-1.3.04.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/leveldbjni-all-1.8.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-hdfs-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/RoaringBitmap-0.5.21.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/async-http-client-1.8.16.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-mapreduce-client-core-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-mapreduce-client-common-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-yarn-server-web-proxy-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/hadoop-yarn-server-common-2.7.2.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jetty-server-9.3.24.v20180605.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/javax.servlet-api-3.1.0.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jetty-http-9.3.24.v20180605.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jetty-util-9.3.24.v20180605.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/jetty-io-9.3.24.v20180605.jar:/opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tezlib/lib/metrics-core-3.1.0.jar:
java.io.tmpdir: /opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001/tmp
user.dir: /opt/hdfs/data/nm-local-dir/usercache/ucmed/appcache/application_1658852014961_0068/container_1658852014961_0068_01_000001
user.name: ucmed
************************************************************/
2022-09-02 11:01:04,483 [INFO] [main] |shim.HadoopShimsLoader|: Trying to locate HadoopShimProvider for hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2022-09-02 11:01:04,484 [INFO] [main] |shim.HadoopShimsLoader|: Picked HadoopShim org.apache.tez.hadoop.shim.HadoopShim27, providerName=org.apache.tez.hadoop.shim.HadoopShim25_26_27Provider, overrideProviderViaConfig=null, hadoopVersion=2.7.2, majorVersion=2, minorVersion=7
2022-09-02 11:01:04,508 [INFO] [main] |app.DAGAppMaster|: AM Level configured TaskSchedulers: [0:TezYarn:null],[1:TezUber:null]
2022-09-02 11:01:04,508 [INFO] [main] |app.DAGAppMaster|: AM Level configured ContainerLaunchers: [0:TezYarn:null],[1:TezUber:null]
2022-09-02 11:01:04,508 [INFO] [main] |app.DAGAppMaster|: AM Level configured TaskCommunicators: [0:TezYarn:null],[1:TezUber:null]
2022-09-02 11:01:04,508 [INFO] [main] |app.DAGAppMaster|: Comparing client version with AM version, clientVersion=0.9.2, AMVersion=0.9.2
2022-09-02 11:01:04,602 [INFO] [main] |service.AbstractService|: Service org.apache.tez.dag.app.DAGAppMaster failed in state INITED; cause: java.lang.NumberFormatException: For input string: "30s"
java.lang.NumberFormatException: For input string: "30s"
	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
	at java.lang.Long.parseLong(Long.java:589)
	at java.lang.Long.parseLong(Long.java:631)
	at org.apache.hadoop.conf.Configuration.getLong(Configuration.java:1311)
	at org.apache.hadoop.hdfs.DFSClient$Conf.<init>(DFSClient.java:502)
	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:638)
	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
	at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653)
	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92)
	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)
	at org.apache.tez.common.TezCommonUtils.getTezBaseStagingPath(TezCommonUtils.java:87)
	at org.apache.tez.common.TezCommonUtils.getTezSystemStagingPath(TezCommonUtils.java:146)
	at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:492)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2662)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2659)
	at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2464)
2022-09-02 11:01:04,606 [WARN] [main] |service.AbstractService|: When stopping the service org.apache.tez.dag.app.DAGAppMaster : java.lang.NullPointerException
java.lang.NullPointerException
	at org.apache.tez.dag.app.DAGAppMaster.initiateStop(DAGAppMaster.java:2179)
	at org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2195)
	at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
	at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
	at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:171)
	at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2662)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2659)
	at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2464)
2022-09-02 11:01:04,606 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster
java.lang.NumberFormatException: For input string: "30s"
	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
	at java.lang.Long.parseLong(Long.java:589)
	at java.lang.Long.parseLong(Long.java:631)
	at org.apache.hadoop.conf.Configuration.getLong(Configuration.java:1311)
	at org.apache.hadoop.hdfs.DFSClient$Conf.<init>(DFSClient.java:502)
	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:638)
	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
	at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653)
	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92)
	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)
	at org.apache.tez.common.TezCommonUtils.getTezBaseStagingPath(TezCommonUtils.java:87)
	at org.apache.tez.common.TezCommonUtils.getTezSystemStagingPath(TezCommonUtils.java:146)
	at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:492)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2662)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2659)
	at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2464)
2022-09-02 11:01:04,608 [INFO] [Thread-2] |app.DAGAppMaster|: DAGAppMasterShutdownHook invoked

错误日志如图

所用版本为:

hadoop 3.3.1

hive 3.1.2

tez 0.9.2

解决方案如下

在hdfs-site.xml中新增配置

<property>
    <name>dfs.client.datanode-restart.timeout</name>
    <value>30</value>
</property>

问题解决

原因为Hadoop2和Hadoop3的兼容性问题