hadoop2.7.7运行程序wordcount出错

最新推荐文章于 2019-12-16 12:05:04 发布
最新推荐文章于 2019-12-16 12:05:04 发布
阅读量956 收藏
点赞数
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qq_41750529/article/details/84779825
版权

/************************************************************
STARTUP_MSG: Starting NodeManager
STARTUP_MSG:   host = slave2/192.168.56.102
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 2.7.7
STARTUP_MSG:   classpath = //usr/local/hadoop/etc/hadoop://usr/local/hadoop/etc/hadoop://usr/local/hadoop/etc/hadoop://usr/local/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar://usr/local/hadoop/share/hadoop/common/lib/activation-1.1.jar://usr/local/hadoop/share/hadoop/common/lib/hadoop-annotations-2.7.7.jar://usr/local/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar://usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar://usr/local/hadoop/share/hadoop/common/lib/xz-1.0.jar://usr/local/hadoop/share/hadoop/common/lib/junit-4.11.jar://usr/local/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar://usr/local/hadoop/share/hadoop/common/lib/stax-api-1.0-2.jar://usr/local/hadoop/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar://usr/local/hadoop/share/hadoop/common/lib/hadoop-auth-2.7.7.jar://usr/local/hadoop/share/hadoop/common/lib/httpclient-4.2.5.jar://usr/local/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar://usr/local/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar://usr/local/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar://usr/local/hadoop/share/hadoop/common/lib/commons-logging-1.1.3.jar://usr/local/hadoop/share/hadoop/common/lib/curator-recipes-2.7.1.jar://usr/local/hadoop/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar://usr/local/hadoop/share/hadoop/common/lib/jersey-json-1.9.jar://usr/local/hadoop/share/hadoop/common/lib/avro-1.7.4.jar://usr/local/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar://usr/local/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar://usr/local/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar://usr/local/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar://usr/local/hadoop/share/hadoop/common/lib/protobuf-java-2.5.0.jar://usr/local/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar://usr/local/hadoop/share/hadoop/common/lib/jackson-xc-1.9.13.jar://usr/local/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.jar://usr/local/hadoop/share/hadoop/common/lib/guava-11.0.2.jar://usr/local/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar://usr/local/hadoop/share/hadoop/common/lib/commons-io-2.4.jar://usr/local/hadoop/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar://usr/local/hadoop/share/hadoop/common/lib/jersey-core-1.9.jar://usr/local/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar://usr/local/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar://usr/local/hadoop/share/hadoop/common/lib/netty-3.6.2.Final.jar://usr/local/hadoop/share/hadoop/common/lib/jetty-6.1.26.jar://usr/local/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar://usr/local/hadoop/share/hadoop/common/lib/jersey-server-1.9.jar://usr/local/hadoop/share/hadoop/common/lib/java-xmlbuilder-0.4.jar://usr/local/hadoop/share/hadoop/common/lib/paranamer-2.3.jar://usr/local/hadoop/share/hadoop/common/lib/zookeeper-3.4.6.jar://usr/local/hadoop/share/hadoop/common/lib/commons-collections-3.2.2.jar://usr/local/hadoop/share/hadoop/common/lib/jettison-1.1.jar://usr/local/hadoop/share/hadoop/common/lib/asm-3.2.jar://usr/local/hadoop/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar://usr/local/hadoop/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar://usr/local/hadoop/share/hadoop/common/lib/hamcrest-core-1.3.jar://usr/local/hadoop/share/hadoop/common/lib/jsch-0.1.54.jar://usr/local/hadoop/share/hadoop/common/lib/api-util-1.0.0-M20.jar://usr/local/hadoop/share/hadoop/common/lib/curator-framework-2.7.1.jar://usr/local/hadoop/share/hadoop/common/lib/commons-net-3.1.jar://usr/local/hadoop/share/hadoop/common/lib/gson-2.2.4.jar://usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar://usr/local/hadoop/share/hadoop/common/lib/jets3t-0.9.0.jar://usr/local/hadoop/share/hadoop/common/lib/commons-lang-2.6.jar://usr/local/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar://usr/local/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar://usr/local/hadoop/share/hadoop/common/lib/commons-math3-3.1.1.jar://usr/local/hadoop/share/hadoop/common/lib/httpcore-4.2.5.jar://usr/local/hadoop/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar://usr/local/hadoop/share/hadoop/common/lib/jsr305-3.0.0.jar://usr/local/hadoop/share/hadoop/common/lib/slf4j-api-1.7.10.jar://usr/local/hadoop/share/hadoop/common/lib/curator-client-2.7.1.jar://usr/local/hadoop/share/hadoop/common/hadoop-common-2.7.7-tests.jar://usr/local/hadoop/share/hadoop/common/hadoop-nfs-2.7.7.jar://usr/local/hadoop/share/hadoop/common/hadoop-common-2.7.7.jar://usr/local/hadoop/share/hadoop/hdfs://usr/local/hadoop/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar://usr/local/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar://usr/local/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar://usr/local/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar://usr/local/hadoop/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar://usr/local/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar://usr/local/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar://usr/local/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar://usr/local/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar://usr/local/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar://usr/local/hadoop/share/hadoop/hdfs/lib/commons-io-2.4.jar://usr/local/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar://usr/local/hadoop/share/hadoop/hdfs/lib/jersey-core-1.9.jar://usr/local/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar://usr/local/hadoop/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar://usr/local/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.jar://usr/local/hadoop/share/hadoop/hdfs/lib/jersey-server-1.9.jar://usr/local/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar://usr/local/hadoop/share/hadoop/hdfs/lib/commons-lang-2.6.jar://usr/local/hadoop/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar://usr/local/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar://usr/local/hadoop/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar://usr/local/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar://usr/local/hadoop/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar://usr/local/hadoop/share/hadoop/hdfs/lib/jsr305-3.0.0.jar://usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.7-tests.jar://usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.7.7.jar://usr/local/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar://usr/local/hadoop/share/hadoop/yarn/lib/activation-1.1.jar://usr/local/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar://usr/local/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar://usr/local/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar://usr/local/hadoop/share/hadoop/yarn/lib/xz-1.0.jar://usr/local/hadoop/share/hadoop/yarn/lib/stax-api-1.0-2.jar://usr/local/hadoop/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar://usr/local/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-logging-1.1.3.jar://usr/local/hadoop/share/hadoop/yarn/lib/jersey-json-1.9.jar://usr/local/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-cli-1.2.jar://usr/local/hadoop/share/hadoop/yarn/lib/servlet-api-2.5.jar://usr/local/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar://usr/local/hadoop/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar://usr/local/hadoop/share/hadoop/yarn/lib/jetty-util-6.1.26.jar://usr/local/hadoop/share/hadoop/yarn/lib/guava-11.0.2.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-io-2.4.jar://usr/local/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar://usr/local/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-codec-1.4.jar://usr/local/hadoop/share/hadoop/yarn/lib/netty-3.6.2.Final.jar://usr/local/hadoop/share/hadoop/yarn/lib/jetty-6.1.26.jar://usr/local/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar://usr/local/hadoop/share/hadoop/yarn/lib/guice-3.0.jar://usr/local/hadoop/share/hadoop/yarn/lib/jersey-client-1.9.jar://usr/local/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar://usr/local/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-collections-3.2.2.jar://usr/local/hadoop/share/hadoop/yarn/lib/jettison-1.1.jar://usr/local/hadoop/share/hadoop/yarn/lib/asm-3.2.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar://usr/local/hadoop/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar://usr/local/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar://usr/local/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar://usr/local/hadoop/share/hadoop/yarn/lib/jsr305-3.0.0.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.7.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.7.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/junit-4.11.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/commons-io-2.4.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.9.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.9.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar://usr/local/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar://usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.7.jar://usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.7.jar://usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.7.jar://usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.7.jar://usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.7-tests.jar://usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar://usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.7.jar://usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.7.jar://usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.7.jar:/contrib/capacity-scheduler/*.jar:/contrib/capacity-scheduler/*.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-registry-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.7.jar://usr/local/hadoop/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar://usr/local/hadoop/share/hadoop/yarn/lib/activation-1.1.jar://usr/local/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar://usr/local/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar://usr/local/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar://usr/local/hadoop/share/hadoop/yarn/lib/xz-1.0.jar://usr/local/hadoop/share/hadoop/yarn/lib/stax-api-1.0-2.jar://usr/local/hadoop/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar://usr/local/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-logging-1.1.3.jar://usr/local/hadoop/share/hadoop/yarn/lib/jersey-json-1.9.jar://usr/local/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-cli-1.2.jar://usr/local/hadoop/share/hadoop/yarn/lib/servlet-api-2.5.jar://usr/local/hadoop/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar://usr/local/hadoop/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar://usr/local/hadoop/share/hadoop/yarn/lib/jetty-util-6.1.26.jar://usr/local/hadoop/share/hadoop/yarn/lib/guava-11.0.2.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-io-2.4.jar://usr/local/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar://usr/local/hadoop/share/hadoop/yarn/lib/jersey-core-1.9.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-codec-1.4.jar://usr/local/hadoop/share/hadoop/yarn/lib/netty-3.6.2.Final.jar://usr/local/hadoop/share/hadoop/yarn/lib/jetty-6.1.26.jar://usr/local/hadoop/share/hadoop/yarn/lib/jersey-server-1.9.jar://usr/local/hadoop/share/hadoop/yarn/lib/guice-3.0.jar://usr/local/hadoop/share/hadoop/yarn/lib/jersey-client-1.9.jar://usr/local/hadoop/share/hadoop/yarn/lib/jersey-guice-1.9.jar://usr/local/hadoop/share/hadoop/yarn/lib/zookeeper-3.4.6.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-collections-3.2.2.jar://usr/local/hadoop/share/hadoop/yarn/lib/jettison-1.1.jar://usr/local/hadoop/share/hadoop/yarn/lib/asm-3.2.jar://usr/local/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar://usr/local/hadoop/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar://usr/local/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar://usr/local/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar://usr/local/hadoop/share/hadoop/yarn/lib/jsr305-3.0.0.jar://usr/local/hadoop/etc/hadoop/nm-config/log4j.properties
STARTUP_MSG:   build = Unknown -r c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac; compiled by 'stevel' on 2018-07-18T22:47Z
STARTUP_MSG:   java = 1.8.0_191
************************************************************/
2018-12-03 06:12:44,745 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT]
2018-12-03 06:12:48,800 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2018-12-03 06:12:48,801 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2018-12-03 06:12:48,812 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2018-12-03 06:12:48,813 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2018-12-03 06:12:48,813 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2018-12-03 06:12:48,814 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2018-12-03 06:12:48,855 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2018-12-03 06:12:48,855 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager
2018-12-03 06:12:48,936 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2018-12-03 06:12:49,090 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2018-12-03 06:12:49,090 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system started
2018-12-03 06:12:49,232 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2018-12-03 06:12:49,250 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService
2018-12-03 06:12:49,250 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: per directory file limit = 8192
2018-12-03 06:12:49,362 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2018-12-03 06:12:49,409 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2018-12-03 06:12:49,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2018-12-03 06:12:49,501 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl:  Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@50029372
2018-12-03 06:12:49,501 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl:  Using ResourceCalculatorProcessTree : null
2018-12-03 06:12:49,501 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Physical memory check enabled: true
2018-12-03 06:12:49,502 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Virtual memory check enabled: true
2018-12-03 06:12:49,509 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (991.7 M). Thrashing might happen.
2018-12-03 06:12:49,532 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8
2018-12-03 06:12:49,606 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 2000
2018-12-03 06:12:49,650 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 38506
2018-12-03 06:12:50,311 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2018-12-03 06:12:50,312 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Blocking new container-requests as container manager rpc server is still starting.
2018-12-03 06:12:50,323 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2018-12-03 06:12:50,337 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 38506: starting
2018-12-03 06:12:50,572 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Updating node address : slave2:38506
2018-12-03 06:12:50,582 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 500
2018-12-03 06:12:50,583 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8040
2018-12-03 06:12:50,590 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2018-12-03 06:12:50,599 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2018-12-03 06:12:50,599 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8040: starting
2018-12-03 06:12:50,600 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer started on port 8040
2018-12-03 06:12:50,614 INFO org.apache.hadoop.mapred.IndexCache: IndexCache created with max memory = 10485760
2018-12-03 06:12:50,631 INFO org.apache.hadoop.mapred.ShuffleHandler: httpshuffle listening on port 13562
2018-12-03 06:12:50,633 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager started at slave2/192.168.56.102:38506
2018-12-03 06:12:50,633 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:0
2018-12-03 06:12:50,634 INFO org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042
2018-12-03 06:12:50,740 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2018-12-03 06:12:50,759 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
2018-12-03 06:12:50,776 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined
2018-12-03 06:12:50,829 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2018-12-03 06:12:50,831 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2018-12-03 06:12:50,831 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2018-12-03 06:12:50,831 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2018-12-03 06:12:50,836 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /node/*
2018-12-03 06:12:50,836 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
2018-12-03 06:12:51,361 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2018-12-03 06:12:51,366 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8042
2018-12-03 06:12:51,366 INFO org.mortbay.log: jetty-6.1.26
2018-12-03 06:12:51,393 INFO org.mortbay.log: Extract jar:file:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.7.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webapp
2018-12-03 06:12:53,472 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042
2018-12-03 06:12:53,472 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app node started at 8042
2018-12-03 06:12:53,490 INFO org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at master/192.168.56.100:8031
2018-12-03 06:12:53,537 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: []
2018-12-03 06:12:53,557 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[]
2018-12-03 06:12:53,670 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id 1204207882
2018-12-03 06:12:53,673 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id -402946099
2018-12-03 06:12:53,674 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as slave2:38506 with total resource of <memory:8192, vCores:8>
2018-12-03 06:12:53,674 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Notifying ContainerManager to unblock new container-requests
2018-12-03 08:16:24,685 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1543835564585_0001_000001 (auth:SIMPLE)
2018-12-03 08:16:24,800 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1543835564585_0001_01_000001 by user root
2018-12-03 08:16:24,824 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1543835564585_0001
2018-12-03 08:16:24,833 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=root    IP=192.168.56.100    OPERATION=Start Container Request    TARGET=ContainerManageImpl    RESULT=SUCCESS    APPID=application_1543835564585_0001    CONTAINERID=container_1543835564585_0001_01_000001
2018-12-03 08:16:24,848 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1543835564585_0001 transitioned from NEW to INITING
2018-12-03 08:16:24,848 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_1543835564585_0001_01_000001 to application application_1543835564585_0001
2018-12-03 08:16:24,858 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1543835564585_0001 transitioned from INITING to RUNNING
2018-12-03 08:16:24,862 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1543835564585_0001_01_000001 transitioned from NEW to LOCALIZING
2018-12-03 08:16:24,862 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1543835564585_0001
2018-12-03 08:16:24,875 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/root/.staging/job_1543835564585_0001/job.splitmetainfo transitioned from INIT to DOWNLOADING
2018-12-03 08:16:24,876 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/root/.staging/job_1543835564585_0001/job.jar transitioned from INIT to DOWNLOADING
2018-12-03 08:16:24,876 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/root/.staging/job_1543835564585_0001/job.split transitioned from INIT to DOWNLOADING
2018-12-03 08:16:24,876 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/root/.staging/job_1543835564585_0001/job.xml transitioned from INIT to DOWNLOADING
2018-12-03 08:16:24,876 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1543835564585_0001_01_000001
2018-12-03 08:16:25,085 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /home/grid/disk/nm-local-dir/nmPrivate/container_1543835564585_0001_01_000001.tokens. Credentials list: 
2018-12-03 08:16:25,194 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user root
2018-12-03 08:16:25,250 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /home/grid/disk/nm-local-dir/nmPrivate/container_1543835564585_0001_01_000001.tokens to /home/grid/disk/nm-local-dir/usercache/root/appcache/application_1543835564585_0001/container_1543835564585_0001_01_000001.tokens
2018-12-03 08:16:25,251 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Localizer CWD set to /home/grid/disk/nm-local-dir/usercache/root/appcache/application_1543835564585_0001 = file:/home/grid/disk/nm-local-dir/usercache/root/appcache/application_1543835564585_0001
2018-12-03 08:16:26,359 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/root/.staging/job_1543835564585_0001/job.splitmetainfo(->/home/grid/disk/nm-local-dir/usercache/root/appcache/application_1543835564585_0001/filecache/10/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2018-12-03 08:16:26,410 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/root/.staging/job_1543835564585_0001/job.jar(->/home/grid/disk/nm-local-dir/usercache/root/appcache/application_1543835564585_0001/filecache/11/job.jar) transitioned from DOWNLOADING to LOCALIZED
2018-12-03 08:16:26,479 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/root/.staging/job_1543835564585_0001/job.split(->/home/grid/disk/nm-local-dir/usercache/root/appcache/application_1543835564585_0001/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2018-12-03 08:16:26,526 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/root/.staging/job_1543835564585_0001/job.xml(->/home/grid/disk/nm-local-dir/usercache/root/appcache/application_1543835564585_0001/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2018-12-03 08:16:26,527 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1543835564585_0001_01_000001 transitioned from LOCALIZING to LOCALIZED
2018-12-03 08:16:26,532 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Failed to launch container.
java.lang.IllegalArgumentException: URI has an authority component
    at java.io.File.<init>(File.java:423)
    at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:281)
    at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:344)
    at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
    at org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.getLogPathForWrite(LocalDirsHandlerService.java:486)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:187)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
2018-12-03 08:16:26,540 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1543835564585_0001_01_000001 transitioned from LOCALIZED to EXITED_WITH_FAILURE
2018-12-03 08:16:26,540 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1543835564585_0001_01_000001
2018-12-03 08:16:26,540 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1543835564585_0001_01_000001 not launched. No cleanup needed to be done
2018-12-03 08:16:26,542 WARN org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=root    OPERATION=Container Finished - Failed    TARGET=ContainerImpl    RESULT=FAILURE    DESCRIPTION=Container failed with state: EXITED_WITH_FAILURE    APPID=application_1543835564585_0001    CONTAINERID=container_1543835564585_0001_01_000001
2018-12-03 08:16:26,583 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1543835564585_0001_01_000001 transitioned from EXITED_WITH_FAILURE to DONE
2018-12-03 08:16:26,583 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_1543835564585_0001_01_000001 from application application_1543835564585_0001
2018-12-03 08:16:26,584 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1543835564585_0001
2018-12-03 08:16:27,603 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1543835564585_0001_01_000001]
2018-12-03 08:16:27,986 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1543835564585_0001_01_000001
2018-12-03 08:16:28,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1543835564585_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2018-12-03 08:16:28,608 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /home/grid/disk/nm-local-dir/usercache/root/appcache/application_1543835564585_0001
2018-12-03 08:16:28,610 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_STOP for appId application_1543835564585_0001
2018-12-03 08:16:28,612 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1543835564585_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2018-12-03 08:16:28,612 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler: Scheduling Log Deletion for application: application_1543835564585_0001, with delay of 10800 seconds
 

//core-site.xml

<configuration>
<property>
    <name>fs.defaultFS</name>
    <value>hdfs://master:9000</value>
</property>

<property>
    <name>hadoop.tmp.dir</name>
    <value>/home/grid/disk</value>
</property>
</configuration>

//hdfs-site.xml

<configuration>
<property>
        <name>dfs.permissions.enabled</name>
        <value>false</value>
</property>

<property>
        <name>dfs.namenode.name.dir</name>
        <value>${hadoop.tmp.dir}/dfs/name</value>
</property>
<property>
        <name>dfs.datanode.data.dir</name>
        <value>${hadoop.tmp.dir}/dfs/name</value>
</property>
</configuration>

 

//yarn-site.xml

<configuration>
<property>
      <name>yarn.resourcemanager.hostname</name>
      <value>master</value>
</property>
<property>
      <name>yarn.nodemanager.aux-services</name>
      <value>mapreduce_shuffle</value>
</property>
<property>
      <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
      <value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>

 

 

ardien
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
hadoop2.7.7
07-20
hadoop2.7.7
windows下hadoop有namenode却没有datanode
wodanigadie的博客
12-16 279
搞什么修改datanode/current/里面的version文件的clusterID号没什么用。最好的办法就是把data里的datanode删掉，保存namenode。jps一直不出datanode进程。
Hadoop集群安装
zuopiezia的博客
02-21 442
###修改hostname all node hostnamectl set-hostname master hostnamectl set-hostname slave1 hostnamectl set-hostname slave2 hostnamectl set-hostname slave3 ##master 到 salve 做无密码认证 ssh-keygen ssh-cop...
伪分布式hadoop集群搭建
Edgar_LQS的博客
11-20 210
环境配置   java配置后如下所示   配置参考地址https://blog.csdn.net/Edgar_LQS/article/details/103152034 lqs@hadoop:~$ java -version java version "1.8.0_211" Java(TM) SE Runtime Environment (build 1.8.0_211-b12) Java Hot...
Hadoop中hdsf时出错 求大神解决
Astute123的博客
12-16 938
19/12/16 12:02:53 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = master/192.168.163.10 STARTUP_...
Hadoop2.x NodeManager启动之服务初始化
海盗的小菜园
03-21 3739
NM和RM类似，也是以服务的形式启动，但服务相对于RM来说少些，也经历服务初始化和服务启动两个阶段，NM继承自CompositeService。NM的服务初始化列表如下： NM的启动入口 public static void main(String[] args) { //异常处理 Thread.setDefaultUncaughtExceptionHandler(new Yar
Hadoop在YARN上运行案例卡死
weixin_38023225的博客
09-04 3367
问题 在本地环境运行模式，运行案例（pi/grep/wordcount）都是OK的 在伪分布式运行模式，运行上述案例，直接卡死 [root@master-node sbin]# start-dfs.sh --启动HDFS集群 [root@master-node sbin]# start-yarn.sh --启动YARN集群 [root@ma...
hadoop服务监听到的端口
qq_25628891的博客
01-13 3642
netstat -ntlp jps namenode PID 19549 namenode监听到的端口 -192.168.220.128:50070 #namenode对外提供的http服务，通过这个服务可以查看hdfs集群的状态 -192.168.220.128:9000 #namenode对外提供的rpc服务的端口(比如客户端的交互，元数据的获取等)
Yarn上的不健康节点---UNHEALTHY nodes
weixin_34126215的博客
09-18 1816
2019独角兽企业重金招聘Python工程师标准>>> ...
hadoop2.7.7对应的hadoop.dll，winutils.exe
12-07
支持windows下安装hadoop2.7.7后，将这两个文件放在bin目录下，可以解决windows下安装hadoop遇到的问题
Hadoop2.7.7安装过程
10-11
个人安装报告，包括安装步骤及遇见的问题和解决办法，并且借鉴了许多大佬并且看了安装视频，在更换源等操作之后，安装成功。小白纯分享望指教，希望可以对大家有所帮助并且共同学习。
hadoop2.7.7.zip
04-04
hadoop2.7.7
windows64位hadoop2.7.7版本hadoop.dll
11-05
windows下做hadoop入门，会出现hdfs报错，2.7.7版本兼容 windows下做hadoop入门，会出现hdfs报错，2.7.7版本兼容 windows下做hadoop入门，会出现hdfs报错，2.7.7版本兼容
电信塔施工方案.doc
04-27
5G通信行业、网络优化、通信工程建设资料。
29-【智慧城市与政府治理分会场】10亿大数据助推都市治理-30页.pdf
04-27
29-【智慧城市与政府治理分会场】10亿大数据助推都市治理-30页.pdf
ABB IRC5 Compact 机器人产品手册
最新发布
04-27
ABB IRC5 Compact 机器人产品手册
LTE容量优化高负荷小区优化指导书.docx
04-27
5G通信行业、网络优化、通信工程建设资料
施工工艺及质量检查记录表.docx
04-27
5G通信行业、网络优化、通信工程建设资料。
hadoop 2.7.7的eclipse
11-24
Hadoop 2.7.7可以与eclipse集成使用，这为开发人员提供了一个方便的方式来编写、调试和执行Hadoop程序。通过将Hadoop与eclipse集成，开发人员可以利用eclipse的强大功能和用户友好的界面来管理和监控Hadoop集群的操作。 在eclipse中使用Hadoop 2.7.7，开发人员可以轻松创建和管理Hadoop项目，编写MapReduce程序，并在集群上运行它们。通过eclipse的图形化界面，可以方便地监控作业的执行情况和集群的负载情况，从而更好地优化和调整程序的性能。 此外，eclipse还提供了丰富的插件和工具，可以帮助开发人员更高效地进行Hadoop应用程序的开发和调试。开发人员可以使用eclipse中的调试器来逐步执行和分析程序的运行过程，从而更快地发现和解决问题。 总之，将Hadoop 2.7.7集成到eclipse中，可以极大地提高开发人员的工作效率和便利性，为他们提供一个更加高效和友好的开发环境。这将有助于加快Hadoop应用程序的开发周期，提高程序的质量和性能，从而更好地满足用户的需求。

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值