启动flume以及启动时出现的问题

最新推荐文章于 2023-03-27 22:32:23 发布

D奋斗的小菜鸟！

最新推荐文章于 2023-03-27 22:32:23 发布

阅读量1.1w

点赞数 1

分类专栏： # Flume 大数据文章标签： flume

本文链接：https://blog.csdn.net/duyenson/article/details/103089396

版权

大数据同时被 2 个专栏收录

16 篇文章 0 订阅

订阅专栏

Flume

3 篇文章 0 订阅

订阅专栏

1.启动flume

1.创建flume Agent配置文件：

#指定agent的sources,sinks,channels
a1.sources = s1  
a1.sinks = k1  
a1.channels = c1  
   
#配置sources属性
a1.sources.r1.type = netcat
a1.sources.r1.bind = localhost
a1.sources.r1.port = 44444


#将sources与channels进行绑定
a1.sources.s1.channels = c1
   
#配置sink 
a1.sinks.k1.type = logger

#将sinks与channels进行绑定  
a1.sinks.k1.channel = c1  
   
#配置channel类型
a1.channels.c1.type = memory

2.启动命令（需传入参数）：

bin/flume-ng agent 
--conf conf /
--conf-file job/flume-netcat-logger.conf
--name a1 
-Dflume.root.logger=INFO,console

2.启动时出现的错误：

错误日志1：

Info: Sourcing environment configuration script /opt/SoftWare/Flume/flume-1.7.0-bin/conf/flume-env.sh
Info: Including Hadoop libraries found via (/opt/SoftWare/Hadoop/hadoop-2.7.7/bin/hadoop) for HDFS access
Info: Including HBASE libraries found via (/opt/SoftWare/HBase/hbase-1.4.10/bin/hbase) for HBASE access
Info: Including Hive libraries found via () for Hive access
+ exec /opt/SoftWare/Java/jdk1.8.0_212/bin/java -Xmx20m -Dflume.root.logger=INFO,console -cp '/opt/SoftWare/Flume/flume-1.7.0-bin/conf:/opt/SoftWare/Flume/flume-1.7.0-bin/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/etc/hadoop:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/common/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/common/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/yarn/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/yarn/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/mapreduce/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/mapreduce/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/contrib/capacity-scheduler/*.jar:/opt/SoftWare/HBase/hbase-1.4.10/conf:/opt/SoftWare/Java/jdk1.8.0_212/lib/tools.jar:/opt/SoftWare/HBase/hbase-1.4.10:/opt/SoftWare/HBase/hbase-1.4.10/lib/activation-1.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/apacheds-i18n-2.0.0-M15.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/api-asn1-api-1.0.0-M20.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/api-util-1.0.0-M20.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/asm-3.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/avro-1.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-beanutils-1.7.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-beanutils-core-1.8.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-cli-1.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-codec-1.9.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-collections-3.2.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-compress-1.4.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-configuration-1.6.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-daemon-1.0.13.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-digester-1.8.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-el-1.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-httpclient-3.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-io-2.4.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-lang-2.6.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-logging-1.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-math-2.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-math3-3.1.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-net-3.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/curator-client-2.7.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/curator-framework-2.7.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/curator-recipes-2.7.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/disruptor-3.3.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/findbugs-annotations-1.3.9-1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/gson-2.2.4.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/guava-12.0.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-annotations-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-auth-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-client-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-common-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-hdfs-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-app-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-common-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-core-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-hs-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-jobclient-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-shuffle-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-yarn-api-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-yarn-client-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-yarn-common-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-yarn-server-common-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-annotations-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-annotations-1.4.10-tests.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-client-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-common-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-common-1.4.10-tests.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-examples-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-external-blockcache-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-hadoop2-compat-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-hadoop-compat-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-it-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-it-1.4.10-tests.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-metrics-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-metrics-api-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-prefix-tree-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-procedure-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-protocol-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-resource-bundle-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-rest-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-rsgroup-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-server-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-server-1.4.10-tests.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-shell-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-thrift-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/htrace-core-3.1.0-incubating.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/httpclient-4.5.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/httpcore-4.4.4.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jackson-core-asl-1.9.13.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jackson-jaxrs-1.9.13.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jackson-mapper-asl-1.9.13.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jackson-xc-1.9.13.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jamon-runtime-2.4.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jasper-compiler-5.5.23.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jasper-runtime-5.5.23.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jaxb-api-2.2.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jaxb-impl-2.2.3-1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jcodings-1.0.8.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jersey-client-1.9.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jersey-core-1.9.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jersey-json-1.9.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jersey-server-1.9.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jettison-1.3.3.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jetty-6.1.26.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jetty-sslengine-6.1.26.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jetty-util-6.1.26.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/joni-2.1.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jruby-complete-1.6.8.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jsch-0.1.54.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jsp-2.1-6.1.14.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jsp-api-2.1-6.1.14.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/junit-4.12.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/leveldbjni-all-1.8.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/libthrift-0.9.3-1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/log4j-1.2.17.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/metrics-core-2.2.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/metrics-core-3.1.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/netty-all-4.1.8.Final.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/paranamer-2.3.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/protobuf-java-2.5.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/servlet-api-2.5-6.1.14.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/slf4j-api-1.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/slf4j-log4j12-1.7.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/snappy-java-1.0.5.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/spymemcached-2.11.6.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/xmlenc-0.52.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/xz-1.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/zookeeper-3.4.14.jar:/opt/SoftWare/Hadoop/hadoop-2.7.7/etc/hadoop:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/common/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/common/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/yarn/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/yarn/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/mapreduce/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/mapreduce/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/contrib/capacity-scheduler/*.jar:.:/opt/SoftWare/Java/jdk1.8.0_212/lib/dt.jar:/opt/SoftWare/Java/jdk1.8.0_212/lib/tools.jar:/opt/SoftWare/Java/jdk1.8.0_212/jre/lib/rt.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib:/opt/SoftWare/HBase/hbase-1.4.10/conf:/lib/*' -Djava.library.path=:/opt/SoftWare/Hadoop/hadoop-2.7.7/lib/native org.apache.flume.node.Application --conf-file job/flume-netcat-logger.conf --name a1
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/SoftWare/Flume/flume-1.7.0-bin/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/SoftWare/HBase/hbase-1.4.10/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2019-11-15 17:32:14,801 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider.start(PollingPropertiesFileConfigurationProvider.java:62)] Configuration provider starting
2019-11-15 17:32:14,811 (conf-file-poller-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:134)] Reloading configuration file:job/flume-netcat-logger.conf
2019-11-15 17:32:14,819 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:930)] Added sinks: k1 Agent: a1
2019-11-15 17:32:14,819 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] Processing:k1
2019-11-15 17:32:14,820 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:1016)] Processing:k1
2019-11-15 17:32:14,838 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:140)] Post-validation flume configuration contains configuration for agents: [a1]
2019-11-15 17:32:14,838 (conf-file-poller-0) [INFO - org.apache.flume.node.AbstractConfigurationProvider.loadChannels(AbstractConfigurationProvider.java:147)] Creating channels
2019-11-15 17:32:14,851 (conf-file-poller-0) [INFO - org.apache.flume.channel.DefaultChannelFactory.create(DefaultChannelFactory.java:42)] Creating instance of channel c1 type memory
2019-11-15 17:32:14,860 (conf-file-poller-0) [INFO - org.apache.flume.node.AbstractConfigurationProvider.loadChannels(AbstractConfigurationProvider.java:201)] Created channel c1
2019-11-15 17:32:14,861 (conf-file-poller-0) [INFO - org.apache.flume.source.DefaultSourceFactory.create(DefaultSourceFactory.java:41)] Creating instance of source r1, type netcat
2019-11-15 17:32:14,878 (conf-file-poller-0) [INFO - org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:42)] Creating instance of sink: k1, type: logger
2019-11-15 17:32:14,888 (conf-file-poller-0) [INFO - org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:116)] Channel c1 connected to [r1, k1]
2019-11-15 17:32:14,896 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:137)] Starting new configuration:{ sourceRunners:{r1=EventDrivenSourceRunner: { source:org.apache.flume.source.NetcatSource{name:r1,state:IDLE} }} sinkRunners:{k1=SinkRunner: { policy:org.apache.flume.sink.DefaultSinkProcessor@6c941808 counterGroup:{ name:null counters:{} } }} channels:{c1=org.apache.flume.channel.MemoryChannel{name: c1}} }
2019-11-15 17:32:14,910 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:144)] Starting Channel c1
2019-11-15 17:32:14,976 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.instrumentation.MonitoredCounterGroup.register(MonitoredCounterGroup.java:119)] Monitored counter group for type: CHANNEL, name: c1: Successfully registered new MBean.
2019-11-15 17:32:14,976 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.instrumentation.MonitoredCounterGroup.start(MonitoredCounterGroup.java:95)] Component type: CHANNEL, name: c1 started
2019-11-15 17:32:14,981 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:171)] Starting Sink k1
2019-11-15 17:32:14,984 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:182)] Starting Source r1
2019-11-15 17:32:14,985 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.source.NetcatSource.start(NetcatSource.java:155)] Source starting
2019-11-15 17:32:15,001 (lifecycleSupervisor-1-0) [ERROR - org.apache.flume.source.NetcatSource.start(NetcatSource.java:172)] Unable to bind to socket. Exception follows.
java.net.BindException: 无法指定被请求的地址
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:433)
	at sun.nio.ch.Net.bind(Net.java:425)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)
	at org.apache.flume.source.NetcatSource.start(NetcatSource.java:167)
	at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44)
	at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:249)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019-11-15 17:32:15,006 (lifecycleSupervisor-1-0) [ERROR - org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)] Unable to start EventDrivenSourceRunner: { source:org.apache.flume.source.NetcatSource{name:r1,state:IDLE} } - Exception follows.
org.apache.flume.FlumeException: java.net.BindException: 无法指定被请求的地址
	at org.apache.flume.source.NetcatSource.start(NetcatSource.java:173)
	at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44)
	at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:249)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.BindException: 无法指定被请求的地址
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:433)
	at sun.nio.ch.Net.bind(Net.java:425)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)
	at org.apache.flume.source.NetcatSource.start(NetcatSource.java:167)
	... 9 more
2019-11-15 17:32:18,008 (lifecycleSupervisor-1-4) [INFO - org.apache.flume.source.NetcatSource.start(NetcatSource.java:155)] Source starting
2019-11-15 17:32:18,009 (lifecycleSupervisor-1-4) [ERROR - org.apache.flume.source.NetcatSource.start(NetcatSource.java:172)] Unable to bind to socket. Exception follows.
java.net.BindException: 无法指定被请求的地址
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:433)
	at sun.nio.ch.Net.bind(Net.java:425)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)
	at org.apache.flume.source.NetcatSource.start(NetcatSource.java:167)
	at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44)
	at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:249)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019-11-15 17:32:18,009 (lifecycleSupervisor-1-4) [ERROR - org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)] Unable to start EventDrivenSourceRunner: { source:org.apache.flume.source.NetcatSource{name:r1,state:IDLE} } - Exception follows.
org.apache.flume.FlumeException: java.net.BindException: 无法指定被请求的地址
	at org.apache.flume.source.NetcatSource.start(NetcatSource.java:173)
	at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44)
	at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:249)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.BindException: 无法指定被请求的地址
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:433)
	at sun.nio.ch.Net.bind(Net.java:425)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)
	at org.apache.flume.source.NetcatSource.start(NetcatSource.java:167)
	... 9 more

解决办法：

       需要修改flume Agent配置文件中 a1.sources.r1.bind 的属性值。

错误日志2：

Info: Sourcing environment configuration script /opt/SoftWare/Flume/flume-1.7.0-bin/conf/flume-env.sh
Info: Including Hadoop libraries found via (/opt/SoftWare/Hadoop/hadoop-2.7.7/bin/hadoop) for HDFS access
Info: Including HBASE libraries found via (/opt/SoftWare/HBase/hbase-1.4.10/bin/hbase) for HBASE access
Info: Including Hive libraries found via () for Hive access
+ exec /opt/SoftWare/Java/jdk1.8.0_212/bin/java -Xmx20m -Dflume.root.logger=INFO,console -cp '/opt/SoftWare/Flume/flume-1.7.0-bin/conf:/opt/SoftWare/Flume/flume-1.7.0-bin/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/etc/hadoop:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/common/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/common/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/yarn/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/yarn/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/mapreduce/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/mapreduce/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/contrib/capacity-scheduler/*.jar:/opt/SoftWare/HBase/hbase-1.4.10/conf:/opt/SoftWare/Java/jdk1.8.0_212/lib/tools.jar:/opt/SoftWare/HBase/hbase-1.4.10:/opt/SoftWare/HBase/hbase-1.4.10/lib/activation-1.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/apacheds-i18n-2.0.0-M15.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/api-asn1-api-1.0.0-M20.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/api-util-1.0.0-M20.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/asm-3.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/avro-1.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-beanutils-1.7.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-beanutils-core-1.8.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-cli-1.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-codec-1.9.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-collections-3.2.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-compress-1.4.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-configuration-1.6.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-daemon-1.0.13.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-digester-1.8.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-el-1.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-httpclient-3.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-io-2.4.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-lang-2.6.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-logging-1.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-math-2.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-math3-3.1.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/commons-net-3.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/curator-client-2.7.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/curator-framework-2.7.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/curator-recipes-2.7.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/disruptor-3.3.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/findbugs-annotations-1.3.9-1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/gson-2.2.4.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/guava-12.0.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-annotations-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-auth-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-client-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-common-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-hdfs-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-app-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-common-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-core-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-hs-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-jobclient-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-mapreduce-client-shuffle-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-yarn-api-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-yarn-client-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-yarn-common-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hadoop-yarn-server-common-2.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-annotations-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-annotations-1.4.10-tests.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-client-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-common-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-common-1.4.10-tests.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-examples-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-external-blockcache-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-hadoop2-compat-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-hadoop-compat-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-it-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-it-1.4.10-tests.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-metrics-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-metrics-api-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-prefix-tree-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-procedure-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-protocol-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-resource-bundle-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-rest-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-rsgroup-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-server-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-server-1.4.10-tests.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-shell-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/hbase-thrift-1.4.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/htrace-core-3.1.0-incubating.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/httpclient-4.5.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/httpcore-4.4.4.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jackson-core-asl-1.9.13.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jackson-jaxrs-1.9.13.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jackson-mapper-asl-1.9.13.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jackson-xc-1.9.13.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jamon-runtime-2.4.1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jasper-compiler-5.5.23.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jasper-runtime-5.5.23.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jaxb-api-2.2.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jaxb-impl-2.2.3-1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jcodings-1.0.8.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jersey-client-1.9.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jersey-core-1.9.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jersey-json-1.9.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jersey-server-1.9.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jettison-1.3.3.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jetty-6.1.26.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jetty-sslengine-6.1.26.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jetty-util-6.1.26.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/joni-2.1.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jruby-complete-1.6.8.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jsch-0.1.54.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jsp-2.1-6.1.14.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/jsp-api-2.1-6.1.14.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/junit-4.12.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/leveldbjni-all-1.8.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/libthrift-0.9.3-1.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/log4j-1.2.17.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/metrics-core-2.2.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/metrics-core-3.1.2.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/netty-all-4.1.8.Final.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/paranamer-2.3.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/protobuf-java-2.5.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/servlet-api-2.5-6.1.14.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/slf4j-api-1.7.7.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/slf4j-log4j12-1.7.10.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/snappy-java-1.0.5.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/spymemcached-2.11.6.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/xmlenc-0.52.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/xz-1.0.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib/zookeeper-3.4.14.jar:/opt/SoftWare/Hadoop/hadoop-2.7.7/etc/hadoop:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/common/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/common/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/hdfs/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/yarn/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/yarn/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/mapreduce/lib/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/mapreduce/*:/opt/SoftWare/Hadoop/hadoop-2.7.7/contrib/capacity-scheduler/*.jar:.:/opt/SoftWare/Java/jdk1.8.0_212/lib/dt.jar:/opt/SoftWare/Java/jdk1.8.0_212/lib/tools.jar:/opt/SoftWare/Java/jdk1.8.0_212/jre/lib/rt.jar:/opt/SoftWare/HBase/hbase-1.4.10/lib:/opt/SoftWare/HBase/hbase-1.4.10/conf:/lib/*' -Djava.library.path=:/opt/SoftWare/Hadoop/hadoop-2.7.7/lib/native org.apache.flume.node.Application --conf-file job/flume-nett-logger.conf --name a1
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/SoftWare/Flume/flume-1.7.0-bin/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/SoftWare/Hadoop/hadoop-2.7.7/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/SoftWare/HBase/hbase-1.4.10/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2019-11-15 17:49:47,987 (main) [ERROR - org.apache.flume.node.Application.main(Application.java:348)] A fatal error occurred while running. Exception follows.
org.apache.commons.cli.ParseException: The specified configuration file does not exist: /opt/SoftWare/Flume/flume-1.7.0-bin/job/flume-nett-logger.conf
	at org.apache.flume.node.Application.main(Application.java:316)

解决办法：

  在输入启动命令的时候，flume Agent配置文件命令输入错误。

D奋斗的小菜鸟！

关注

1
点赞
踩
15

收藏

觉得还不错? 一键收藏
2
评论
启动flume以及启动时出现的问题

1.启动flume1.创建flume Agent配置文件：#指定agent的sources,sinks,channelsa1.sources = s1 a1.sinks = k1 a1.channels = c1 #配置sources属性a1.sources.r1.type = netcata1.sources.r1.bind = localhosta1.sourc...
复制链接

扫一扫