1.执行bin/flume-ng agent -c ./conf -f ./conf/spooldir.conf -n a1 -Dflume.root.logger=INFO,console后,上传文件到dirfile报错:[ERROR - org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:280)] FATAL: Spool Directory source r1: { spoolDir: /export/servers/dirfile }: Uncaught exception in SpoolDirectorySource thread. Restart or reconfigure Flume to continue processing.
java.nio.charset.MalformedInputException: Input length = 1
原因:上传的文件内容有中文
解决方案:删除中文字符即可
2.运行级联flume时报错:
[ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:447)] process failed.
[ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event.
解决:
在配置文件/export/servers/apache-flume-1.8.0-bin/conf---collector.conf中添加以下语句:
a1.sinks.k1.hdfs.useLocalTimeStamp = true