kafka中topic默认属性_Kafka到hdfs3接收器缺少所需的配置“ confluent.topic.bootstrap.servers”；没有默认值...

Status

My HDFS was installed via ambari, HDP.

I'm Currently trying to load kafka topics into HDFS sink. Kafka and HDFS was installed in the same machine x.x.x.x.

I didn't change much stuff from the default settings, except some port that according to my needs.

Here is how i execute kafka:

/usr/hdp/3.1.4.0-315/kafka/bin/connect-standalone.sh /etc/kafka/connect-standalone.properties /etc/kafka-connect-hdfs/quickstart-hdfs.properties

Inside connect-standalone.properties

bootstrap.servers=x.x.x.x:6667

key.converter=org.apache.kafka.connect.storage.StringConverter

value.converter=org.apache.kafka.connect.storage.StringConverter

key.converter.schemas.enable=true

value.converter.schemas.enable=true

offset.storage.file.filename=/tmp/connect.offsets

offset.flush.interval.ms=10000

inside quickstart-hdfs.properties

name=hdfs-sink

#connector.class=io.confluent.connect.hdfs.HdfsSinkConnector

connector.class=io.confluent.connect.hdfs3.Hdfs3SinkConnector

tasks.max=1

topics=test12

hdfs.url=hdfs://x.x.x.x:9000

flush.size=3

Here are the results i get when excute it:

[2020-06-23 03:26:00,918] INFO Started o.e.j.s.ServletContextHandler@71d9cb05{/,null,AVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler:855