spring-boot配置kafka、kafka使用、kafka生产者和消费者
导入对应的包
<dependency>
<groupId>org.apache.kafka</groupId>
<artifactId>kafka_2.11</artifactId>
<version>1.1.0</version>
<exclusions>
<exclusion>
<artifactId>jackson-databind</artifactId>
<groupId>com.fasterxml.jackson.core</groupId>
</exclusion>
<exclusion>
<artifactId>jackson-core</artifactId>
<groupId>com.fasterxml.jackson.core</groupId>
</exclusion>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-annotations</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.springframework.kafka</groupId>
<artifactId>spring-kafka</artifactId>
<version>2.1.12.RELEASE</version>
</dependency>
配置文件配置
spring:
kafka:
bootstrap-servers: 127.0.0.1:9092
producer:
key-serializer: org.apache.kafka.common.serialization.StringSerializer
value-serializer: org.apache.kafka.common.serialization.StringSerializer
consumer:
group-id: TEST
enable-auto-commit: false
key-deserializer: org.apache.kafka.common.serialization.StringDeserializer
value-deserializer: org.apache.kafka.common.serialization.StringDeserializer
发送kafka消息方法
@Component
public class SendKafka{
@Autowired
private KafkaTemplate<String, String> kafkaTemplate;
public void sendKafka(){
try {
kafkaTemplate.send("testtopic","testkey","测试值")
} catch (Exception e) {
e.printStackTrace();
log.error("{}",e);
}
}
}
接收kafka消息方法
@KafkaListener(topics = {"testtopic"})
public void testtopic(ConsumerRecord<String, String> record) {
String key = new String(record.key().getBytes("UTF-8"),"UTF-8");
String value = new String(record.value().getBytes("UTF-8"),"UTF-8");
System.out.println("key:"+key+",value:"+value);
}
其他步骤
- kafka服务自带zookeeper下载与启动
- Spring boot配置kafka服务
- kafka生产者发送消息成功回调
- kafka根据ip端口获取消息队列上的topic
- kafka动态设置监听哪些topic
- 动态启动关闭kafka监听、设置默认不监听kafka
- kafka设置:1只接受消息、不发送消息;2只发送消息不接受消息;3既接受消息也发送消息;4既不接收消息也不发送消息
- kafka会把历史数据都获取下来
- Spring boot kafka执行多次多次消费