SpringBoot整合Kafka

1.先启动kafka集群

 

kafka-server-start.sh /home/hadoop/apps/kafka_2.11-1.1.0/config/server.properties

2.添加maven依赖，可在创建项目的时候勾选

 

<dependency>
    <groupId>org.springframework.kafka</groupId>
    <artifactId>spring-kafka</artifactId>
</dependency>

项目结构如下

配置信息：

application.yml

 

spring:
  kafka:
    bootstrap-servers: master:9092
    producer:
      key-serializer: org.apache.kafka.common.serialization.StringSerializer
      value-serializer: org.apache.kafka.common.serialization.StringSerializer
    consumer:
      group-id: test
      enable-auto-commit: true
      auto-commit-interval: 1000
      key-deserializer: org.apache.kafka.common.serialization.StringDeserializer
      value-deserializer: org.apache.kafka.common.serialization.StringDeserializer

要注意对齐，否则读不到配置信息会报错

 

生产者：

 

package com.example.testkafkacspring.demo.web;
​
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.kafka.core.KafkaTemplate;
import org.springframework.web.bind.annotation.RequestMapping;
import org.springframework.web.bind.annotation.RestController;
​
/**
 * 测试kafka生产者
 */
@RestController
@RequestMapping("kafka")
public class TestKafkaProducerController {
    @Autowired
    private KafkaTemplate<String, String> kafkaTemplate;
    @RequestMapping("send")
    public String send(String msg){
        kafkaTemplate.send("test_topic", msg);
        return "success add ";
    }
}

消费者：

 

package com.example.testkafkacspring.demo.kafka;
​
import org.apache.kafka.clients.consumer.ConsumerRecord;
import org.springframework.kafka.annotation.KafkaListener;
import org.springframework.stereotype.Component;
​
/**
 * kafka消费者测试
 */
@Component
public class TestConsumer {
    @KafkaListener(topics = "test_topic")
    public void listen (ConsumerRecord<?, ?> record) throws Exception {
        //控制台打印send进来的信息
        System.out.printf("topic = %s, offset = %d, value = %s \n", record.topic(), record.offset(), record.value());
    }
}

启动类：

 

package com.example.testkafkacspring.demo;
​
import org.springframework.boot.SpringApplication;
import org.springframework.boot.autoconfigure.SpringBootApplication;
​
@SpringBootApplication
public class DemoApplication {
    public static void main(String[] args) {
        SpringApplication.run(DemoApplication.class, args);
    }
}

运行项目：

可能会报错。遇到本地8080端口被占用，kafka服务器的server.properties配置信息错误，修改即可

在浏览器访问:http://localhost:8080/kafka/send?msg=hello

控制台输出：

 

topic = test_topic, offset = 0, value = hello

为了体现消费者不止执行一次就结束，再调用一次接口：http://localhost:8080/kafka/send?msg=kafka

 

topic = test_topic, offset = 1, value = kafka 

可以不停的向topic里send信息