Kafka源码分析之KafkaProducer发送数据send()方法

最新推荐文章于 2024-08-12 16:16:19 发布

lipeng_bigdata

最新推荐文章于 2024-08-12 16:16:19 发布

阅读量2.5w

点赞数 5

分类专栏： Kafka

本文链接：https://blog.csdn.net/lipeng_bigdata/article/details/51112870

版权

本文深入探讨了KafkaProducer的send()方法，详细阐述了从等待元数据到序列化键值、计算大小、确保记录有效、添加记录及唤醒sender的整个过程，为理解Kafka数据发送机制提供了关键洞察。

摘要由CSDN通过智能技术生成

KafkaProducer是Kafka中Producer的一种实现，其主要功能就是发送消息给Kafka中broker。其send()方法如下：

    /**
     * Asynchronously send a record to a topic. Equivalent to <code>send(record, null)</code>.
     * See {@link #send(ProducerRecord, Callback)} for details.
     */
    @Override
    public Future<RecordMetadata> send(ProducerRecord<K, V> record) {
        return send(record, null);
    }

再看两个参数的send()方法，代码如下：

    /**
     * Asynchronously send a record to a topic and invoke the provided callback when the send has been acknowledged.
     * <p>
     * The send is asynchronous and this method will return immediately once the record has been stored in the buffer of
     * records waiting to be sent. This allows sending many records in parallel without blocking to wait for the
     * response after each one.
     * <p>
     * The result of the send is a {@link RecordMetadata} specifying the partition the record was sent to and the offset
     * it was assigned.
     * <p>
     * Since the send call is asynchronous it returns a {@link java.util.concurrent.Future Future} for the
     * {@link RecordMetadata} that will be assigned to this record. Invoking {@link java.util.concurrent.Future#get()
     * get()} on this future will block until the associated request completes and then return the metadata for the record
     * or throw any exception that occurred while sending the record.
     * <p>
     * If you want to simulate a simple blocking call you can call the <code>get()</code> method immediately:
     *
     * <pre>
     * {@code
     * byte[] key = "key".getBytes();
     * byte[] value = "value".getBytes();
     * Produ