ROcketMQ源码分析(十一)之CommitLog

最新推荐文章于 2022-10-20 22:39:27 发布

jannals

最新推荐文章于 2022-10-20 22:39:27 发布

阅读量473

点赞数

分类专栏： # RocketMQ源码分析文章标签： RocketMQ源码 CommitLog

本文链接：https://blog.csdn.net/usagoole/article/details/126394670

版权

本文主要分析RocketMQ的CommitLog，它是保存消息元数据的地方，记录每条消息的消费状态。内容涉及CommitLog的存储目录、构造方法、消息追加以及如何获取偏移量。通过自旋锁保证并发安全性。

摘要由CSDN通过智能技术生成

版本

基于rocketmq-all-4.3.1版本

简介

CommitLog是保存消息元数据的地方，所有Topic的消息到达Broker后都会保存到CommitLog文件。CommitLog 里面记录了每条消息的消费情况，是否被消费，由谁消费，该消息是否持久化等信息
CommitLog文件的存储目录默认为**${ROCKET_HOME}/store/commitlog**，默认大小是1G

CommitLog核心属性

public class CommitLog {
     
    // Message's MAGIC CODE daa320a7
    public final static int MESSAGE_MAGIC_CODE = -626843481;
    private static final InternalLogger log = InternalLoggerFactory.getLogger(LoggerName.STORE_LOGGER_NAME);
    // End of file empty MAGIC CODE cbd43194
    private final static int BLANK_MAGIC_CODE = -875286124;
    /**
     * 内存映射文件队列，CommitLog和ConsumeQueue都有一个对应的MappedFileQueue
     */
    private final MappedFileQueue mappedFileQueue;
    private final DefaultMessageStore defaultMessageStore;
    /**
     * 同步刷盘
     * flushCommitLogService = new GroupCommitService();
     * 异步刷盘
     * flushCommitLogService = new FlushRealTimeService();
     */
    private final FlushCommitLogService flushCommitLogService;

    //If TransientStorePool enabled, we must flush message to FileChannel at fixed periods
    private final FlushCommitLogService commitLogService;

    private final AppendMessageCallback appendMessageCallback;
    private final ThreadLocal<MessageExtBatchEncoder> batchEncoderThreadLocal;
    private HashMap<String/* topic-queueid */, Long/* offset */> topicQueueTable = new HashMap<String, Long>(1024);
    private volatile long confirmOffset = -1L;

    private volatile long beginTimeInLock = 0;
    private final PutMessageLock putMessageLock;
		...省略...
}

构造方法

CommitLog构造方法：可以看出CommitLog与DefaultMessageStore绑定，CommitLog是对外的统一抽象，实际文件的操作委托给mappedFile

public CommitLog(final DefaultMessageStore defaultMessageStore) {
     
    //创建MappedFileQueue
    this.mappedFileQueue = new MappedFileQueue(defaultMessageStore.getMessageStoreConfig().getStorePathCommitLog(),
        defaultMessageStore.getMessageStoreConfig().getMapedFileSizeCommitLog(), defaultMessageStore.getAllocateMappedFileService());
    this.defaultMessageStore = defaultMessageStore;
    // 默认是异步刷盘FlushDiskType.ASYNC_FLUSH
    if (FlushDiskType.SYNC_FLUSH == defaultMessageStore.getMessageStoreConfig().getFlushDiskType()) {
     
        this.flushCommitLogService = new