Parquet 向量化读源码分析

ColumnDescriptor.java

Describes a column’s type as well as its position in its containing schema.

在这里插入代码片

VectorizedParquetRecordReader.java

VectorizedParquetRecordReader 类内使用了 VectorizedColumnReader

public class VectorizedParquetRecordReader extends SpecificParquetRecordReaderBase<Object> {
  // TODO: make this configurable.
  private static final int CAPACITY = 4 * 1024;

  /**
   * Batch of rows that we assemble and the current index we've returned. Every time this
   * batch is used up (batchIdx == numBatched), we populated the batch.
   */
  private int batchIdx = 0;
  private int numBatched = 0;

  /**
   * For each request column, the reader to read this column. This is NULL if this column
   * is missing from the file, in which case we populate the attribute with NULL.
   */
  private VectorizedColumnReader[] columnReaders;

  /**