【dpdk】NVIDIA MLX5 Compress Driver

From

3. NVIDIA MLX5 Compress Driver — Data Plane Development Kit 23.11.0 documentation (dpdk.org)

1. NVIDIA MLX5 Compress Driver

Note

NVIDIA acquired Mellanox Technologies in 2020. The DPDK documentation and code might still include instances of or references to Mellanox trademarks (like BlueField and ConnectX) that are now NVIDIA trademarks.

The mlx5 compress driver library (librte_compress_mlx5) provides support for NVIDIA BlueField-2, and NVIDIA BlueField-3 families of 25/50/100/200/400 Gb/s adapters.

1.1. Design

This PMD is configuring the compress, decompress amd DMA engines.

GGAs (Generic Global Accelerators) are offload engines that can be used to do memory to memory tasks on data. These engines are part of the ARM complex of the BlueField chip, and as such they do not use NIC related resources (e.g. RX/TX bandwidth). They do share the same PCI and memory bandwidth.

So, using the BlueField device (starting from BlueField-2), the compress class operations can be supported in parallel to the net, vDPA and RegEx class operations.

See NVIDIA MLX5 Common Driver guide for more design details.

3.2. Features

Compress mlx5 PMD has support for:

• Compression
• Decompression
• DMA

3.3. Algorithms

3.3.1. NULL algorithm

NULL algorithm is the way to perform DMA operations. It works through either compress or decompress operation.

Shareable transformation.

Checksum generation:

• CRC32, Adler32 and combined checksum.

3.3.2. DEFLATE algorithm

Huffman code type:

• FIXED.
• DYNAMIC.

Window size support:

1KB, 2KB, 4KB, 8KB, 16KB and 32KB.

Shareable transformation.

Checksum generation:

• CRC32, Adler32 and combined checksum.

3.3.3. LZ4 algorithm

Support for flags:

• RTE_COMP_LZ4_FLAG_BLOCK_CHECKSUM
• RTE_COMP_LZ4_FLAG_BLOCK_INDEPENDENCE

Window size support:

1KB, 2KB, 4KB, 8KB, 16KB and 32KB.

Shareable transformation.

Checksum generation:

• xxHash-32 checksum.

3.4. Limitations

• Scatter-Gather, SHA and Stateful are not supported.
• Non-compressed block is not supported in compress (supported in decompress).
• Compress operation is not supported by BlueField-3.
• LZ4 algorithm is not supported by BlueField-2.

3.5. Driver options

Please refer to mlx5 common options for an additional list of options shared with other mlx5 drivers.

• log-block-size parameter [int]

  Log of the Huffman block size in the Deflate algorithm. Values from [4-15]; value x means block size is 2x. The default value is 15.

3.6. Supported NICs

• NVIDIA® BlueField-2 SmartNIC
• NVIDIA® BlueField-3 SmartNIC

3.7. Prerequisites

• NVIDIA MLNX_OFED version: 5.2 See mlx5 common prerequisites for more details.