CUDA编程实践--cuDNN

NVIDIA® cuDNN is a GPU-accelerated library of primitives for deep neural networks.
cuDNN是一个对DNN的GPU加速库。他提供高度可调整的在DNN中的常用的例程实现。
It provides highly tuned implementations of routines arising frequently in DNN applications:

• 常用语前向后向卷积网络，包括交叉相关。Convolution forward and backward, including cross-correlation
• 前像后向pooling。Pooling forward and backward
• 前向后向softmax。Softmax forward and backward
• 前向后向神经元激活。Neuron activations forward and backward
• Rectified linear (ReLU)
• Hyperbolic tangent (TANH)
• Tensor transformation functions
• LRN, LCN and batch normalization forward and backward

cuDNN’s convolution routines aim for performance competitive with the fastest GEMM (matrix multiply) based implementations of such routines while using significantly less memory.
cuDNN突出可定制的数据布局，支持灵活的维数排序，跨步，4D子区域for 4D张量作为输入输出。
cuDNN features customizable data layouts, supporting flex