主要用于推理 GitHub - jeng1220/cuGemmProf: A simple tool to profile performance of multiple combinations of GEMM of cuBLAS GitHub - bytedance/lightseq: LightSeq: A High Performance Library for Sequence Processing and Generation CUDALibrarySamples/cuBLASLt at master · NVIDIA/CUDALibrarySamples · GitHub GitHub - mnicely/cublasLt_examples: Complete examples of the cublasLt libraries. More information can be found in Section 3 of the CUBLAS programming guide. https://docs.nvidia.com/cuda/pdf/CUBLAS_Library.pdf or https://docs.nvidia.com/cuda/cublas/index.html GitHub - NVIDIA/FasterTransformer: Transformer related optimization, including BERT, GPT 这个不是,备忘一下而已: https://github.com/NVIDIA/DeepLearningExamples