CUDA lazy loading is not enabled

CUDA lazy loading is not enabled.

CUDA lazy loading is not enabled.

Enabling it can significantly reduce device memory usage and speed up TensorRT initialization

Enabling it can significantly reduce device memory usage and speed up TensorRT initialization. See “Lazy Loading” section of CUDA documentation https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#lazy-loading

坑

使用lazy时，CUDA版本要大于11.8