Totally,I have spend almost 4-5 days for this procedure.
There is two way to install cuda and nvidia.
1\ seperate the installation of Nvidia Driver and CUDA toolkit.
Because CUDA toolkit contains Nvidia Driver installation,so if you have installed Nvidia Driver before you are going to install CUDA,you need to unintall Driver or unselect the "Driver" in the CUDA Installation procedure.What i recommend is unselect it .
As mentioned in this blog:https://www.pugetsystems.com/labs/hpc/How-To-Install-CUDA-10-1-on-Ubuntu-19-04-1405/
after install CUDA without Driver selected,you need to set PATH environment.
I choose to append this three lines to ~/.bashrc:
export PATH=$PATH:/usr/local/cuda-11.0/bin
export CUDADIR=/usr/local/cuda-11.0
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda-11.