Difference between GPU and CPU
- GPU cares more about data processing ability while CPU concerns more about flow control and data caching.
- GPU is more excellent at computing compute-intensive and high parellel computation due to it’s architechture.
Introduction to CUDA
CUDA is a general purpost parallel computing platform and programming model that leverages the parallel compute engine in NVIDIA GPUs to solve many complex computational problems in a more efficient way than on a CPU.
Three abstractioin of the core of CUDA
- Thread Hierarchy
- Memory Hierarchy
- Heterogeneous Programming