delete linux kernel compiled by yourself

sudo rm -rf /lib/modules/{kernel_version}
sudo rm -rf /usr/src/linux-headers-{kernel_version}
sudo rm /boot/*{kernel_version}*
sudo rm /var/lib/dpkg/info/linux-headers-{kernel_version}*
sudo update-grub

To avoid the problem while using update-initramfs -u, you need

sudo rm -rf /var/lib/initramfs-tools/{kernel_version}