Point is, it is the private key that xcode looks for for the
certificates that you already have. Since you have a private key, xcode
lists that as a available option for signing. So, its the private
key that you want to delete and not the certi. So go to Keys section in
the keychain access, find the culprit key, and shoot it.