I found the reason I couldn't remove them was because of the permissions in the registry. I tried changing them, but they wouldn't propagate down through the sub keys. It was a big PIA to go through each subkey and take ownership and then change permissions.
In the end, I removed the network card, disabled the onboard nic, and then when I booted up, I was able to easily delete the phantom nics in Device Manager.
