Our current version of Cert-Manager does not uninstall
cleanly, and we must manually remove custom resource
definitions.