conda remove removes a package from an environment. To remove the environment you need to use conda env remove -n test_env