Can't remove repos that no longer exist in GitHub?

I had a public GitHub repo that I either renamed / transferred ownership of, but it still shows up in my CircleCI account. Unfortunately, I can not remove it or modify any of the settings for ghost copy of the repo.