Remove projects that were accidentally added?

Nope, this is something you can do with Kyle’s script, it doesn’t need them to run it.

I would refer to https://circleci.com/gh/organizations/:org/settings#projects to get a list of projects where they are the only follower if you are unsure which ones got added.