Exact same problem added a tester with an email address, deleted them. Came back later and attempted to re-add the tester but connect refuses as the person is already on the team and highlights the email address.
Looks like the web app isnt clearing the database of the sandbox user when removed.