We have the same problem at our company with over more than 1000 testers. Lots of whom get the message 'tester removed' when we launch a new build to test. We can indeed add them again in Testflight but it creates a lot of extra work for us and frustrating at the testers side.
Hope someday there will be an explanation or solution.