Here's how to fix that:
Go to developer.apple.com
Open the provision profile
Press Edit in the top right
Press Save without making any changes
Now delete the ~/Library/MobileDevice/Provisioning Profiles folder and let xcode redownload the profiles again.
This worked for me.
I got the solution from: https://twitter.com/vinayakpaul/status/1514164659133501441?s=21&t=9iUWlAumS3_s_yC8NFwHMQ