The problem I have with my Airpods Pro is when answering/making phone calls. What I do is switch the audio to either speaker or phone and then switch it back to my Airpods Pro. It is annoying but we are all participating in the Beta program to get these kind of issues fixed