Same problem here with a brand new MBP2021 14 M1 Pro. I'm very disappointed. I was using a MBP2015 13, and it was reliable, the reason why so many musicians like macOS.
After trying a lot of tricks (safe mode, relaunch of coreaudio, setting audio rate to 48kHz...etc.), I finally found one that seems to work on my computer: Switching off “Set date and time automatically” in System Preferences.
https://cdm.link/2019/02/apple-2018-glitch/
Hope it will help some. But hey, Apple, WTF?!?
moli94
Users receive reputation points by contributing quality content to the forums.
Posts include post and replies published on the forums.
Post authors can mark replies as Accepted to indicate successful solutions.
Apple Developer Forums admins can mark replies as Apple Recommended to indicate an approved solution