Having same issue on my new Macbook Pro 16" 2021. It's very annoying! Neither killing coreaudio, nor changing bit rate or deleting com.apple.audio.* files helped me. Stopping all intel processes not helping neither. Have MacOs Monterey 12.3.1.
When using my AirPods Pro can hear sound cracking too. :(
What other solutions can be helpful?? Please assist.