Same issue here on a Macbook Pro M1 with 32 gb of ram and a RME Fireface UFX III.
If I am playing audio from different apps, in example a youtube vide while playing guitar with a VST (standalone, Logic or Bitwig), causes glitches and drops.
The issue seems to appear more ofter if I am moving between desktop with the touchpad gestures.
I read here that Sonoma beta is fixing the issue: https://www.audiosciencereview.com/forum/index.php?threads/audio-stutters-with-usb-dacs-on-macbook-m1-pro.42001/page-15
I didn't personally try but I am tempted because it is pretty annoying.
I tried my same setup (same VST instrument while playing a youtube video) on a windows PC with the same RME Fireface UFX III: zero problem.