Incredibly irritating.
Using my own library with a playlist and selecting shuffle in the playlist, every song plays twice.
Introduced at Beta 12.1.3 but looking through the webs it looks like this issue has happened before.
Tried restarting Music: No effect
Tried rebooting phone: No effect