One way to bypass this enormous issue, which unfortunately will only apply to fairly specific use cases, but provide releif for some, is to use the iOS app BitPerfect, the app integrates with iTunes (Music) to ensure bit-perfect playback of audio files. When this app is running and doing it's thing increased CPU load will no longer cause pops and cracks in the audio stream.
Nothing else I've tried has come close to actually fixing the problem.
NOTE:
The app needs some updates, can be buggy on up-to-date OS, can freeze Music and BitPerfect altogether sometimes requiring restart, this seems to occur when switching between audio output devices.