Not sure if this related. My project doesn't need CoreAudioTypes frameworks but it complaints anyway. My project able to build for iOS but throw this similar error for tvOS.
It turns out that 2 of my swift files that are shared between iOS and tvOS, they're importing iOS specific lib. In my case, UIImpactFeedbackGenerator and UISelectionFeedbackGenerator. All I did was to guard the import and implementing with #if os(iOS) and the errors went away.