SoundRecognition causes Input/Output callbacks to have varying Buffer sizes and introduces Glitching

Question

M_Dawgy OP

Created Oct ’24

Replies 4

Boosts 1

Participants 4

Hello,

We have noticed an issue with SoundRecognition that causes glitching with our AudioUnit setup in Smule.

Input and output frame sizes are inconsistent.
Input frame size does not match [AVAudioSession sharedInstance].IOBufferDuration
My best guess is that SoundRecognition influences the input frame size and not the output frame size.

To reproduce use the example app here: https://github.com/MarkoGill/SoundRecognitionBug

Hardware/OS

iPhone 14 Pro on iOS 18 -> Experiences the problem
iPhone 11 on iOS 18 -> Experiences the problem
iPhone 15 on iOS 18 -> Not experiencing the problem

Reproduction Steps

Enable Sound Recognition (Settings > Accessibility > Sound Recognition > On)
Enable a Sound for detection (Sounds > Dog > On)
Open the example app with headset (it routes input to output)
Notice glitching occurs
Check the logs. Record and Playback buffer sizes vary

Example Log:
AU input sample rate: 48000.000000
AU output sample rate: 48000.000000
hardware sample rate: 48000.000000
hardware buffer size: 1104.000000
updated record frame counts:  1024
updated playback frame counts:  1104

Notes:

You can disable Sound Recognition, restart the app, and playback behaves correctly.

Boost

Answer 1

Engineer OP

Apple

Oct ’24

Hello @M_Dawgy, thank you for your post. Our engineering teams need to investigate this issue, as resolution may involve changes to Apple's software. I'd greatly appreciate it if you could open a bug report, include a sysdiagnose, and post the FB number here once you do. Bug Reporting: How and Why? has tips on creating your bug report.

0

Answer 2

M_Dawgy OP

Oct ’24

Here is the requested Bug Report with sysdiagnose

https://feedbackassistant.apple.com/feedback/15387048

0

Answer 3

RezCav OP

2w

We see a similar problem when Voice Commands are enabled.

0

Answer 4

walo OP

16h

We're seeing the same issue, particularly when Vocal Shortcuts is enabled. https://developer.apple.com/forums/thread/769245 (forked your project to extract some other details while testing)

0