While AirPlaying, MPVolumeView snaps to different volume when I play my app media

I have an app that plays sound files stored locally. I'm using a single SwiftUI view with a MPVolumeView so the user can control system volume from the player in my app. When I'm playing the sound file on the iPhone, my volume slider operates as expected. When I AirPlay to my AppleTV, the volume slider still works to control the volume, but when I hit play in my app, the volume snaps to a different value, but actual sound volume doesn't change. Control still works. Flipping to control center, I see a volume mismatch between system volume and the MPVolumeView.

Here's the code that I use to put the slider in my app.

    struct VolumeSlider: UIViewRepresentable {
        func makeUIView(context: Context) -> MPVolumeView {
            let vv = MPVolumeView(frame: .zero)
            vv.showsVolumeSlider = true
            vv.setVolumeThumbImage(UIImage() ,for: UIControl.State.normal)
            return vv
        }
        
        func updateUIView(_ uiView: MPVolumeView, context: Context) {
            // No need to update the view in this case
        }
    }

I'm using AVFoundation and AVAudioPlayer to playback the sound file. I'm using MediaPlayer to tell MPNowPlayingInfoCenter the track info and AlbumArt. Audio control via control center works perfectly. Does the same if I target iOS 16 or 17.

Is this a bug with the MPVolumeView or the way I added it to the app?