We have a working example here:
https://github.com/fbriggs/lifecast_public/blob/main/web/lifecast_res/LifecastVideoPlayer11.js#L538
Note the texture needsUpdate = true part.
In addition to this, it is necessary to wait for a user input (pinch) after entering the immersive session.
removeEventListener("pause", .. didn't work for us.