[visionOS] How to render side-by-side stereo video?

Spatial Computing Reality Composer Pro
msid_goog OP
Created 6d
Replies 0
Boosts 0
Views 152
Participants 1

I want to render a 3d/stereoscopic video in an Apple Vision Pro window using RealityKit/RealityView. The video is a left-right stereo. The straight forward approach would be to spawn a quad, and give it a custom Shader Graph material, which has a CameraIndexSwitch. The CameraIndexSwitch chooses between the right texture vs the left texture.

https://i.sstatic.net/XawqjNcg.png

The issue I have here is that I have to extract the video frames from my AVSampleBufferVideoRenderer. This should work ok, but not if I'm playing FairPlay content.

So, my question is, how to render stereo FairPlay videos in a SwiftUI RealityView?

Replies  0
Boosts  0
Views  152
Participants  1
[visionOS] How to render side-by-side stereo video?
First post date Last post date
 
 
Q