VisionOS used outdoors? Is 2D video streaming standard with AVP?

Question

Created Jun ’23

Replies 2

Boosts 0

Participants 3

This Video (https://youtu.be/TX9qSaGXFyg?t=134) seems to show that someone is watching a 3D video made BY the Apple Vision Pro while they were outside.

Most VR googles don't do well outdoors, or so I understand. Is this not the case with the AVP? What are the limitations?

Also, my understanding is that the above video was done entirely via a VisionPro device, both the shots of the person wearing the device, and the shots of what it looks like from their perspective as they use it.

Is that correct? If so, will 2D video streaming be standard with AVP upon release?

If not, it should be, or at least an available upgrade. The use-cases for 2D video streaming of the AVP's POV are too numerous to list:

e.g.

youtube videos/live streaming; news broadcasts (indoor at least, depending on the outdoor usability), educational lectures (think Robert Reich illustrated lectures (https://www.youtube.com/watch?v=7NxRqCDvIr8) using all the tools of AR/VR rather than pen and paper),

If Facetime avatars can be taken out of the box, then a newscaster could place their avatar within the the scene that the are reporting from a safer distance than might otherwise by possible.

etc

Boost

Answer 1

Saijanai OP

Jun ’23

I misunderstood what was said here: https://youtu.be/DgLrBSQ6x7E?t=4162

The external video was normal film apparently. EVen so, if a 2D video representation of what the wearer sees can be streamed to someone else for projection or use on youtube or in TV news for that matter, that's an entire ecosystem of use-cases that are opened up.

0

Answer 2

brandonK212 OP

Jun ’23

The YouTube video, at the timestamp you provided, seems to be demonstrating someone playing back a video captured on an Apple Vision Pro, using the 3D video capture functionality. As was mentioned in the Create a Great Spatial Playback Experience and Deliver Video Content for Spatial Experiences, you can create video playback of 2D or 3D video using an AVPlayerViewController or a RealityKit entity that contains a VideoPlayerComponent component. Traditional 2D video can be played back in likely the same supported formats that AVPlayerViewController currently supports, or in the MV-HEVC format for video that contains depth.

Apple Vision Pro does not provide developers directly access to the cameras on the device. While you can consume and watch livestreams on the device using the video playback mechanisms in those WWDC sessions, livestreaming what Apple Vision Pro sees is not possible.

0