Creating Shared Experiences in Physical Locations

Hello everyone, I'm working on developing an app that allows users to share and enjoy experiences together while they are in the same physical locations. Despite trying several approaches, I haven't been able to achieve the desired functionality. If anyone has insights on how to make this possible or is interested in joining the project, I would greatly appreciate your help!

Answered by JoonAhn in 802193022

AVP is a spatial computer seamlessly blending digital content with the physical space around you. For spatial computing, the physical space must be defined accurately and speedy. FindSurface determines the shapes, sizes, and 6DoF poses of your physical space from 3D measurement points including MeshAnchors of AVP. Once the shapes, sizes, and 6DoF poses of your physical space are detemined, you can everything, e.g., you can view photos and videos wrapped around your physical surfaces.

FindSurface Real-Time 1 - Apple Vision Pro https://youtu.be/2aSMBrPTEtg

FindSurface Real-Time Preview - Apple Vision Pro https://youtu.be/CGjhfKxjpUU

Accepted Answer

AVP is a spatial computer seamlessly blending digital content with the physical space around you. For spatial computing, the physical space must be defined accurately and speedy. FindSurface determines the shapes, sizes, and 6DoF poses of your physical space from 3D measurement points including MeshAnchors of AVP. Once the shapes, sizes, and 6DoF poses of your physical space are detemined, you can everything, e.g., you can view photos and videos wrapped around your physical surfaces.

FindSurface Real-Time 1 - Apple Vision Pro https://youtu.be/2aSMBrPTEtg

FindSurface Real-Time Preview - Apple Vision Pro https://youtu.be/CGjhfKxjpUU

Once you know the shapes, sizes, and 6DoF poses of the physical object surfaces (e.g. floors, walls, pillars, etc.) around you, a set of permanent stable ObjectAnchors can be established by exchanging and comparing them.

Hi @DDrGuis333

It sounds like you are looking for something similar to Collaborative Sessions which is not supported on visionOS. If I'm correct, I encourage you to file a feature request using feedback assistant.

In the meantime you can use image or object tracking to establish a common reference point for all the participants and place content relative to the tacked image or tracked object. Here are 2 articles that cover each API.

Creating Shared Experiences in Physical Locations
 
 
Q