No object detection on visionOS?

I recently had a chat with a company in the manufacturing business. They were asking if Vision Pro could be used to guide maintenance workers through maintenance processes, a use-case that is already established on other platforms. I thought Vision Pro would be perfect for this as well, until I read in this article from Apple that object detection is not supported:

https://developer.apple.com/documentation/visionos/bringing-your-arkit-app-to-visionos#Update-your-interface-to-support-visionOS

To me, this sounds like sacrificing a lot of potential for business scenarios, just for the sake of data privacy. Is this really the case, i.e. is there no way to detect real-world objects and place content on top of them? Image recognition would not be enough in this use-case.

Is this really the case, i.e. is there no way to detect real-world objects and place content on top of them?

Correct, there is no way to do this on visionOS, please file an enhancement request for this functionality using [Feedback Assistant]<https://developer.apple.com/bug-reporting/>.

visionOS's ARKit offers MeshAnchor.

You can then get the MeshAnchor vertices simply into a point cloud. Next, you need an algorithmic means of calculating the information required for your application, such as: Shape, size, position and orientation of objects in the point cloud.

We have developed such a software library. We are willing to make this available to visionOS developers through Apple if Apple agrees.

Currently, the geometries that can be extracted and measured from point clouds in real time with the highest accuracy according to ISO 10360-6 are planes, spheres, cylinders, cones and rings.

Now we can overlay any virtual information on and around the surfaces of object planes, spheres, cylinders, cones and rings that exist in the real world.

Heat Pump System - Apple iPad Pro LiDAR https://youtu.be/9QkSPkLIfWU

I'm wondering the same thing. It should be a top priority to get object detection support to enable truly useful apps. Otherwise most application that can be created are 2D ports into a 3d world and games.

No object detection on visionOS?
 
 
Q