Unprojecting color image into MeshAnchors

Question

Created Jun ’20

Replies 1

Boosts 0

Participants 2

Like answered on previous question.

[If you want to color the mesh based on the camera feed, you could do so manually, for example by unprojecting the pixels of the camera image into 3D space and color the according mesh face with the pixel's color.]

Could you be able to give some hint how to solve this?

I'm not really familiar with this concept.

Boost

Answer 1

Vision Pro Engineer OP

Apple

Jun ’20

Roughly speaking: For every vertex of the mesh you can project it into the camera's image plane and then look up a color for that vertex in the camera image. SceneKit has a projectPoint(_:) method to do that. In RealityKit there is a corresponding project() method.

0