Unprojecting color image into MeshAnchors

Like answered on previous question.

[If you want to color the mesh based on the camera feed, you could do so manually, for example by unprojecting the pixels of the camera image into 3D space and color the according mesh face with the pixel's color.]

Could you be able to give some hint how to solve this?

I'm not really familiar with this concept.
Up vote post of HeoJin Down vote post of HeoJin
810 views
Posted by
HeoJin
Reply
Add a Comment

Replies

Roughly speaking: For every vertex of the mesh you can project it into the camera's image plane and then look up a color for that vertex in the camera image. SceneKit has a projectPoint(_:) method to do that. In RealityKit there is a corresponding project() method.



Posted by
Frameworks Engineer
Up vote reply of Frameworks Engineer Down vote reply of Frameworks Engineer
Add a Comment