Creating a texture for a SCNGeometry using the ARKit camera?

Much of this question is adapted from the idea of building a SCNGeometry from an ARMeshGeometry, as indicated in this very helpful post by @gchiste.

In my app, I am creating a SCNScene with my scanned ARMeshGeometry built as SCNGeometry, and would like to apply a "texture" to the scene, replicating what the camera saw as each mesh was built. The end goal is to create a 3D model somewhat representative of the scanned environment.

My understanding of texturing (and UV maps) is quite limited, but my general thought is that I would need to create texture coordinates for each mesh, then sample the ARFrame's capturedImage to apply to the mesh.

Is there any particular documentation or general guidance one might be able to provide to create such an output?
Hello Brandon,

Generating texture coordinates for the mesh is quite a difficult task for a variety of reasons. I first recommend that you file an enhancement request using Feedback Assistant, to request api to do this for you.

If you are determined to come up with your own solution, then I suggest that you do some searching for terms like "texture mapping real world objects". You should be able to find research papers that can explain the challenges, and potentially some solutions that you may be able to implement.
Hi @gchiste,

Thank you for your reply! I will file an enhancement request using Feedback Assistant for this topic, requested an API that would provide such functionality. Additionally, thank you for your guidance regarding "texture mapping for real world objects" as a starting point to learn more about this topic. This is exactly what I was looking for, in terms of best understanding the overall topic ahead of me and how to learn about the potential challenges and solutions.

Thank you again!
Hi @brandonK212

I am trying to work around a similar problem. Were you able to achieve the desired results? Can you please help me as to how to achieve this?
Creating a texture for a SCNGeometry using the ARKit camera?
 
 
Q