Reconstruction saved outdoor ARKit scenes

Question

Created May ’21

Replies 1

Boosts 0

Views 1.1k

Participants 2

Hi,

I am still working on an app to place simple 3D models on different places outdoor. I save the location (World Data) of the environment nearby and load and reconstruct the scene later on. I make use of the latest Apple device (iPhone 12 Pro) with the LiDAR scanner. Strange thing is that often you can't reconstruct the experience. Is the stored (LiDAR) data to accurate so that the scene has to be exactly the same? For example, could it be a problem if a flower leave was broken, so it's imposible to reconstruct?

In my case (example) I've created two seperated scenes. I placed one arrow model (.usdz) on a flowerpot and one on a statue. I saved both, checked by reloading (model was still there) and came back the next day. It was rainy that day. I couldn't reproduce the AR scene around the flowerpot but the statue was no problem. Is there a way to make the scene simpler to recognize? For example, is it better to add horizontal and vertical plane detection besides the meshes? Or change the way of using the world mapping status? Other solution could be: place more models (arrows), so that one of the Anchors should match.

Thanks in advance,

Marc

Boost

Answer 1

Vision Pro Engineer OP

Apple

Jun ’21

Different lighting (like on a sunny versus on a rainy day) indeed affects the chances to successfully relocalize to a previously saved world map.

As your use case involves augmenting specific objects (like a statue or a plant pot), you could give the ARReferenceObject API a try. Unlike an ARWorldMap, which takes the entire surroundings into account, you can create a scan of just the object of interest and then detect it later on (ARKit will add an ARObjectAnchor at the location of the detected object). I recommend checking out the Scanning and Detecting 3D Objects developer sample for more information.

Similar to world map saving and loading, this approach like works best when lighting conditions are consistent during scan and detection. However, it doesn't matter if the environment around the object has changed (such as leaves or rain puddles on the ground), so your overall changes to re-detect the object might be better.

0