Load AR Experience, LiDAR and environment light

Question

Created Apr ’21

Replies 2

Boosts 0

Views 1k

Participants 2

Hello,

I am working on an AR app. In this app I will make use of Apple's new LiDAR hardware. I make use of ARKit and RealityKit and want to place simple (.usdz) models. Most important is that I can save the data and recreate by loading the AR experience later on. There is not much demo material and documentation on this subject available. I've studied the examples:

Visualising and Interacting with a Reconstructed Scene,
Saving and Loading World Data,
and many more.

At the moment I can save and load the data but there is something wierd. It seems that I need the same lightning environment/sources to recreate the scene. Otherwise it will not work. When using LiDAR I thought that environment lightning is not important at all. I know that you needed light in the past to use PlaneDetection. Am I doing something wrong or are there special settings I need use? Apple support has no answer on this subject, so I hope that someone can help me out.

Thanks,

Marc

Boost

Answer 1

DTS Engineer OP

Apple

Apr ’21

At the moment I can save and load the data but there is something wierd. It seems that I need the same lightning environment/sources to recreate the scene. Otherwise it will not work. When using LiDAR I thought that environment lightning is not important at all. I know that you needed light in the past to use PlaneDetection. Am I doing something wrong or are there special settings I need use?

The approach demonstrated in "Saving and Loading World Data" is the recommended approach. There is no special setting related to this feature. ARWorldMaps are reliant on feature points, and even on LiDAR devices, environment lighting is still important.

You should file an enhancement request using Feedback Assistant to request that re-localization be improved when the environment lighting has changed.

1

Answer 2

MarcieMarc OP

Apr ’21

I've placed the request in the Feedbac Assistant. Thanks.

1