RealityKit iPhone camera lens

Question

Created Feb ’21

Replies 1

Boosts 0

Participants 2

Which camera lens does the iPhone use when running RealityKit?

I am asking because someone on a blog stated that the iPhone uses the telephoto lens for depth mapping. Obviously, not all iPhone have a telephoto lens. So either this is not true, or reality kit uses different lenses depending on the device.

Boost

Answer 1

Todd2 OP

Mar ’21

I don't know if Apple will answer this, but from my experience using a number of devices I suspect Apple uses a combination of

Standard wide lens
Ultra wide lens
LiDAR sensor

and merges all this data to understand the world around it and the device's location in that world. The more combination of sensors Apple can leverage on a given device, the more effective the tracking is, so the better the experience is.

A device with a single standard wide lens will do (but you do need to move the device side-to-side to help it triangulate depth). Wide + Ultra wide lens is better. Wide + Ultra wide + LiDAR is pretty sweet.

0