AR Kit and the iPhone X

Hi all,


I've been searching since yesterdays announcment of the iPhone X if there will be any way to access the raw vector data produced by the dot projector and depth sensors in the front facing camera? There seems to be a lot of indication in the documentation that the face tracking would be accessable but I'm not sure at what level.


Just wondering if anyone has any more information on this.


Cheers.

Replies

See the Face Tracking with ARKit video (https://developer.apple.com/videos/play/fall2017/601/) and the sample app linked there as a starting point. Apps can access a triangle mesh via ARFaceGeometry or ARSCNFaceGeometry, and 50+ specific feature positions (ARBlendShapeLocation), and the front camera color image. You also have access to the front AVDepthData depth image.

Good info, thanks - are devs allowed to also access the IR camera, as well?