Understanding Segmentation buffer (ARkit3)

Hi

Trying to gain a better understanding of the new segmentation buffer so I can use it as a mask.

Is this buffer a 24 bit RGB texture or rather 32bit RGBA with the buffer information in the alpha channel?

Replies

Hello,


If you perform a GPU frame capture on an app which has the segmentation frame semantics turned on you will be able to see the pixel formats for each texture.


The segmentation buffer is an R8UNorm (https://developer.apple.com/documentation/corevideo/1563591-pixel_format_identifiers/kcvpixelformattype_onecomponent8?language=objc), and the estimated depth buffer is a depth32Float (https://developer.apple.com/documentation/corevideo/1563591-pixel_format_identifiers/kcvpixelformattype_depthfloat32?language=objc)

Is there any information of the range of the depth data? meters?