How to sync ARFrame & ARFaceAnchor geometry ?

Question

Created Apr ’21

Replies 2

Boosts 0

Participants 2

Hi,
I'm using ARSCNView's delegate(ARSCNViewDelegate) to receive SCNNode(ARSCNFaceGeometry) updates.

I've observed cases where the face geometry (blink detection) misses by 1 frame.

I detect this case by visually comparing the image and the mesh in the method:

Code Block  renderer(_ renderer: SCNSceneRenderer, didUpdate node: SCNNode, for anchor: ARAnchor)

I pull the ARFrame from (renderer as?ARSCNView).session.currentFrame

My question is:
Is it guarantied that the session.currentFrame in the renderer:didUpdate scope to be always in sync with the face geometry?

I suspect a potential problem here since the geometry is being "pushed" while the current frame is being "pulled".

Boost

Answer 1

wonkieun OP

Jul ’22

I have a same problem, did you resolve it?

0

Answer 2

amir-aharon-cg OP

Jul ’22

Yes. Here is apple response via the DTS:

"To get ARFaceGeometry that matches the capturedImage of the currentFrame, you should get the face geometry from the anchors of the currentFrame (rather than a SceneKit delegate method). The anchors on the currentFrame correspond with the capturedImage of the currentFrame."

0