ARFace eyes detection for eyeballs

Hi, I am currently developing and working on 3D character talking heads like Animojis, I am wondering how to track and get information about eyeballs? I can track head orientation, there is iPhone camera position, and blendshapes in relation to eyes, but is there special attributes that tells where the eyesballs should look at?


Thanks.

Accepted Reply

I think I might figure it out. Blendshapes coefficient kind of giving this information for eyes pupil rotation!


  • Eye Look Up - Eye Look Down
  • Eye Look Out - Eye Look In
  • For both Left and Right eyes


Very likely can be translated to rotation of eyeballs of 3D characters.


Thanks Apple AR team!

Replies

So I saw this demo of iPhone X Facial Animation and the artist seems able to capture eye tracking, perhaps using OpenCV method in Swift?

https://uploadvr.com/using-iphone-x-maya-quick-cheap-facial-capture/

I think I might figure it out. Blendshapes coefficient kind of giving this information for eyes pupil rotation!


  • Eye Look Up - Eye Look Down
  • Eye Look Out - Eye Look In
  • For both Left and Right eyes


Very likely can be translated to rotation of eyeballs of 3D characters.


Thanks Apple AR team!