RealityKit Blendshapes

Hello,

Recent additions to RealityKit 2 look really great!

I have an app that uses SceneKit to animate 3d models with face tracking. My SceneKit Models contains Blendshapes.

I was wondering if it was possible to convert my App to RealityKit (I have performance issues with SceneKit since iOS 14).

For that I need to know:

  • If USDZ can contain blend shapes. I see in USD Python tools 0.64 that BlendShape support had been added but I have not been able to verify if my converted model contained the blenshapes.
  • If RealityKit can access and modify those blendshapes? I don't see a way to do it actually (nothing that look like SCNMorpher).

Thank you for your insights. Gil

Up vote post of Gil Down vote post of Gil
1.4k views
Posted by
Gil
Reply
Add a Comment

Replies

Hi Gil, unfortunately we do not support blend shapes right now. However, our team is aware that this is a highly requested feature.

Posted by
Graphics and Games Engineer
Post not yet marked as solved Up vote reply of Graphics and Games Engineer Down vote reply of Graphics and Games Engineer

  • Hi, Is it possible in the new (wwdc23) reality composer pro?

    —
    amir-aharon-cg

  • hi, I am also interested in this topic! How can we have access to morphs in USDZ file to use them in visionOS?

    —
    frankVisztra

  • Hi, Any updates on blend shapes support for RealityKit ?

    —
    amir-aharon-cg