GLB Animation Data Getting Lost in Reality Converter

Hello :),

My name is Alec and I'm experimenting with the USD file format. Here's what I've done:

  1. I used my iPad to take a point scan of my own head (funny I know). I brought the PLY cloud into Blender where I used GeoNodes to instance objects on those points. I also loaded audio into my Blend file because I wanted my head to react to audio
  2. I exported my model into Alembic format (.abc) and exported the animation data as well (.mdd). I followed this video to do it https://www.youtube.com/shorts/awArQyvncmU
  3. I brought the .mdd & .abc back into files back into Blender and rexported as a GLB. AT THIS POINT I KNOW I HAVE A WORKING GLB MODEL AND ANIMATION (see a link to file here. Warning, its 500MB: https://drive.google.com/file/d/15nQ2eIqhFQtHce5EbwH4_pXq-maR3rKo/view?usp=sharing )
  4. I brought the glb file into Reality Converter hoping there would be a seamless conversion to USDZ. For some reason, my animation data is getting lost :(

I don't know what to do. Does anyone know what I might be doing wrong?

Bonus Question: Is it even possible to put audio in a USDZ file in Reality Composer?

Many thanks to everyone out there willing to help!

All the best, Alec

Hi Alec, did you ever find a solution to go from Blender to Reality Converter to retain animations when exporting as GLB?

I've had better luck exporting from Blender to USD or USDC and then loading that into Xcode. AFAIK, there is no blendshape support in RealityKit, You may want to try something joint based.

https://developer.apple.com/documentation/realitykit/validating-usd-files?changes=_3 < feature support comparison

Good news - RealityKit has advanced spatial audio support (and support for embedded audio. Good luck!

GLB Animation Data Getting Lost in Reality Converter
 
 
Q