from iOS & iPadOS 16 Beta 3 Release Notes
It saids to use a device with A12 or A13 but iPad Pro 12.9 (4th Generation) can't detect persons.
I tested with the ARKit replay data that can be captured the person
- detected (tested on iPhone 13 Pro Max with iOS 15.5)
- not detected (tested on iPad Pro 12.9 Gen4 with iOS 16 beta 3)
Tested with BodyDetection Project
Log
2022-07-10 17:27:27.153899+0700 BodyDetection[3026:1192001] Metal GPU Frame Capture Enabled
2022-07-10 17:27:27.154031+0700 BodyDetection[3026:1192001] Metal API Validation Enabled
2022-07-10 17:27:27.229646+0700 BodyDetection[3026:1192001] [Foundation.IO] Could not locate file 'default-binaryarchive.metallib' in bundle.
2022-07-10 17:27:27.497224+0700 BodyDetection[3026:1192001] [ECS.Core] Class for component AccessibilityComponent already registered
2022-07-10 17:27:27.592351+0700 BodyDetection[3026:1192001] [AssetTypes] Registering library (/System/Library/PrivateFrameworks/CoreRE.framework/default.metallib) that already exists in shader manager. Library will be overwritten.
2022-07-10 17:27:27.870551+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/suFeatheringCreateMergedOcclusionMask.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.908466+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/arKitPassthrough.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.910532+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/drPostAndComposition.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.911679+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/arSegmentationComposite.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.912939+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/arInPlacePostProcessCombinedPermute0.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.914706+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/arInPlacePostProcessCombinedPermute1.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.915377+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/arInPlacePostProcessCombinedPermute2.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.927888+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/arInPlacePostProcessCombinedPermute3.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.928700+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/arInPlacePostProcessCombinedPermute4.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.929341+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/arInPlacePostProcessCombinedPermute5.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.929987+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/arInPlacePostProcessCombinedPermute6.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.930610+0700 BodyDetection[3026:1192001] [Assets] Resolving material name 'engine:BuiltinRenderGraphResources/AR/arInPlacePostProcessCombinedPermute7.rematerial' as an asset path -- this usage is deprecated; instead provide a valid bundle
2022-07-10 17:27:27.931604+0700 BodyDetection[3026:1192001] [Foundation.Serialization] Json Parse Error line 18: Json Deserialization; unknown member 'EnableARProbes' - skipping.
2022-07-10 17:27:27.931645+0700 BodyDetection[3026:1192001] [Foundation.Serialization] Json Parse Error line 20: Json Deserialization; unknown member 'EnableGuidedFilterOcclusion' - skipping.
2022-07-10 17:27:28.099950+0700 BodyDetection[3026:1192001] [] [17:27:28.099] captureSourceRemote_SetProperty signalled err=-16452 (kFigCaptureSourceError_SourceNotLocked) (Source must be locked for configuration to set properties) at FigCaptureSourceRemote.m:549
2022-07-10 17:27:28.100896+0700 BodyDetection[3026:1192001] [] [17:27:28.101] captureSourceRemote_SetProperty signalled err=-16452 (kFigCaptureSourceError_SourceNotLocked) (Source must be locked for configuration to set properties) at FigCaptureSourceRemote.m:549
2022-07-10 17:27:28.526246+0700 BodyDetection[3026:1192297] ⛔️⛔️⛔️ ERROR [MOVReaderInterface]: Error Domain=com.apple.AppleCV3DMOVKit.readererror Code=9 "CVAUserEvent: Error Domain=com.apple.videoeng.streamreaderwarning Code=0 "Cannot grab metadata. Unknown metadata stream 'CVAUserEvent'." UserInfo={NSLocalizedDescription=Cannot grab metadata. Unknown metadata stream 'CVAUserEvent'.}" UserInfo={NSLocalizedDescription=CVAUserEvent: Error Domain=com.apple.videoeng.streamreaderwarning Code=0 "Cannot grab metadata. Unknown metadata stream 'CVAUserEvent'." UserInfo={NSLocalizedDescription=Cannot grab metadata. Unknown metadata stream 'CVAUserEvent'.}} ⛔️⛔️⛔️
2022-07-10 17:27:29.129011+0700 BodyDetection[3026:1192297] ⛔️⛔️⛔️ ERROR [MOVReaderInterface]: Error Domain=com.apple.AppleCV3DMOVKit.readererror Code=9 "CVAUserEvent: Error Domain=com.apple.videoeng.streamreaderwarning Code=0 "Cannot grab metadata. Unknown metadata stream 'CVAUserEvent'." UserInfo={NSLocalizedDescription=Cannot grab metadata. Unknown metadata stream 'CVAUserEvent'.}" UserInfo={NSLocalizedDescription=CVAUserEvent: Error Domain=com.apple.videoeng.streamreaderwarning Code=0 "Cannot grab metadata. Unknown metadata stream 'CVAUserEvent'." UserInfo={NSLocalizedDescription=Cannot grab metadata. Unknown metadata stream 'CVAUserEvent'.}} ⛔️⛔️⛔️
Warning (secondary thread): in AppendProperty at line 858 of sdf/path.cpp -- Can only append a property 'preliminary:anchoring:type' to a prim path (/)
Warning (secondary thread): in AppendProperty at line 858 of sdf/path.cpp -- Can only append a property 'triggers' to a prim path (/)
2022-07-10 17:27:30.176576+0700 BodyDetection[3026:1192297] [profiling] ResetStream() : No ops in stream.
Hi chatdep,
With iOS 16, Motion Capture is able to track a person's ears. The "Capturing Body Motion in 3D" developer sample is yet to be updated to account for those changes; this is why the model is currently not showing up when running the sample on beta of iOS 16.
However, Motion Capture itself is working again in Beta 3. You can verify this by looking at the session(:didUpdate:) callback: When running the sample and pointing the device at a person, you should be receiving ARBodyAnchor updates and be able to read out the transforms for each joint.