How to debug HandTrackingProvider.

Hi everyone,

I'm trying to make some app using HandTrackingProvider to monitor hand gestures in immersive world and move objects in the space.

I know the HandTrackingProvider class is for visionOS only, not for iOS or any other Apple OS.
https://developer.apple.com/documentation/arkit/handtrackingprovider

For now, the visionOS simulator can not use cameras, how can I debug hand trackings? I'm working on Apple's sample code "Happy Beam" now.
https://developer.apple.com/documentation/visionos/happybeam

Anyone have genius technics to solve this?
Or there is any workaround?
Any idea will be appriciated.

Thank you!
Yos

I found these two classes have similar concept.

  • VNDetectHumanHandPoseRequest (VisionKit)
  • HandTrackingProvider (visionOS)

So I use sample code "DetectingHandPosesWithVision" to make spatial gestures on my iPad using VNDetectHumanHandPoseRequest class.
https://developer.apple.com/documentation/vision/detecting_hand_poses_with_vision

After making some gestures on iPad, I will port them onto visionOS using HandTrackingProvider class. This is not a workaround. But I think it is the only way to make spatial gestures now.

How to debug HandTrackingProvider.
 
 
Q