How to debug HandTrackingProvider.

Hi everyone,

I'm trying to make some app using HandTrackingProvider to monitor hand gestures in immersive world and move objects in the space.

I know the HandTrackingProvider class is for visionOS only, not for iOS or any other Apple OS.
https://developer.apple.com/documentation/arkit/handtrackingprovider

For now, the visionOS simulator can not use cameras, how can I debug hand trackings? I'm working on Apple's sample code "Happy Beam" now.
https://developer.apple.com/documentation/visionos/happybeam

Anyone have genius technics to solve this?
Or there is any workaround?
Any idea will be appriciated.

Thank you!
Yos

Post not yet marked as solved Up vote post of AlohaYos Down vote post of AlohaYos
402 views
Posted by
AlohaYos
Reply
Add a Comment

Replies

I found these two classes have similar concept.

  • VNDetectHumanHandPoseRequest (VisionKit)
  • HandTrackingProvider (visionOS)

So I use sample code "DetectingHandPosesWithVision" to make spatial gestures on my iPad using VNDetectHumanHandPoseRequest class.
https://developer.apple.com/documentation/vision/detecting_hand_poses_with_vision

After making some gestures on iPad, I will port them onto visionOS using HandTrackingProvider class. This is not a workaround. But I think it is the only way to make spatial gestures now.

Posted by
AlohaYos
Post not yet marked as solved Up vote reply of AlohaYos Down vote reply of AlohaYos
Add a Comment