How to debug HandTrackingProvider.

Question

AlohaYos OP

Created Jul ’23

Replies 1

Boosts 1

Participants 1

Hi everyone,

I'm trying to make some app using HandTrackingProvider to monitor hand gestures in immersive world and move objects in the space.

I know the HandTrackingProvider class is for visionOS only, not for iOS or any other Apple OS.
https://developer.apple.com/documentation/arkit/handtrackingprovider

For now, the visionOS simulator can not use cameras, how can I debug hand trackings? I'm working on Apple's sample code "Happy Beam" now.
https://developer.apple.com/documentation/visionos/happybeam

Anyone have genius technics to solve this?
Or there is any workaround?
Any idea will be appriciated.

Thank you!
Yos

Boost

Answer 1

AlohaYos OP

Jul ’23

I found these two classes have similar concept.

VNDetectHumanHandPoseRequest (VisionKit)
HandTrackingProvider (visionOS)

So I use sample code "DetectingHandPosesWithVision" to make spatial gestures on my iPad using VNDetectHumanHandPoseRequest class.
https://developer.apple.com/documentation/vision/detecting_hand_poses_with_vision

After making some gestures on iPad, I will port them onto visionOS using HandTrackingProvider class. This is not a workaround. But I think it is the only way to make spatial gestures now.

1