CreateML Activity Classifier for Hand Pose

Question

Created Jun ’20

Replies 3

Boosts 0

Views 1k

Participants 3

Can CreateMl be used to create a classifier coreML model based on training data for hand poses. For example could I provide training videos of a "wave", "thumbs up" etc into create ML?

Or does create Ml on train body pose data?

Boost

Answer 1

fireatwill OP

Jun ’20

I'm trying to figure out this as well...the video describing how to make classifiers for body poses looks great! Would love to be able to do this for hands as well.

1

Answer 2

fireatwill OP

Jun ’20

I just attempted to make a thumbs up / thumbs down classifier with the "Action Classification" template as shown in the "Build an Action Classifier with Create ML" video and had no luck. It kept trying to use the body pose information instead of the hand pose information. Maybe there's another way to do it? Hopefully we won't have to wait till next year's WWDC.

0

Answer 3

OP

Apple

Jun ’20

You could build a CoreML model on images of hands- thumbs up, thumbs down, open fingers, etc.- and then use the Vision framework to do object recognition in live capture. Here's a good resource on that! https://developer.apple.com/documentation/vision/recognizing_objects_in_live_capture

1