Counting actions with the Action Classifier

Question

Created Jul ’20

Replies 2

Boosts 0

Participants 2

Hello,

Would there be a way that we could take an action, say squatting, and classify the squat down and squat up actions?

Boost

Answer 1

Frameworks Engineer OP

Apple

Jul ’20

This sounds like that you need to differentiate between these two classes: one for squat down->up, and one for up->down. If this is case, you may need to prepare training data for these two classes separately.

1

Answer 2

Frameworks Engineer OP

Apple

Jul ’20

Make sure that your squat down videos only contain the movement from top to down, and your squat up videos only contain the movement from down to top. Make these two separate classes.

Alternatively, you may keep squat as one class for recognition, but use joint coordinates from the body pose to assist the fine-grained judgment. For example, once the model recognizes squat, check the coordinates on hands. If these are higher than coordinates on hips, this is a squat down.

0