Activity classification from APIs, not from Create ML GUI

Question

Created Jun ’20

Replies 4

Boosts 0

Participants 5

Is it possible to work directly with the API for human activity classification *without* using Create ML (which I believe requires Big Sur)? In other words, can I use the APIs directly instead, this was possible with the first iteration of Create ML.

Answered by Engineer in 614206022

Hi,

You can train a model directly via API using the Create ML framework.

https://developer.apple.com/documentation/createml

The newly introduced video based Action Classification template (in the app) and corresponding MLActionClassifier class (in framework) are only available on Big Sur.

The motion sensor based Activity Classification template (in the app) and corresponding MLActivityClassifier (in framework) introduced last year are available in Catalina.

Boost

Answer 1

Developer Tools Engineer OP

Apple

Jun ’20

The Create ML app ships on both Catalina and Big Sur. The Activity Classification template shipped with Catalina and is supported in Big Sur as well.

New for Big Sur is the Action Classification template. This is supported only on Big Sur and is trainable either via the Create ML app or the Create ML framework on Big Sur only.

2

Answer 2

Engineer OP

Apple

Jun ’20

Accepted Answer

Hi,

You can train a model directly via API using the Create ML framework.

https://developer.apple.com/documentation/createml

The newly introduced video based Action Classification template (in the app) and corresponding MLActionClassifier class (in framework) are only available on Big Sur.

The motion sensor based Activity Classification template (in the app) and corresponding MLActivityClassifier (in framework) introduced last year are available in Catalina.

3

Answer 3

Developer Tools Engineer OP

Apple

Jun ’20

You will need to use Big Sur to train an action classifier model using the CreateML App or the CreateML Framework.

The action classifier model produced by CreateML is best experienced on iOS 14.0 and Big Sur, in combination with the Vision API's Body Pose Estimation feature.

If you want to provide your own function to compute Body Pose data, you can even use the action classifier model on iOS 13 and macOS Big Sur.

0

Answer 4

Frameworks Engineer OP

Apple

Jun ’20

Which API are you talking about specifically? If you mean Vision's body pose API, it is only available since Big Sur. If you mean the Create ML "Action Classification" API, it is also available since Big Sur.

Once you are on Big Sur, you may either use Create ML App (no code needed) to train, or use Create ML framework (you need to write Swift code): https://developer.apple.com/documentation/createml/mlactionclassifier

0