How can I create a multi-input model using CreateML?

Let's say I would like to build a classification model to recognise plants. Two plants may look identical but differ by region or month of growth, so I would like to build a multi-input model that accepts not only an image, but also additional metadata, such as the month and location where the photo was taken.

Inputs:

  • imageOfPlant: Image
  • month: Double
  • latitude: Double
  • longitude: Double

Output:

  • speciesName: [String] // sorted by probability, like default image classification

Can this be done in CreateML, or using Apple frameworks in general?

Replies

Though its not thoughly documented, you should take a look at CreateML Components.

Or you can try building a model from Tensorflow with Keras and converting it to a CoreML model file