For those following the official setup here:
https://developer.apple.com/metal/tensorflow-plugin/
And then trying to run the test code, you will need to make an instance of the legacy optimizer:
from tensorflow.keras.optimizers.legacy import Adam
adam = Adam()
And then use that created instance instead of the string "Adam":
model.compile(optimizer=adam, loss=loss_fn, metrics=["accuracy"])