Same here, running on macOS 12 beta 5. tensorflow metal is much slower. Although it seems to have better accuracy.
I'm new to tensorflow and maybe I'm not doing it right? Or maybe it is just another bogus "feature" of mac?
On cpu:
1875/1875 [==============================] - 1s 371us/step - loss: 0.5217 - accuracy: 0.8446
Epoch 2/5
1875/1875 [==============================] - 1s 353us/step - loss: 0.1890 - accuracy: 0.9428
Epoch 3/5
1875/1875 [==============================] - 1s 362us/step - loss: 0.1459 - accuracy: 0.9555
Epoch 4/5
1875/1875 [==============================] - 1s 353us/step - loss: 0.1301 - accuracy: 0.9616
Epoch 5/5
1875/1875 [==============================] - 1s 353us/step - loss: 0.1194 - accuracy: 0.9623
on GPU:
1875/1875 [==============================] - 8s 4ms/step - loss: 0.2965 - accuracy: 0.9130
Epoch 2/5
1875/1875 [==============================] - 7s 4ms/step - loss: 0.1405 - accuracy: 0.9588
Epoch 3/5
1875/1875 [==============================] - 7s 4ms/step - loss: 0.1046 - accuracy: 0.9680
Epoch 4/5
1875/1875 [==============================] - 7s 4ms/step - loss: 0.0861 - accuracy: 0.9733
Epoch 5/5
1875/1875 [==============================] - 7s 4ms/step - loss: 0.0743 - accuracy: 0.9761