I too am seeing the issue on tf-metal 0.3.0 and tf-macos 2.7. on OSX 12.0.1
An important attribute of this issue is that it crashes on a 2019 16" MBP w/discrete GPU. I have an M1 mac mini and it runs fine on that platform.
As others have pointed out, other optimizers (SGD, Rmsprop) are fine and do not crash.