For me the fix was matching the current version of the tensoflow-macos with tensorflor-metal
If you scroll down here -> https://developer.apple.com/metal/tensorflow-plugin/
You'll reach the "Release" section
And then the compatible tensorflow-macos and metal plugin are there showed, for example in order to use the metal plugin with the version 0.5 you've to manually set the version of tensorflow as 2.9.0
python -m pip install tensorflow-macos==2.90
pip install tensorflow-metal==0.5.0