I have the same issue but only if I try to add a LTCCell to my model.
model = Sequential()
model.add(RNN(ltc_cell, return_sequences=False, input_shape=(config.num_steps, config.input_size)))
model.add(Dense(128))
model.add(Dense(config.output_size))
model.compile(optimizer=optimizer, loss=loss_function, metrics=['Accuracy'])
model.build()
model.summary()
history = model.fit(train_X, train_y, batch_size=config.batch_size, epochs=config.init_epoch,
verbose=verbosity_mode)
When I delete the Metal plugin I can train my network but it would take forever. For a LTCCell with 64 inter_neurons and 32 motor_neurons the estimated time is 2 hours per Epoch.
M1 MacBook Pro, 8 GB, tensorflow-macos 2.7, metal plugin 0.3.0, Python 3.9.