I confirm this bug upon upgrading from Catalina to Big Sur. It's crazy annoying. Hitting Return instead of Delete seems to me the best solution. The "slow Delete" also works, but risks a repetitive Delete that erases more than you intended. One hopes that Apple will quickly fix this regression.