Have you managed to get anywhere with this. I am having exactly the same issue and cannot find a way to enable the the correct permissions:
I have tried:
tccutil reset AddressBook
but I cannot get the system (Ventura 13.0.1) to prompt for permissions and cannot add the permissions in system options, Privacy & Security. This works perfectly well on Monterey 12.6.