Try rebooting your router/networking equipment. Pairing and connecting with the AppleTV happens over Bonjour/mDNS and sometimes that can get into a bad state with multiple entries for the same device.
I had gotten into the same bad state where the pairing process never completed. Tried rebooting the TV and my Mac with no help. Everything started working as expected when I restarted my router.