Replaced Apple TV and my new one is showing up as missing in home app

When the first betas offered Apple TV in the HomeKit, my family room AppleTV just got replaced and now it showing as missing and not responding in the whole map even though I don’t have it anymore.