RealityKit stop tracking object when it leaves camera view

I would like to stop tracking an object that has been anchored with AnchorEntity(.object(group: "AR Resources", name: "obj")) when the camera pans away from it.

I almost want to the remove the anchor from ARView.scene.anchors? But I am not sure what the best way to d that is. It might be in one of the following:
func session(_ session: ARSession, didUpdate anchors: [ARAnchor])
or
func session(_ session: ARSession, didAdd anchors: [ARAnchor])


Thanks in advance for the help!