I've noticed the same thing with my Airpods 3, they used to be nearly un-usable for gaming. After using them for listening to music etc on the PC as i worked for a few months, i gamed with them again and i couldn't tell if there was latency at all. The difference was night and day, so i wonder if the Apple chip learns over time and stores the data to improve the connection.