Xcode keeps asking me to login to GitHub when I add packages. It happens over and over, and never allows me to add a package from a GitHub URL

I try and add a new package.

After that, it asks for my personal access token. Which I correctly enter.

And then it repeats. I don't know how to get it to stop. I've noticed it has gone away. But each time I go to add a package I can almost guarantee I'll spend an hour trying to add