User Profile

I am running into an issue mainly on my CI, but the issue is present either way. I have a project with multiple Swift Packages as dependancies, most are remote but i have a couple that are local swift packages. On first load of xcode, it will fail to fetch the local packages, if i keep xcode open, around 10 minutes later, it will automatically try and fetch the packages but this time will succeed. Has anybody had this issue? Apart from deploying these packages remotely, is there any other solutions? xcode 13, 13.1, 13.2 all tried and have the same behaviour. Thanks!