In case anyone is still having this problem:
I don't know what causes this, but it in fact relates to the version of the beta. Although my build is not done, the error with segaddr certainly didn't persist. In Xcode 15 Beta 6's Release Notes there is a bug fix in the linker mentioned: https://developer.apple.com/documentation/xcode-release-notes/xcode-15-release-notes#Build-System
Since Xcode 15 includes changes to the linker, this is probably linked (pun intended), to these changes.