This is also the case for macOS architectures as well.
Both macos-x86_64 and macos-arm64 represent two equivalent library definitions. It seems like using lipo for these combinations might be necessary:
ios-arm64-simulator and ios-x86_64-simulator
ios-arm64-maccatalyst and ios-x86_64-maccatalyst
macos-x86_64 and macos-arm64
What I'm not sure about is how these will end up in the xcframework subfolders.
edit: using lipo is necessary, and is the accepted solution for this.