Cant connect to IOS 14 simulator using GKMatchRequest

I am trying to implement GameKit in SwiftUI using iOS 14.5.

I can connect and retrieve leaderboard on a real physical iPhone and on the simulator. However when I try to connect using GKMatchRequest from physical iPhone to the simulator I get an error. There are no issues when I try to connect from physical to physical phone. Is this a known issue? Is there something I should do that I am not aware of? The odd part is that, as said, physical to physical works fine.

Domain=GKErrorDomain Code=3 "The requested operation could not be completed due to an error communicating with the server." UserInfo={GKServerStatusCode=5030
The requested operation could not be completed due to an error communicating with the server., NSUnderlyingError=0x281bb8db0
No registration for peer

thanks in advance