Using video chat instead of voice chat on online game ?

Question

Created Feb ’24

Replies 2

Boosts 0

Participants 2

Hello, I am building an app that requires players joined to an online game session and to have a video chat with both of their front cameras turned on. I currently know that GameKit supports the voice chat option but could not find any source for video chat. Is it possible set up a video chat on an online game session?. What libraries can I use that have support in implementing the video chat (AVFoundation) ?

Your assistance is greatly appreciated.

Answered by DTS Engineer in 781259022

Hello @Useraugenkunst,

First, I recommend that you file an enhancement request for GameKit to add a video chat API using Feedback Assistant.

Having said that, it is possible to implement this functionality, though it is quite complex, here is a brief outline of steps:

You establish a connection between the two devices (there are several options for this, but probably using Network.framework)
Each device captures a video stream (using AVCaptureSession)
Each device compresses their respective video stream (using VTCompressionSession)
Each device sends their compressed stream to the other device over the connection
Each receiving device decompresses and presents the received stream

Boost

Answer 1

DTS Engineer OP

Apple

Feb ’24

Accepted Answer

Hello @Useraugenkunst,

First, I recommend that you file an enhancement request for GameKit to add a video chat API using Feedback Assistant.

Having said that, it is possible to implement this functionality, though it is quite complex, here is a brief outline of steps:

You establish a connection between the two devices (there are several options for this, but probably using Network.framework)
Each device captures a video stream (using AVCaptureSession)
Each device compresses their respective video stream (using VTCompressionSession)
Each device sends their compressed stream to the other device over the connection
Each receiving device decompresses and presents the received stream

0

Answer 2

Useraugenkunst OP

Mar ’24

Hello @gchiste

Thank you for your response. I just had a question regarding the approach you suggested. Since the players are already connected via the GameKit matchmaking server, would it be necessary to establish a connection between the two players as you have explained on step 1 ?.

0