RealityKit Collaborative Session using Multipee... |Apple Developer Forums

332 Views 13 Replies

Latest reply on Dec 2, 2019 5:17 PM by ellohay

Level 1 (0 points)

addedlayer Nov 17, 2019 7:26 AM

Does anyone have a working example of a RealityKit Collaborative session? The documentation is very sparse and I'm getting an error:

[GCKSession] Not in connected state, so giving up for participant [68A67812] on channel [6].

It seems the devices are connecting but that as soon as RealityKit is trying to sync, I get the error.

Re: RealityKit Collaborative Session using Multipeer Connectivity

Level 1 (0 points)
ellohay Nov 17, 2019 10:51 AM (in response to addedlayer)

I am also looking for any sample code on how to do make a multiuser session.
This helped me (0)

Actions
- Re: RealityKit Collaborative Session using Multipeer Connectivity
  
  Apple Staff (230 points)
  gchiste Nov 18, 2019 4:26 PM (in response to ellohay)
  
  This sample was published very recently: https://developer.apple.com/documentation/arkit/creating_a_collaborative_session
  
  This helped me (2)
  
  Actions
  - Re: RealityKit Collaborative Session using Multipeer Connectivity
    
    Level 1 (0 points)
    ellohay Nov 19, 2019 8:25 PM (in response to gchiste)
    
    Thank you @gchiste for posting this.
    
    Does Apple also have sample code for a solution that uses RealityKit's synchronization? I ask because I am looking for a simpler solution without having to use ARSession delegate functions.
    
    This helped me (0)
    
    Actions
    - Re: RealityKit Collaborative Session using Multipeer Connectivity
      
      Level 1 (0 points)
      asddddaa Nov 20, 2019 6:55 AM (in response to ellohay)
      
      Hi Ellohay,
      
      Actually in the sample code he shared, they are using realitykit. It should be fine. However, they are using in this sample code the two delegate methods they mentioned that it shouldnt be used if you use realitykit. So I am not sure if this is change of plans or we can just not use these delegate methods.
      
      Please let me know if you find a better way for collaberative session. I am searching for this since last WWDC .
      
      Thanks
      
      This helped me (0)
      
      Actions
      - Re: RealityKit Collaborative Session using Multipeer Connectivity
        
        Level 1 (0 points)
        ellohay Nov 20, 2019 9:17 PM (in response to asddddaa)
        
        Hello @asddddaa,
        
        The sample code uses RealityKit to place AR content, but does not use RealityKit's networking solution. Using RealityKit's networking is probably much simpler and I agree that there should not be a need to use delegate functions.
        
        I will surely post a sample here if I find one.
        
        Thanks
        
        This helped me (0)
        
        Actions
        
        Re: RealityKit Collaborative Session using Multipeer Connectivity
        
        Apple Staff (230 points)
        gchiste Nov 21, 2019 2:30 PM (in response to ellohay)
        
        As noted in the Readme of the sample, "Although this sample draws its graphics using RealityKit, it doesn’t use RealityKit’s mechanism for over-the-network entity synchronization. Instead, it uses RealityKit as a renderer only as necessary to demonstrate ARKit’s collaborative session."
        
        In other words, this sample is a demonstration of ARKit's collaboration api's, so it does not use RealityKit's synchronization.
        
        This helped me (1)
        
        Actions
        
        Re: RealityKit Collaborative Session using Multipeer Connectivity
        
        Level 1 (0 points)
        ellohay Nov 21, 2019 4:24 PM (in response to gchiste)
        
        Hello @gchiste,
        
        Would you be able to post sample code for a solution that uses RealityKit's synchronization?
        
        This helped me (0)
        
        Actions
        
        Re: RealityKit Collaborative Session using Multipeer Connectivity
        
        Level 1 (0 points)
        addedlayer Nov 22, 2019 11:31 AM (in response to ellohay)
        
        I've been working on a sample all week but haven't got it working yet. As soon as I have something, I'll post a link here.
        
        This helped me (0)
        
        Actions
  - Re: RealityKit Collaborative Session using Multipeer Connectivity
    
    Level 1 (0 points)
    addedlayer Nov 22, 2019 11:28 AM (in response to gchiste)
    
    Thank you for sharing the sample. I'll give it a try!
    
    I tried getting RealityKit sync to work and had no success. I wasn't sure if it was a bug or if I was missing something. I'll continue debugging and report my findings!
    
    Thanks again.
    
    This helped me (0)
    
    Actions
Re: RealityKit Collaborative Session using Multipeer Connectivity

Level 1 (0 points)
Alexander Gaidukov Nov 23, 2019 5:42 AM (in response to addedlayer)
Any updates? I'm also trying to create collaborative session, but it doesn't work. I assume the problem is that synchronization component of all entities is always nil. Even if you try to set it explicitly, it will still be nil.

dump(entity.synchronization) // nil entity.synchronization = SynchronizationComponent() dump(entity.synchronization) // nil
This helped me (0)

Actions
Re: RealityKit Collaborative Session using Multipeer Connectivity

Level 1 (20 points)
maxxfrazer Nov 30, 2019 10:35 AM (in response to addedlayer)

I just posted an article on exactly this with a library to take away the boilerplate code and a working example.

https://medium.com/@maxxfrazer/realitykit-synchronization-289ba9409a6e

And the library to do most of the work for you complete with an example project:

https://github.com/maxxfrazer/MultipeerHelper

Hopefully it helps you all!
This helped me (0)

Actions
- Re: RealityKit Collaborative Session using Multipeer Connectivity
  
  Level 1 (0 points)
  ellohay Dec 2, 2019 5:17 PM (in response to maxxfrazer)
  
  Hello @maxxfrazer
  
  The article you posted helped to make a collaborative session. I will definitely be reading your RealityKit articles.
  
  Thank you,
  Ellohay
  
  This helped me (0)
  
  Actions
Re: RealityKit Collaborative Session using Multipeer Connectivity

Level 1 (0 points)
ellohay Nov 29, 2019 3:26 PM (in response to addedlayer)

I have created a project:

http://https://github.com/amaroo2006/CollabSession

I have tested this project, and it works. You can use the touch gestures to show updates in real time.

The package dependency for MultipeerHelper can be found at the bottom of this article
https://medium.com/@maxxfrazer/realitykit-synchronization-289ba9409a6e
This helped me (0)

Actions