I am working with ARKit4 and I want to use MetalKit as well as SceneKit to render the session. I have a MTKView and a ARSCNView on top of it. I am using the MTKView to render the RGB images as show cased here: https://developer.apple.com/documentation/arkit/visualizing_a_point_cloud_using_scene_depth
And I want to render the ARKit scene reconstruction mesh as well. That is why I need to use ARSCNView. However, I am unable to initialize the ARSession for both the views. Only one works at a time.
Is it possible to use both the frameworks( SceneKit and MetalKit) simultaneously for rendering ARKit mesh?
Post
Replies
Boosts
Views
Activity
I am new to Metal Kit and Computer Graphics in general.
I was playing around with this sample code:
https://developer.apple.com/documentation/arkit/visualizing_a_point_cloud_using_scene_depth
I want to re-write this app. I wish to render a triangle mesh / triangle strip with custom colors in place of the particles or dots rendered here in this app (on top of the rgb image captured per frame)
I would really appreciate it if someone can point me to the right direction. I know I need to probably re-write the shader file to draw triangles but I can not figure out how.
Any help is appreciated.
Thank you.
I am trying to load a obj file from the app's document directory.
let asset = MDLAsset(url: url)
scene = SCNScene(mdlAsset: asset)
This works fine for smaller .obj files. But when I have large files (around 12MB) I get the error "Cannot load OBJ file"
I need to be able to load large files on the app, is there a work around?
I was working on the ARKit4 scene reconstruction.
I am able to render the mesh on the environment. I was wondering how can I customize the mesh? Like, by default the mesh is primitive colored triangles and what if I want to render it as solid black triangles, how can I do that?
I am relatively new to swift so if anyone can point me to some tutorials to achieve this, that will be great.
Thank you.
I am working on ARKit4, trying to generate a 3D model from the mesh. I am trying to display the 3D .obj file in SceneKit but the model doesn't show up.
I get the following error:
2020-09-25 17:56:32.532137-0700 connection to com.apple.ModelIO.AssetLoader was interrupted 2020-09-25 17:56:32.532201-0700 AssetLoader.loadURL errorHandler: Error Domain=NSCocoaErrorDomain Code=4097 "connection to service on pid 0 named com.apple.ModelIO.AssetLoader" UserInfo={NSDebugDescription=connection to service on pid 0 named com.apple.ModelIO.AssetLoader} 2020-09-25 17:56:32.535432-0700 Couldn’t communicate with a helper application.
Please help me resolve this error.
I have been working on developing an app for iPad Pro 2020 to capture the scene depth from the lidar sensor using ARKit 4 sceneDepth property. It was working completely fine until the iOS got updated today. The sceneDepth is always nil.