Placing 3D object in video

Is there any way to place 3D objects, maybe using ARKit or Metalkit in the video.

I have tried to extract frames from video, then draw a cube using SCNNode and then render it into UIImage, then gather all images and create video.

But this is not feasible solution as it creates huge memory spike and ultimately gives memory warning.

So is there any other way to draw 3D objects on the video file.

Hello @abhijit.pargaonkar

Could you describe a bit more what effect you are trying to achieve?

3D video is encoded as two stereoscopic images per frame and is rendered as such, it does not have the level of depth information of a full 3D scene like you might create in Reality Composer Pro. Assuming your 3D video file is in MV-HEVC format, you can learn more about how these files work from this developer video.

However, if you explain a bit more about the sort of effect you are looking to achieve I might be able to assist you with a different solution. You may be trying to create an effect that requires Portals, which are not related to 3D videos, and would require a different explanation and workflow.

Placing 3D object in video
 
 
Q