How would I go about building AR effects similar to the AR Spaces features in Clips?

Question

SAIK1065 OP

Created Jun ’21

Replies 1

Boosts 0

Participants 2

Hello!

I really want to make these immersive AR experiences with engaging graphics like the new AR Spaces feature in the Clips app. Is RealityKit the way to go for this? Or does it require some really lower level understanding and use of API’s like ARKit with Metal?

Also, with RealityKit’s scene understanding, we can map a mesh of the scene the LIDAR device can see but I was wondering how would I switch that out with a custom mesh design like in the Clips app as well.

Thank you!

Boost

Answer 1

Graphics and Games Engineer OP

Apple

Jun ’21

I would look at RealityKit’s new post processing API. This will allow you to create effects that are applied to the entire screen, similar to the effects in Clips. You will likely need to write your own custom effects using Metal, but the API makes it easy to implement shader code without a lot of setup. Please see the ‘Explore advanced rendering with RealityKit 2’ for more details on the API.

1