RealityView world tracking without camera feed?

Question

Vielfalt OP

Created Aug ’24

Replies 4

Boosts 1

Participants 2

Is it possible with iOS 18 to use RealityView with world tracking but without the camera feed as background?

With content.camera = .worldTracking the background is always the camera feed, and with content.camera = .virtual the device's position and orientation don't affect the view point. Is there a way to make a mixture of both?

My use case is that my app "Encyclopedia GalacticAR" shows astronomical objects and a skybox (a huge sphere), like a VR view of planets, as you can see in the left image. Now that iOS 18 offers RealityView for iOS and iPadOS, I would like to make use of it, but I haven't found a way to display my skybox as environment, instead of the camera feed.

I filed the suggestion FB14734105 but hope that somebody knows a workaround...

Boost

Answer 1

Vision Pro Engineer OP

Apple

Aug ’24

You can set the background to a skybox instead through the RealityViewCameraContent.environment property.

0

Answer 2

Vielfalt OP

Aug ’24

I tried, but the skybox doesn't show up if the camera is set to world tracking.

To reproduce the issue, open the BOT-anist sample project and add content.camera = .worldTracking in ExplorationView.swift ca. line 57 (above the code that sets the environment).

I tried that with Xcode 16.0 beta 5, iPadOS 18 beta 6, on iPad Pro 11" 3rd gen, and the background shows the camera feed instead of the skybox.

Is this a bug?

0

Answer 3

Vielfalt OP

Aug ’24

Correction: It's line 45 in ExplorationView.swift, where content.camera = .worldTracking must be inserted.

I filed FB14821481

0

Answer 4

Vielfalt OP

Aug ’24

Still occurs with iOS and iPadOS 18.0 beta 7, Xcode 16 beta 6.

In beta 7, worldTracking has been renamed to spatialTracking, so the code for BOT-anist ExplorationView.swift line 45, which breaks the skybox, is now:

content.camera = .spatialTracking

0