Error loading ReferenceImage

Question

Pascal2807 OP

Created Feb ’24

Replies 2

Boosts 0

Participants 2

Currently, I try to test the ImageTrackingProvider with the Apple Vision Pro. I started with some basic code:

import RealityKit
import ARKit

@MainActor class ARKitViewModel: ObservableObject{
    private let session = ARKitSession()
    private let imageTracking = ImageTrackingProvider(referenceImages: ReferenceImage.loadReferenceImages(inGroupNamed: "AR"))
    
    func runSession() async {
        do{
            try await session.run([imageTracking])
        }
        catch{
            print(error)
        }
    }
    
    func processUpdates() async {
        for await _ in imageTracking.anchorUpdates{
            print("test")
        }
    }
}

I only have one picture in the AR folder. I added the size an I have no error messages in the AR folder.

Bildschirmfoto 2024-02-19 um 18.39.41.png

As I am trying to run the application with the vision Pro, I receive following error:

ar_image_tracking_provider_t <0x28398f1e0>: Failed to load reference image <ARReferenceImage: 0x28368f120 name="IMG_1640" physicalSize=(1.350, 2.149)> with error: Failed to add reference image.

It finds the image, but there seems to be a problem with the loading. I tried the jpeg and the png format.

I do not understand why it fails to load the ReferenceImage.

I use Xcode Version 15.3 beta 3

Boost

Answer 1

Vision Pro Engineer OP

Apple

Feb ’24

There is a known issue in visionOS 1.0 where this error message is displayed if reference images are loaded before entering an immersive space. Could it be that ARKitViewModel, and thus the reference image, is initialized before entering the immersive space?

Note though that this error message is incorrect - as soon as you enter the immersive space, the reference image should be loaded and image tracking should work. Please give it a try!

0

Answer 2

Vision Pro Engineer OP

Apple

Feb ’24

Have you tested though whether you receive an image anchor when you point the Vision Pro at a print-out of the reference image file (in a well lit environment)? As mentioned, the error message is incorrect and can be ignored in visionOS 1.0.

0