Object Capture With only manual capturing

Question

HeoJin OP

Created Jul ’23

Replies 2

Boosts 0

Views 1.2k

Participants 2

Is it possible to capture only manually (automatic off) on object capture api ?

And can I proceed to capturing stage right a way?

Only Object Capture API captures real scale object.

Using AVFoundation or ARKit, I've tried using lidar capturing HEVC or create PhotogrammetrySample, It doesn't create real scale object.

I think, during object capture api, it catches point cloud, intrinsic parameter, and it help mesh to be in real scale.

Does anyone knows 'Object Capture With only manual capturing' or 'Capturing using AVFoundation for real scale mesh'

Boost

Answer 1

Engineer OP

Apple

Sep ’23

There is no manual only capture on iOS ObjectCaptureSession API, and a bounding box is required.

You can use a 2 rear camera session of AVFoundation to capture HEIC images with stereo depth embedded instead (which we demonstrated in the previous release of Object Capture) or provide the AVDepthData depth maps in the PhotogrammetrySample. If the depth map is provided correctly, the scale should be correctly computed.

0

Answer 2

HeoJin OP

Sep ’23

I tried to initialize session with bellow. //MARK: Initialize Camera private func initializeCamera() { print("Initialize Camera") currentCamera = AVCaptureDevice.default(.builtInLiDARDepthCamera, for: .depthData, position: .back)

    currentSession = AVCaptureSession()
    currentSession.sessionPreset = .photo
    do {
        let cameraInput = try AVCaptureDeviceInput(device: currentCamera)
        currentSession.addInput(cameraInput)
    } catch {
        fatalError()
    }
    let videoOutput = AVCaptureVideoDataOutput()
    videoOutput.setSampleBufferDelegate(self,
                                        queue: currentDataOutputQueue)
    videoOutput.videoSettings = [kCVPixelBufferPixelFormatTypeKey as String: kCVPixelFormatType_32BGRA]
    currentSession.addOutput(videoOutput)
    let depthOutput = AVCaptureDepthDataOutput()
    depthOutput.setDelegate(self, callbackQueue: currentDataOutputQueue)
    depthOutput.isFilteringEnabled = true
    currentSession.addOutput(depthOutput)
    currentPhotoOutput = AVCapturePhotoOutput()
    currentSession.addOutput(currentPhotoOutput)
    currentPhotoOutput.isDepthDataDeliveryEnabled = true
}

0