Automatic Plane Measurements like in the Apple Measure App

Question

Created 1d

Replies 2

Boosts 0

Participants 2

I’m working on an iOS app that needs to measure the area of planes or surfaces, like the length and width of objects, just like the Apple Measure app does. I’ve been exploring ARKit, but I’m curious if there are any APIs or techniques that can help automate the process of detecting and measuring planes.

Specifically, I’m looking for a way to automatically detect and measure planes (e.g., from a top-down view). For example: Measuring a box width and length. I have attached a screenshot and a video of the Apple Measure App doing it.

Does Apple provide any tools or APIs for this, or are there any best practices I should know about? I’d love to hear from anyone who’s tackled something similar.

Video: https://drive.google.com/file/d/1BxM7fIbFxsCsYwY7w8ZxIeq_4WTGkkwA/view?usp=drive_link

Boost

Answer 1

JoonAhn OP

1d

Box measurement (size and 6DoF) is an unsolved industrial application problem in warehouse and airport automation. Once there is a solution, it must be great. It could be solved by processing both 3D point cloud and 2D image.

Following videos show partial solutions processing only point cloud.

YouTube Videos:

Real-Time Box Measurement, l-i2E7aZY6A
Measuring & Tracking of Boxes in Real-Time, mEHaR2mjm9c

Real-Time Box Measurement.png

0

Answer 2

SharinPixDev OP

8h

Hello @JoonAhn

Thanks for your reply.

There's currently no simple solution for real-time box measurement. The videos you sent me mainly use OpenCV for processing point clouds. ARKit, with its LiDAR and depth capabilities, could be a potential tool to tackle this problem. I want to know if ARKit provides any documentation or demo app based on this scenario.

Thanks

0