If the shape, size, location, and orientation of the surface of a real object can be accurately known by processing ARMeshAnchor in real time, various AR applications are possible. Accurate real-time calculations ensure that such real objects can serve as moving anchors for virtual objects.
YouTube "Virtual ads inside Chungmuro station Line 3 - iPhone Pro 12" BmKNmZCiMkw
YouTube "Rolling Ball - Apple iPad Pro LiDAR" sMRfX334blI
Post
Replies
Boosts
Views
Activity
Furthermore, even in totally dark environments where the RGB images required for motion tracking cannot be obtained, however 576 points of LiDAR are obtained. By processing LiDAR's 576 such points in real time, you can pinpoint the shape, size, location, and orientation of a real-world object's surface front of you, even in the total darkness. 576 points of LiDAR must have no concern about privacy problem. But will bring much positive uses.
Sorry...
Now the YouTube video is now visible, i.e., you only need to know the URL.
The video "Nose extraction - iPhone X, SR300" https://youtu.be/eCmVYl3GIEY is really old one.
Since 2020 Apple LiDAR and depthMap are available, there new technical possibilities are realized and demonstrated.
YouTube CurvSurf
https://www.youtube.com/CurvSurf
GitHub CurvSurf
https://github.com/CurvSurf
There are numerous object surfaces around us. Accurately determining their shape, size, position and posture in real time is a major problem. Essentially, this is a problem we are all trying to solve.
pickIdx = pickIdxExt = -1;
if (there is at least one point inside the "view cone")
the closest point to ray_pos with the smallest len1 is picked as pickIdx = idx; // pickIdx >= 0
else if (there is at least one point outside the "view cone")
the closest point to the "view circle" on screen with the largest cosine value is picked as pickIdxExt = idx; // pickIdxExt >= 0
return pickIdx < 0 ? pickIdxExt : pickIdx; // return (-1) means that no point is picked or list[] is empty.
// ViewController.swift
// ln:592. 'else {' should be altered to 'else if (pickIdx < 0) {'
else if (pickIdx < 0) {
// This will accelerate the picking process. Once a point is found inside the "view cone", i.e., pickIdx >= 0, we do not care pickIdxExt.
The set of points list[] is a collection of 3D points from:
ARPointCloud, YouTube 4U4FlavRKa4 .
AR, Based on Curved Object Surfaces.
vertices of ARMeshAnchor, YouTube JSNXB3zc4mo .
Fast Cylinder Fitting.
ARDepthData, YouTube zc6GQOtgS7M .
Real Time Ball Tracking in depthMap.
The right solution would require obtaining the 6DoF motion tracking information of both the user and the vehicle in real time.
Apple Vision Pro
Object planes, spheres, cylinders, cones, and tori can now be effortlessly detected and measured in real-time at up to 120 fps (found-per-second).
It may be going up to 300 fps.
Check out the source code of the AVP app on GitHub CurvSurf for more details:
GitHub Link
The finger joints are rendered as cubes with 6DoF poses:
"FindSurface Real-Time Preview - Apple Vision Pro"
https://youtu.be/CGjhfKxjpUU
The source code of the AVP app is available:
GitHub Link