I am currently working on a project where I aim to overlay the camera feed obtained via the Apple Vision Pro's camera access API to align perfectly with the user's perspective in Vision Pro.
However, I've noticed a discrepancy between the captured camera feed and the actual view from the user's perspective. My assumption is that this difference might be related to lens distortion correction or the lack thereof.
Unfortunately, I'm not entirely sure how the camera feed is being corrected or processed. For the overlay, I'm using a typical 3D CG approach where a texture captured from the background plane is projected onto a surface. In this case, the "background capture" is the camera feed that I'm projecting.
If anyone has insights or suggestions on how to align the camera feed with the user's perspective more accurately, any information would be greatly appreciated.
Attached image shows what difference between the camera feed and actual user's perspective field of view.
I want to align the camera feed image to the user's perspective.
Post
Replies
Boosts
Views
Activity
I'm testing Object Capture that is announced at WWDC21 but I got the error like below.
zsh: illegal hardware instruction /Users/userName/Downloads/CreatingAPhotogrammetryCommandLineApp/inpu
I'm wondered why the console didn't say the path correctly. The path is "/Users/userName/Downloads/CreatingAPhotogrammetryCommandLineApp/input" (last t is missing)
I built the app on a M1 Macbook and of cause I ran it on same Macbook but I got the error I mentioned.
I'm guessing the app can run correctly in mesh building timing because I can see logs about the status of estimations.
I attached the log. Does anyone know what happened in my Macbook?
Error log