Skip to content

The demo app demonstrates a real-time application using FindSurface to search point clouds, which ARKit provides, for geometry shapes.

License

Notifications You must be signed in to change notification settings

adozenlines/FindSurface-GUIDemo-iOS

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FindSurface-GUIDemo-iOS (Swift)

CurvSurf FindSurface™ GUIDemo for iOS (Swift)

Overview

This demo app demonstrates a real-time application using FindSurface to search point clouds, which ARKit provides, for geometry shapes.

FindSurfaceFramework is required to build the source code into a program. Download the framework here and refer to here for an instruction about how to setup your project to build it with the framework.

Requirements

This demo app requires the LiDAR sensor to get a point cloud from ARKit.

  • Apple iPad Pro LiDAR
  • Apple iPhone 12 Pro
  • Apple iPhone 12 Pro Max
  • Apple iPhone 13 Pro
  • Apple iPhone 13 Pro Max

Features

Compared to the basic demo, the gui demo has the following features:

  • Real-time detection of surfaces in camera scenes;
  • Using input point cloud data provided by ARKit;
  • Detected surfaces rendered in overlay (AR rendering);
  • GUI interfaces to manipulate the app's settings (e.g., confidence, smoothed depth, feature types).

User Interface

interface

  1. Feature types of surfaces to detect.
  2. Hide/show the point cloud on the screen.
  3. Confidence levels to filter point cloud (e.g., the "C.Med" option means filter out the points having "low" confidence).
  4. Point cloud scanning mode.
    • "Fixed(Fix)" means that FindSurface takes about 20k points from ARKit as an input for each frame.
    • "Accumulate(Acc)" means it takes about 500 points from ARKit as an input for each frame and accumulates them into a 500k points-sized buffer in a FIFO manner. The points are not accumulated unless the camera has a movement.
  5. Switch between smoothed scene depths and scene depths (ARKit option).
  6. Accuracy (error) levels of the target surface.
  7. Enable/disable FindSurface to start searching geometric shapes.
  8. Undo the latest snapshot.
  9. Remove all snapshots.
  10. Radius indicators.
    • The seed radius indicator (the white circle), controlled by pinching the screen.
    • The picking radius indicator (the red circle), controlled by dragging the screen vertically.
    • The focusing point (the blue box) indicates the aim to the target object, to choose a seed point.
  11. (A) Target surface information.
  12. (B) Third-person perspective view mode (experimental, see the snapshot in the Output Examples)
  13. Points shown on the screen are the visualization of the points provided by ARKit, of which colors indicate confidence levels (green, blue, and red mean high, medium, and low, respectively).

About Noise Level Estimation

FindSurface requires a priori root-mean-squared error of the measurement points (See the measurement accuracy description in this document for details). To determine an appropriate value of the measurement accuracy parameter, we built a linear model of normal noise for the app:

base_error(distance) = a + b * distance * 2
// the distance is in meters.

We set the values of a = 0.001 and b = 0.00005 for the normal (expected) noise model as a result of our experiments and introduced an additional constant values for each model, of which the values have been heuristically determined, to derive the following variations of the model:

lower_error(distance) = base_error(distance) - 0.001
normal_error(distance) = base_error(distance) + 0.001
higher_error(distance) = base_error(distance) + 0.003

The app calculates a concrete value of the a priori error according to the distance and the error level that users set (e.i., E.Low, E.Med, and E.High).

Output Examples

A sphere is detected

fixed

Points are hidden

hidden

Accumulated points

accumulated

Third-person perspective view

third-person

About

The demo app demonstrates a real-time application using FindSurface to search point clouds, which ARKit provides, for geometry shapes.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published