May 2023
tl;dr: Encoding the occupancy of a scene with a neural network, and can be queried at any location with arbitrary resolution.
In 3D there is no canonical representation which is both computationally and memory efficient yet allows for representing high-resolution geometry of arbitrary topology.
Occupancy networks implicitly represent the 3D surface as the continuous decision boundary of a deep neural network classifier. Instead of predicting a voxelized representation at a fixed resolution, the network can be evaluated at arbitrary resolution. This drastically reduces the memory footprint during training.
- Training involves random sampling points inside the volume. Random sampling yields the best results.
- During inference, a Multiresolution IsoSurface Extraction (MISE) method is used to extract isosurface of a scene.
- Summary of technical details