Lumen

In 2020, a LIDAR sensor was added to the rear camera of the iPad Pro for the first time. This made it possible to generate reference points for distances in a camera image.

From these reference points a point cloud could be generated, which can represent a 3D space.

Lumen was a technology study and one of the first apps that could generate a 3D model of space.

Here is a video of Lumen, a photo of the scanned 3D space and of the internal object classification using AI.

The point selection for the 3D model could still be improved by common algorithms. This has not yet been done with this showcase.

An example from a paper would be this method.