Reconstructing Scenes with Mirror and Glass Surfaces
Thomas Whelan1, Michael Goesele1,2, Steven J. Lovegrove1, Julian Straub1, Simon Green1, Richard Szeliski3, Steven Butterfield1, Shobhit Verma1, Richard Newcombe1
1Facebook Reality Labs 2TU Darmstadt 3Facebook
Planar reflective surfaces such as glass and mirrors are notoriously hard to reconstruct for most current 3D scanning techniques. When treated naïvely, they introduce duplicate scene structures, effectively destroying the reconstruction altogether. Our key insight is that an easy to identify structure attached to the scanner—in our case an AprilTag—can yield reliable information about the existence and the geometry of glass and mirror surfaces in a scene. We introduce a fully automatic pipeline that allows us to reconstruct the geometry and extent of planar glass and mirror surfaces while being able to distinguish between the two. Furthermore, our system can automatically segment observations of multiple reflective surfaces in a scene based on their estimated planes and locations. In the proposed setup, minimal additional hardware is needed to create high-quality results. We demonstrate this using reconstructions of several scenes with a variety of real mirrors and glass.
We would like to customise the information and usability of this website to your preferences and needs.
To this end, we use so-called cookies. Please choose which cookies you would like to enable when visiting our webpages.
Some of these cookies are required to load and correctly display this website on your device.
These are strictly necessary or essential cookies and cannot be deselected.
The preferences cookie saves your language setting, while the statistics cookie regulates
how the open-source statistical software “Matomo” analyses your visits to and activities on our website.
For more information about cookies we use, please refer to our