Floorplan-Jigsaw: Jointly Estimating Scene Layout and Aligning Partial Scans

Floorplan-Jigsaw: Jointly Estimating Scene Layout and Aligning Partial Scans

The University of Hong Kong

International Conference on Computer Vision (ICCV), 2019

In this paper, we propose a method for registering partial reconstructions of an indoor scene which may not have sufficient overlap. Our key observation is that the local layouts of partial reconstructions can be viewed as the fragments of a global room layout which typically has the following two characteristics: (1) the room layout is a set of perpendicular or parallel walls, which is referred to the Manhattan World (MW) property; (2) the room layout forms a closed loop on a 2D floorplan. We exploit these properties to develop an efficient method for jointly predicting a room layout that has the above layout properties and estimating the transformations from a set of unordered partial reconstructions.

Abstract

We present a novel approach to align partial 3D reconstructions which may not have substantial overlap. Using floorplan priors, our method jointly predicts a room layout and estimates the transformations from a set of partial 3D data. Unlike the existing methods relying on feature descriptors to establish correspondences, we exploit the 3D 'box' structure of a typical room layout that meets the Manhattan World property. We first estimate a local layout for each partial scan separately and then combine these local layouts to form a globally aligned layout with loop closure. Without the requirement of feature matching, the proposed method enables some novel applications ranging from large or featureless scene reconstruction and modeling from sparse input. We validate our method quantitatively and qualitatively on real and synthetic scenes of various sizes and complexities. The evaluations and comparisons show superior effectiveness and accuracy of our method.

ArXiv [ArXiv]
Paper [PDF]
Supplemental Material [PDF]
Code and Data [Coming Soon...]

Citation:
Cheng Lin, Changjian Li, and Wenping Wang. Floorplan-jigsaw: Jointly estimating scene layout and aligning partialscans. InThe IEEE International Conference on ComputerVision (ICCV), October 2019. (bibtex)

In the press:
Computer Vision News, The magazine of the algorithm community - ICCV Daily 2019, Friday.

Algorithm Pipeline

Overview of the proposed method. Given a set of unordered partial reconstructions (a), our algorithm first estimatestheir local floorplans (b) respectively. Then we compute the poses (c) of all the local floorplans to find a global optimalplacement (d) followed by a refinement process (d). Finally we output the aligned complete reconstruction (e) and predict afinal room layout (f) accordingly.

Representative Results

We evaluate our algorithm using 101 scenes collected from SUNCG dataset, SUN3D dataset and our real-world scanning. Each scene is given by a set of partial reconstructions derived from the region-by-region capturing or the failures of camera localization. A challenge in our testing data is, there may not be sufficient overlap among the partial data. Our dataset covers representative indoor layouts of which the scene area varies from 2m x 6m to 18m x 20m, and the number of wall corners varies from 4 to 16. All the experiments are performed on a machine with Intel Core i7-7700K 4.2GHz CPU and 32GB RAM. Below are some representative results.

Results of the partial reconstruction alignment and the global layout estimation.