3D-FRONT: 3D Furnished Rooms with layOuts and semaNTics

Huan Fu1   Bowen Cai1   Lin Gao2   Lingxiao Zhang2   Cao Li1   Qixun Zeng1

Chengyue Sun1   Yiyun Fei1   Yu Zheng1   Ying Li1   Yi Liu1   Peng Liu1   Lin Ma1   Le Weng1

Xiaohang Hu1   Xin Ma1   Qian Qian1   Rongfei Jia1   Binqiang Zhao1   Hao Zhang3

1Alibaba-inc    2Institute of Computing Technology, Chinese Academy of Sciences    3School of Computing Science, Simon Fraser University

News

Introduction

We introduce 3D-FRONT (3D Furnished Rooms with layOuts and semaNTics), a new, large-scale, and comprehensive repository of synthetic indoor scenes highlighted by professionally designed layouts and a large number of rooms populated by high-quality textured 3D models with style compatibility. From layout semantics down to texture details of individual objects, our dataset is freely available to the academic community and beyond. Currently, 3D-FRONT contains 18,797 rooms diversely furnished by 3D objects, far surpassing all publicly available scene datasets. In addition, the 7,302 furniture objects all come with high-quality textures. While the floorplans and layout designs are directly sourced from professional creations, the interior designs in terms of furniture styles, color, and textures have been carefully curated based on a recommender system we develop to attain consistent styles as expert designs. Furthermore, we release Trescope, a light-weight rendering tool, to support benchmark rendering of 2D images and annotations from 3D-FRONT. We demonstrate two applications, interior scene synthesis and texture synthesis, that are especially tailored to the strengths of our new dataset.

Features

Alibaba will continously enlarge the benchmark by providing more annotations and adding new features (e.g., sharing the professional designs) to serve for 3D acadamic studies.

Exquisite interior design, complete 3D house layout

The most compelling part of 3D-FRONT is the indoor scene packages. 3D-FRONT shares all the essential data that constructs a scene, from layout semantics down to stylistic and texture details of individual objects. While the layout ideas are directly sourced from professional designs, the interior designs are transferred from expert creations followed by a post verification process. With such a feature, its scale, including 6,813 distinct houses and 18,797 diversely furnished rooms, is far surpassing all publicly available scene datasets. It enables data-driven designing studies, such as floorplans synthesis, interior scene synthesis, and scene suits compatibility prediction, that other scene datasets can not support well. It also benefits the studying of 3D scene understanding subjects, such as SLAM, 3D scene reconstruction, and 3D scene segmentation. Further, we assign selected practical camera viewpoints to furnished scenes and release the Trescope light-weight render tool. This allows the users of 3D-FRONT to easily render images and annotations to support their 2D vision studies. Last but not least, we promise that we will continuously improve 3D-FRONT by adding more features. Some certain plans include 1) releasing an industrial render engine, i.e., AceRay, to support benchmark photo-realistic rendering and 2) sharing much enriched texture and 3D geometry contents.

Download

The 3D-FRONT benchmark is provided by Alibaba Topping Homestyler, and organized by Alibaba Tao Technology Department. If you would like to download the 3D-FRONT data, please send the 3D-FRONT Terms of Use to us at 3dfront@list.alibaba-inc.com as an attachment with your name, PI's name, and affiliation. Once we receive the email, it means you agree the terms and conditions. If you have not received a response within a week, it is likely that your email is bouncing - please check this before sending repeat requests. Please check the news for updates to the data release.

Samples

  • All
  • House
  • Room

Living Room

Dining Room

Master Bedroom

Citation

We share the dataset in advance to facilitate related 3D gemotery and vision studies. If you use our dataset or code, please also cite our reports:

    @article{fu20203dfront,
        title={3D-FRONT: 3D Furnished Rooms with layOuts and semaNTics},
        author={Fu, Huan and Cai, Bowen and Gao, Lin and Zhang, Lingxiao and Li, Cao and Zeng, Qixun and Sun, Chengyue 
                and Fei, Yiyun and Zheng, Yu and Li, Ying and Liu, Yi and Liu, Peng and Ma, Lin and Weng, Le and Hu, Xiaohang 
                and Ma, Xin and Qian, Qian and Jia, Rongfei and Zhao, Binqiang and Zhang, Hao},
        journal={arXiv preprint arXiv:2011.09127},
        year={2020}
    }
            

    @article{fu20203dfuture,
      title={3D-FUTURE: 3D Furniture shape with TextURE},
      author={Fu, Huan and Jia, Rongfei and Gao, Lin and Gong, Mingming and Zhao, Binqiang and Maybank, Steve and Tao, Dacheng},
      journal={arXiv preprint arXiv:2009.09633},
      year={2020}
    }