Interior Layout Generation Based on Scene Graph and Graph Generation Model (original) (raw)

Abstract

Interior layout design is closely related to people’s everyday life and is very widely demanded. As much workload of interior layout design being repetitive and categorized, automation and assistance could be applied with the help of most recent advancement of artificial intelligence. In this paper, we present an exploration work of automating interior layout design. We put forward a set of representation rules which turn interior scene photos into structuralized scene graphs. With representation rule containing both categorial and spatial information, we establish an interior scene graph dataset by annotating well-designed interior scene pictures downloaded from online photo sharing sites. Using the interior scene dataset which contains over 400 valid interior scene graphs, we train a graph generative model and further render its output as reconstructed scenes. The system could generate interior scene within short time and could potentially be applied in multiple related tasks.

Similar content being viewed by others

References

  1. Wu W, Fu XM, Tang R, Wang Y, Qi YH, Liu L (2019) Data-driven interior plan generation for residential buildings. ACM Trans Graph (TOG) 38(6):1–12
    Google Scholar
  2. Li W, Saeedi S, McCormac J, Clark R, Tzoumanikas D, Ye Q, Leutenegger S (2018) InteriorNet: mega-scale multi-sensor photo-realistic indoor scenes dataset. arXiv preprint arXiv:1809.00716
  3. Zhang SH, Zhang SK, Liang Y, Hall P (2019) A survey of 3D indoor scene synthesis. J Comput Sci Technol 34(3):594–608
    Article Google Scholar
  4. Wang K, Savva M, Chang AX, Ritchie D (2018) Deep convolutional priors for indoor scene synthesis. ACM Trans Graph (TOG) 37(4):70
    Google Scholar
  5. Li M, Patil AG, Xu K, Chaudhuri S, Khan O, Shamir A, Zhang H (2019) GRAINS: generative recursive autoencoders for indoor scenes. ACM Trans Graph (TOG) 38(2):12
    Article Google Scholar
  6. Huang SS, Fu H, Hu SM (2016) Structure guided interior scene synthesis via graph matching. Graph Models 85:46–55
    Article MathSciNet Google Scholar
  7. Wang K, Lin YA, Weissmann B, Savva M, Chang AX, Ritchie D (2019) Planit: planning and instantiating indoor scenes with relation graph and spatial prior networks. ACM Trans Graph (TOG) 38(4):1–15
    Article Google Scholar
  8. Merrell P, Schkufza E, Li Z, Agrawala M, Koltun V (2011) Interactive furniture layout using interior design guidelines. ACM Trans Graph (TOG) 30(4):87
    Article Google Scholar
  9. Xu W, Wang B, Yan DM (2015) Wall grid structure for interior scene synthesis. Comput Graph 46:231–243
    Article Google Scholar
  10. Qi S, Zhu Y, Huang S, Jiang C, Zhu SC (2018) Human-centric indoor scene synthesis using stochastic grammar. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5899–5908
    Google Scholar
  11. Johnson J, Krishna R, Stark M, Li LJ, Shamma D, Bernstein M, Fei-Fei L (2015) Image retrieval using scene graphs. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3668–3678
    Google Scholar
  12. Johnson J, Gupta A, Fei-Fei L (2018) Image generation from scene graphs. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1219–1228
    Google Scholar
  13. Anderson P, Fernando B, Johnson M, Gould S (2016) Spice: semantic propositional image caption evaluation. In: European conference on computer vision. Springer, Cham, pp 382–398
    Google Scholar
  14. Chang A, Savva M, Manning CD (2014) Learning spatial knowledge for text to 3D scene generation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 2028–2038
    Google Scholar
  15. Zhou J, Cui G, Zhang Z, Yang C, Liu Z, Sun M (2018) Graph neural networks: a review of methods and applications. arXiv preprint arXiv:1812.08434
  16. Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907
  17. Li Q, Han Z, Wu XM (2018) Deeper insights into graph convolutional networks for semi-supervised learning. In: Thirty-second AAAI conference on artificial intelligence
    Google Scholar
  18. Brockschmidt M, Allamanis M, Gaunt AL, Polozov O (2018) Generative code modeling with graphs. arXiv preprint arXiv:1805.08490
  19. De Cao N, Kipf T (2018) MolGAN: an implicit generative model for small molecular graphs. arXiv preprint arXiv:1805.11973
  20. You J, Liu B, Ying Z, Pande V, Leskovec J (2018) Graph convolutional policy network for goal-directed molecular graph generation. In: Advances in neural information processing systems, pp 6410–6421
    Google Scholar
  21. Li Y, Vinyals O, Dyer C, Pascanu R, Battaglia P (2018) Learning deep generative models of graphs. arXiv preprint arXiv:1803.03324
  22. Song S, Yu F, Zeng A, Chang AX, Savva M, Funkhouser T (2017) Semantic scene completion from a single depth image. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1746–1754
    Google Scholar
  23. Liu M, Zhang K, Zhu J, Wang J, Guo J, Guo Y (2018) Data-driven indoor scene modeling from a single color image with iterative object segmentation and model retrieval. IEEE Trans Vis Comput Graph
    Google Scholar

Download references

Author information

Authors and Affiliations

  1. Tsinghua University, Beijing, China
    Xia Su, Chenglin Wu, Wen Gao & Weixin Huang

Authors

  1. Xia Su
    You can also search for this author inPubMed Google Scholar
  2. Chenglin Wu
    You can also search for this author inPubMed Google Scholar
  3. Wen Gao
    You can also search for this author inPubMed Google Scholar
  4. Weixin Huang
    You can also search for this author inPubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and School of Architecture, University of North Carolina, Charlotte, NC, USA
    John S. Gero

Rights and permissions

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Cite this paper

Su, X., Wu, C., Gao, W., Huang, W. (2022). Interior Layout Generation Based on Scene Graph and Graph Generation Model. In: Gero, J.S. (eds) Design Computing and Cognition’20. Springer, Cham. https://doi.org/10.1007/978-3-030-90625-2\_15

Download citation

Publish with us