H-BIM & Artificial Intelligence

Connecting geometry and semantics: from 3D classification of heritage data to H-BIM representations


Team

Valeria Croce 1, 2*
Marco Giorgio Bevilacqua 3
Gabriella Caroti 1
Andrea Piemonte 1

1 Department of Civil and Industrial Engineering, ASTRO Laboratory, University of Pisa, 56122 Pisa, Italy
2 Modèles et Simulations pour l’Architecture et le Patrimoine, UMR 3495 CNRS/MC, 13402 Marseille, France
3 Department of Energy, Systems, Territory and Construction Engineering, DESTEC, University of Pisa, 56122 Italy
* Author to whom correspondence should be addressed.

Abstract

Cultural heritage information systems, such as H-BIM, are becoming more and more widespread today, thanks to their potential to bring together, around a 3D representation, the wealth of knowledge related to a given object of study. However, the reconstruction of such tools starting from 3D architectural surveying is still largely deemed as a lengthy and time-consuming process, with inherent complexities related to managing and interpreting unstructured and unorganized data derived, e.g., from laser scanning or photogrammetry. Tackling this issue and starting from reality-based surveying, the purpose of this paper is to semi-automatically reconstruct parametric representations for H-BIM-related uses, by means of the most recent 3D data classification techniques that exploit Artificial Intelligence (AI). The presented methodology consists of a first semantic segmentation phase, aiming at the automatic recognition through AI of architectural elements of historic buildings within points clouds; a Random Forest classifier is used for the classification task, evaluating each time the performance of the predictive model. At a second stage, visual programming techniques are applied to the reconstruction of a conceptual mock-up of each detected element and to the subsequent propagation of the 3D information to other objects with similar characteristics. The resulting parametric model can be used for heritage preservation and dissemination purposes, as common practices implemented in modern H-BIM documentation systems. The methodology is tailored to representative case studies related to the typology of the medieval cloister and scattered over the Tuscan territory.

Keywords

H-BIM, Semantic Segmentation, Architectural Heritage, Artificial Intelligence, Scan-to-BIM, Machine Learning.

Share and cite

Croce, V., Bevilacqua, M. G., Caroti, G., and Piemonte, A.: Connecting geometry and semantics via Artificial Intelligence: from 3D classification of heritage data to H-BIM representations, Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLIII-B2-2021, 145–152, https://doi.org/10.5194/isprs-archives-XLIII-B2-2021-145-2021, 2021.