Semantic Enrichment of Architectural Heritage Point Clouds Using Artificial Intelligence: The Palacio de Sástago in Zaragoza, Spain

In the current landscape dominated by Artificial Intelligence, the integration of Machine Learning and Deep Learning within the realm of Cultural Heritage, particularly within architectural contexts, is paramount for the efficient processing and interpretation of point clouds. These advanced methods facilitate automated segmentation and classification, significantly improving both the clarity and practical use of data acquired from laser scanning and photogrammetry. The present study investigates the Palacio de Sástago—a prominent Renaissance palace in Zaragoza, Spain—and introduces a cutting-edge modus operandi for the automated recognition of architectural elements within the palace’s inner courtyard. Employing the well-established Random Forest algorithm, implemented in a Python environment, the framework begins with a comprehensive evaluation of the geometric features identified in the LiDAR point cloud. This process employs the Mean Decrease in Impurity metric to evaluate the relevance of each variable. To boost the accuracy and efficiency of the final classifications, the features are refined post-assessment, enhancing both the training phase and the algorithm’s later evaluation. The research’s findings demonstrate significant potential, supporting advancements in CAD systems and HBIM that will enable more precise, automated modelling of architectural elements, thereby enhancing the accuracy of digital reconstructions and improving conservation planning for heritage sites.