Appearance-based material classification after occlusion removal for operation-level construction progress monitoring

Today, the availability of a large number of smart devices on construction sites, has significantly interest popularity of appearance-based methods for automated construction progress using site photographs monitoring. These methods, however, face a number of technical challenges that limit their applicability including low spatial resolution of images, and static and dynamic occlusions due to the construction progress and moving resources (equipment, workers, scaffolding, etc). To address these limitations, this paper extends on an existing model-driven appearance-based material classification method for appearance-based construction progress monitoring using 4D BIM and site photologs. Specifically, it introduces a robust occlusion removal algorithm that can lower false positives in material recognition. The method leverages the depth information from the 4D BIM as well as the 3D point cloud created through Structure from Motion procedures. Once the occluded regions are removed, square-shape patches can be extracted from the back-projection of the BIM elements on site images. These improved image patches are then used in the material recognition pipeline to create a vector quantized histogram of all the material classes. The material class with the highest frequency is chosen as the material type for the element and this appearance information is used to infer the most updated state of progress for the elements. To validate, four existing incomplete and noisy point cloud models from real world construction site images and their corresponding BIMS were used. An extended version of the Construction Material Library (CML) developed at the University of Illinois at Urbana-Champaign’s Real-time and Automated Monitoring and Control (RAAMAC) lab was used to train the material classifiers and the experimental results shows an average accuracy of 90.9%. The occlusion removal and subsequent classification for the four datasets resulted in an accuracy of 92.2% compared to 89.9% in the existing method, demonstrating a definite improvement. By predicting the material present in an element, the status of that element can be identified as “in progress” or “completed’ and compared with the schedule. Since static occlusions are detected, analyzed, and removed, this method has potential to be effective for appearance-based progress monitoring methods and can results in higher accuracy material classification.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Civil Engineering

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2015

Author dc:creator

• Muthukumar, Banu

Contributors dc:contributor

• Golparvar-Fard, Mani

• Progress monitoring
• Material Classification
• Construction site

Statement dc:rights

• Copyright 2015 Banu Muthukumar

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/88097

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/88097