{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/109573"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/109573","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Developing autonomy in structural inspections through computer vision and graphics","abstract":"Visual inspection is the most common means of assessing the condition of civil infrastructure in the United States but can be exceedingly laborious, time consuming, subjective, and even dangerous. Inspections are typically performed by human experts who collect visual or other non-destructive data and combine it with relevant decision-making criteria. Computer vision techniques, in conjunction with acquisition through remote cameras and unmanned aerial vehicles (UAVs), offer promising non-contact solutions to automate civil infrastructure condition assessment. The ultimate goal of such a system is to automatically collect and robustly convert the image data into actionable information. Critical challenges exist to realizing an automated visual inspection system for civil infrastructure. While image data provides high spatial density, extracting relevant information from images that is useful for a specific inspection task, such as the presence and location of damage, is very challenging. To compound this problem, multiple types of information would need to be extracted from every image: for example, most guidelines for inspections require the identification of multiple damage types and describe evaluating the significance of the damage based on the associated material type on which the damage occurs. Additionally, methods need to be developed to extract high-fidelity information from images. When conducting visual inspections, human inspectors are effortlessly able to retrieve high-fidelity descriptions like the precise shape of defects (e.g., cracks), differentiate damage from damage like patterns (e.g., shadows, cables), and identify the structural components on which the damage occurs (e.g., walls, beams, columns, etc). Finally, the extracted information must be used to make objective decisions about the condition of the structure. This dissertation develops an automated inspection framework with four main parts, (i) the development of datasets to train supervised deep learning methods, (ii) the acquisition of data from damaged structures using UAVs, (iii) the application of trained deep networks to extract actionable information from the acquired data such as the location and types of damage, and the materials and types of components on which the damage occurs, and (iv) the visualization of results for review by inspectors to enable decision-making. Key challenges in implementing this framework are identified and addressed.","abstract_html":"Visual inspection is the most common means of assessing the condition of civil infrastructure in the United States but can be exceedingly laborious, time consuming, subjective, and even dangerous. Inspections are typically performed by human experts who collect visual or other non-destructive data and combine it with relevant decision-making criteria. Computer vision techniques, in conjunction with acquisition through remote cameras and unmanned aerial vehicles (UAVs), offer promising non-contact solutions to automate civil infrastructure condition assessment. The ultimate goal of such a system is to automatically collect and robustly convert the image data into actionable information. Critical challenges exist to realizing an automated visual inspection system for civil infrastructure. While image data provides high spatial density, extracting relevant information from images that is useful for a specific inspection task, such as the presence and location of damage, is very challenging. To compound this problem, multiple types of information would need to be extracted from every image: for example, most guidelines for inspections require the identification of multiple damage types and describe evaluating the significance of the damage based on the associated material type on which the damage occurs. Additionally, methods need to be developed to extract high-fidelity information from images. When conducting visual inspections, human inspectors are effortlessly able to retrieve high-fidelity descriptions like the precise shape of defects (e.g., cracks), differentiate damage from damage like patterns (e.g., shadows, cables), and identify the structural components on which the damage occurs (e.g., walls, beams, columns, etc). Finally, the extracted information must be used to make objective decisions about the condition of the structure. This dissertation develops an automated inspection framework with four main parts, (i) the development of datasets to train supervised deep learning methods, (ii) the acquisition of data from damaged structures using UAVs, (iii) the application of trained deep networks to extract actionable information from the acquired data such as the location and types of damage, and the materials and types of components on which the damage occurs, and (iv) the visualization of results for review by inspectors to enable decision-making. Key challenges in implementing this framework are identified and addressed.","abstract_has_math":false,"creators":["Hoskere, Vedhus A"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Civil Engineering","degree_department":null,"school":null,"contributors":["Spencer Jr., Billie F.","Golparvar-Fard, Mani","Lazebnik, Svetlana","Chowdhary, Girish","Smith, Matthew D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-03-05T21:45:14Z","date_published":"2021-03-05T21:45:14Z","updated_at":"2026-07-22T22:24:50Z","subjects":["deep learning, structural inspections, structural health monitoring, computer vision, computer graphics, unmanned aerial vehicles"],"languages":["en"],"rights":["Copyright 2020 Vedhus Hoskere"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/109573","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Spencer Jr., Billie F.","Golparvar-Fard, Mani","Lazebnik, Svetlana","Chowdhary, Girish","Smith, Matthew D."]},{"key":"dc:creator","label":"Author","values":["Hoskere, Vedhus A"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2021-03-05T21:45:14Z","2023-03-05T21:47:41Z","2020-11-19","2020-12"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Civil Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["deep learning, structural inspections, structural health monitoring, computer vision, computer graphics, unmanned aerial vehicles"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2020 Vedhus Hoskere"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/109573"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Visual inspection is the most common means of assessing the condition of civil infrastructure in the United States but can be exceedingly laborious, time consuming, subjective, and even dangerous. Inspections are typically performed by human experts who collect visual or other non-destructive data and combine it with relevant decision-making criteria. Computer vision techniques, in conjunction with acquisition through remote cameras and unmanned aerial vehicles (UAVs), offer promising non-contact solutions to automate civil infrastructure condition assessment. The ultimate goal of such a system is to automatically collect and robustly convert the image data into actionable information. Critical challenges exist to realizing an automated visual inspection system for civil infrastructure. While image data provides high spatial density, extracting relevant information from images that is useful for a specific inspection task, such as the presence and location of damage, is very challenging. To compound this problem, multiple types of information would need to be extracted from every image: for example, most guidelines for inspections require the identification of multiple damage types and describe evaluating the significance of the damage based on the associated material type on which the damage occurs. Additionally, methods need to be developed to extract high-fidelity information from images. When conducting visual inspections, human inspectors are effortlessly able to retrieve high-fidelity descriptions like the precise shape of defects (e.g., cracks), differentiate damage from damage like patterns (e.g., shadows, cables), and identify the structural components on which the damage occurs (e.g., walls, beams, columns, etc). Finally, the extracted information must be used to make objective decisions about the condition of the structure. This dissertation develops an automated inspection framework with four main parts, (i) the development of datasets to train supervised deep learning methods, (ii) the acquisition of data from damaged structures using UAVs, (iii) the application of trained deep networks to extract actionable information from the acquired data such as the location and types of damage, and the materials and types of components on which the damage occurs, and (iv) the visualization of results for review by inspectors to enable decision-making. Key challenges in implementing this framework are identified and addressed.","Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2022-12-01","The student, Vedhus Hoskere, accepted the attached license on 2020-11-05 at 10:59.","The student, Vedhus Hoskere, submitted this Dissertation for approval on 2020-11-05 at 11:10.","This Dissertation was approved for publication on 2020-11-19 at 17:12.","DSpace SAF Submission Ingestion Package generated from Vireo submission #15861 on 2021-03-04 at 16:30:41","Made available in DSpace on 2021-03-05T21:45:14Z (GMT). No. of bitstreams: 2 HOSKERE-DISSERTATION-2020.pdf: 6716667 bytes, checksum: a84dd09b5567cb730d01aa17d705822c (MD5) LICENSE.txt: 4211 bytes, checksum: 6c4ca4829ac4e838f3d5df3cd2cf64a4 (MD5) Previous issue date: 2020-11-19","Embargo set by: Seth Robbins for item 117278 Lift date: 2023-03-05T21:45:47Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 117278 Lift date: 2023-03-05T21:47:41Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Developing autonomy in structural inspections through computer vision and graphics"]}]}],"canonical_facts":{"dc:contributor":["Spencer Jr., Billie F.","Golparvar-Fard, Mani","Lazebnik, Svetlana","Chowdhary, Girish","Smith, Matthew D."],"dc:creator":["Hoskere, Vedhus A"],"dc:date":["2021-03-05T21:45:14Z","2023-03-05T21:47:41Z","2020-11-19","2020-12"],"dc:description":["Visual inspection is the most common means of assessing the condition of civil infrastructure in the United States but can be exceedingly laborious, time consuming, subjective, and even dangerous. Inspections are typically performed by human experts who collect visual or other non-destructive data and combine it with relevant decision-making criteria. Computer vision techniques, in conjunction with acquisition through remote cameras and unmanned aerial vehicles (UAVs), offer promising non-contact solutions to automate civil infrastructure condition assessment. The ultimate goal of such a system is to automatically collect and robustly convert the image data into actionable information. Critical challenges exist to realizing an automated visual inspection system for civil infrastructure. While image data provides high spatial density, extracting relevant information from images that is useful for a specific inspection task, such as the presence and location of damage, is very challenging. To compound this problem, multiple types of information would need to be extracted from every image: for example, most guidelines for inspections require the identification of multiple damage types and describe evaluating the significance of the damage based on the associated material type on which the damage occurs. Additionally, methods need to be developed to extract high-fidelity information from images. When conducting visual inspections, human inspectors are effortlessly able to retrieve high-fidelity descriptions like the precise shape of defects (e.g., cracks), differentiate damage from damage like patterns (e.g., shadows, cables), and identify the structural components on which the damage occurs (e.g., walls, beams, columns, etc). Finally, the extracted information must be used to make objective decisions about the condition of the structure. This dissertation develops an automated inspection framework with four main parts, (i) the development of datasets to train supervised deep learning methods, (ii) the acquisition of data from damaged structures using UAVs, (iii) the application of trained deep networks to extract actionable information from the acquired data such as the location and types of damage, and the materials and types of components on which the damage occurs, and (iv) the visualization of results for review by inspectors to enable decision-making. Key challenges in implementing this framework are identified and addressed.","Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2022-12-01","The student, Vedhus Hoskere, accepted the attached license on 2020-11-05 at 10:59.","The student, Vedhus Hoskere, submitted this Dissertation for approval on 2020-11-05 at 11:10.","This Dissertation was approved for publication on 2020-11-19 at 17:12.","DSpace SAF Submission Ingestion Package generated from Vireo submission #15861 on 2021-03-04 at 16:30:41","Made available in DSpace on 2021-03-05T21:45:14Z (GMT). No. of bitstreams: 2 HOSKERE-DISSERTATION-2020.pdf: 6716667 bytes, checksum: a84dd09b5567cb730d01aa17d705822c (MD5) LICENSE.txt: 4211 bytes, checksum: 6c4ca4829ac4e838f3d5df3cd2cf64a4 (MD5) Previous issue date: 2020-11-19","Embargo set by: Seth Robbins for item 117278 Lift date: 2023-03-05T21:45:47Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 117278 Lift date: 2023-03-05T21:47:41Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/109573"],"dc:language":["en"],"dc:rights":["Copyright 2020 Vedhus Hoskere"],"dc:subject":["deep learning, structural inspections, structural health monitoring, computer vision, computer graphics, unmanned aerial vehicles"],"dc:title":["Developing autonomy in structural inspections through computer vision and graphics"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Civil Engineering"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:50Z"}