{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/50402"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/50402","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Crowdsourcing construction activity analysis from jobsite video streams","abstract":"Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2014-07-18T16:10:17Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 Liu_Kaijian.pdf: 15198108 bytes, checksum: 7187095111d51e5b2a0a4cb8d1d66523 (MD5)","abstract_html":"Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2014-07-18T16:10:17Z Item was in collections: University of Illinois Theses &amp; Dissertations (ID: 1) No. of bitstreams: 1 Liu_Kaijian.pdf: 15198108 bytes, checksum: 7187095111d51e5b2a0a4cb8d1d66523 (MD5)","abstract_has_math":false,"creators":["Liu, Kaijian"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Civil Engineering","degree_department":null,"school":null,"contributors":["Golparvar-Fard, Mani"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2014,"date_issued":"2014-09-16T17:12:36Z","date_published":"2014-09-16T17:12:36Z","updated_at":"2026-07-22T22:25:40Z","subjects":["Construction Productivity","Activity Analysis","Workface Assessment","Video-based Monitoring","Crowdsourcing"],"languages":["en"],"rights":["Copyright 2014 Kaijian Liu"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/50402","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Golparvar-Fard, Mani"]},{"key":"dc:creator","label":"Author","values":["Liu, Kaijian"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2014-09-16T17:12:36Z","2016-09-22T20:59:19Z","2014-08","2014-09-16"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Civil Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Construction Productivity","Activity Analysis","Workface Assessment","Video-based Monitoring","Crowdsourcing"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2014 Kaijian Liu"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/50402"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2014-07-18T16:10:17Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 Liu_Kaijian.pdf: 15198108 bytes, checksum: 7187095111d51e5b2a0a4cb8d1d66523 (MD5)","Made available in DSpace on 2014-09-16T17:12:36Z (GMT). No. of bitstreams: 2 Kaijian_Liu.pdf: 15198108 bytes, checksum: 7187095111d51e5b2a0a4cb8d1d66523 (MD5) license.txt: 4059 bytes, checksum: 050b6de27e292d7744737aada48c80e1 (MD5)","Embargo set by: Seth Robbins for item 50513 Lift date: 2016-09-16T17:13:01Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited Restriction Lifted for Item 50513 on 2016-09-22T20:59:19Z.","The advent of affordable cameras is reshaping the way owners and contractors are documenting ongoing construction operations by providing large amount of jobsite video streams for assessing on-site activities. To facilitate assessing these large collections of videos, recent studies have focused on leveraging computer vision algorithms for construction activity analysis and automatic workface assessment process. Despite promising results, understanding human activities from videos are still rather limited. The main gaps in knowledge are: 1) the lack of comprehensive datasets with groundtruth to cover all construction activities, and 2) methods that can deal with high degree of intra-class variability among activities and visual feature similarities among non-direct works. To address the need of reliable workface assessment, and to facilitate the development of computer vision algorithms for automatic activity analysis, this thesis proposes conducting video-based workface assessment in form of a crowdsourcing task at massive marketplace, such as Amazon Mechanical Turk (AMT). The presented method can attract hundreds of human annotators from around the world in seconds to use the compositional structure of worker-activity-posture-tool to analyze videos. Today, the human ability to interpret video content outperforms current vision-based algorithms. Thus, it is hypothesized that with the assistance from crowd intelligence (non-experts) and automatic detection and tracking algorithms, reliable workface assessment results can be quickly collected from jobsite video streams. To validate this hypothesis, a web-based workface assessment tool is developed that supports 1) crowdsourcing of video-based activity analysis tasks at AMT by calling for human annotators’ intelligence to interpret a sparse set of keyframes; 2) a detection and a tracking algorithm to automatically generate workface assessment results for the rest of non-key frames based on the sparse set of user-assisted key frames; and 3) intuitive interfaces for 2D construction resources localization, presentation of compositional structure taxonomy of construction worker activities, visualization of activity analysis results, and quality control strategies. Six different exhaustive experiments are conducted to examine different annotation methods and frequencies, different video lengths to construct HITs (Human Intelligence Tasks), difference between expert and non-expert annotators, difference between linear and detection-based extrapolation methods, and optimal cross-validation strategy to improve workface assessment’s accuracy. The experimental results are presented and discussed by annotation time and accuracy at each level of compositional structure. Our experiments with overall accuracy of 85% for non-expert annotators testify that the quality of work by non-experts annotators at AMT is as reliable as experts on providing accurate and complete workforce assessment. The introduced method has potential to minimize time needed for workface assessment and allows professionals to focus their time on the more important task of root-cause analysis and investigating alternatives for performance improvement."]},{"key":"dc:title","label":"Title","values":["Crowdsourcing construction activity analysis from jobsite video streams"]}]}],"canonical_facts":{"dc:contributor":["Golparvar-Fard, Mani"],"dc:creator":["Liu, Kaijian"],"dc:date":["2014-09-16T17:12:36Z","2016-09-22T20:59:19Z","2014-08","2014-09-16"],"dc:description":["Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2014-07-18T16:10:17Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 Liu_Kaijian.pdf: 15198108 bytes, checksum: 7187095111d51e5b2a0a4cb8d1d66523 (MD5)","Made available in DSpace on 2014-09-16T17:12:36Z (GMT). No. of bitstreams: 2 Kaijian_Liu.pdf: 15198108 bytes, checksum: 7187095111d51e5b2a0a4cb8d1d66523 (MD5) license.txt: 4059 bytes, checksum: 050b6de27e292d7744737aada48c80e1 (MD5)","Embargo set by: Seth Robbins for item 50513 Lift date: 2016-09-16T17:13:01Z Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Limited Restriction Lifted for Item 50513 on 2016-09-22T20:59:19Z.","The advent of affordable cameras is reshaping the way owners and contractors are documenting ongoing construction operations by providing large amount of jobsite video streams for assessing on-site activities. To facilitate assessing these large collections of videos, recent studies have focused on leveraging computer vision algorithms for construction activity analysis and automatic workface assessment process. Despite promising results, understanding human activities from videos are still rather limited. The main gaps in knowledge are: 1) the lack of comprehensive datasets with groundtruth to cover all construction activities, and 2) methods that can deal with high degree of intra-class variability among activities and visual feature similarities among non-direct works. To address the need of reliable workface assessment, and to facilitate the development of computer vision algorithms for automatic activity analysis, this thesis proposes conducting video-based workface assessment in form of a crowdsourcing task at massive marketplace, such as Amazon Mechanical Turk (AMT). The presented method can attract hundreds of human annotators from around the world in seconds to use the compositional structure of worker-activity-posture-tool to analyze videos. Today, the human ability to interpret video content outperforms current vision-based algorithms. Thus, it is hypothesized that with the assistance from crowd intelligence (non-experts) and automatic detection and tracking algorithms, reliable workface assessment results can be quickly collected from jobsite video streams. To validate this hypothesis, a web-based workface assessment tool is developed that supports 1) crowdsourcing of video-based activity analysis tasks at AMT by calling for human annotators’ intelligence to interpret a sparse set of keyframes; 2) a detection and a tracking algorithm to automatically generate workface assessment results for the rest of non-key frames based on the sparse set of user-assisted key frames; and 3) intuitive interfaces for 2D construction resources localization, presentation of compositional structure taxonomy of construction worker activities, visualization of activity analysis results, and quality control strategies. Six different exhaustive experiments are conducted to examine different annotation methods and frequencies, different video lengths to construct HITs (Human Intelligence Tasks), difference between expert and non-expert annotators, difference between linear and detection-based extrapolation methods, and optimal cross-validation strategy to improve workface assessment’s accuracy. The experimental results are presented and discussed by annotation time and accuracy at each level of compositional structure. Our experiments with overall accuracy of 85% for non-expert annotators testify that the quality of work by non-experts annotators at AMT is as reliable as experts on providing accurate and complete workforce assessment. The introduced method has potential to minimize time needed for workface assessment and allows professionals to focus their time on the more important task of root-cause analysis and investigating alternatives for performance improvement."],"dc:identifier":["http://hdl.handle.net/2142/50402"],"dc:language":["en"],"dc:rights":["Copyright 2014 Kaijian Liu"],"dc:subject":["Construction Productivity","Activity Analysis","Workface Assessment","Video-based Monitoring","Crowdsourcing"],"dc:title":["Crowdsourcing construction activity analysis from jobsite video streams"],"dc:type":["text"],"thesis:degree_discipline":["Civil Engineering"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:40Z"}