{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/99371"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/99371","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Sensor data analytics and web applications to improve monitoring and understanding of lake processes","abstract":"Lakes are complex systems that involve numerous physical, chemical and biological processes. With modern sensor technology, large amounts of sensor data on lake water chemistry are being generated to help researchers understand the spatial and temporal patterns of these lake processes. Each sensor generates different datasets and effectively utilizing the resulting large and diverse datasets to improve understanding of lake processes and optimize sampling strategies is essential to protect and improve lake resources. For example, in the Great Lakes, the case study in this thesis, the US Environmental Protection Agency (USEPA) conducts several monitoring programs with various sensors, including the TRIAXUS undulating vehicle, the Sea-Bird CTD (Conductivity, Temperature, Depth) depth profiler, and a dissolved oxygen (DO) logger network that are the focus of this study. In this work, we develop three data analysis frameworks to support limnologists in more effectively collecting and analyzing these types of datasets, providing a lake system perspective. The frameworks have been made available to the research community as open-source code, including three prototype interactive Web applications. For towed undulating vehicles such as TRIAXUS, we propose a geospatial analysis framework and software to interpret water-quality sampling data in near-real time. The framework includes data quality assurance and quality control processes, automated kriging interpolation along undulating paths, and local hotspot and cluster analyses. The approach is demonstrated using historical sampling data from an undulating vehicle deployed at three rivermouth sites in Lake Michigan during 2011. The normalized root-mean-square error (NRMSE) of the interpolation averages approximately 10% in 3-fold cross validation. The results show that the framework can be used to track river plume dynamics and provide insights on mixing, which could be related to wind and seiche events. Next, we develop and test algorithms for rapid and consistent analysis of depth profiling data sampled from CTD profilers to identify lake stratifications and deep chlorophyll layers (DCL). We develop a segmentation method to approximate vertical temperature profiles with linear segments using Piecewise Linear Representation (PLR) algorithm, from which stratification patterns can be extracted. We also propose an automated peak detection algorithm to identify the fluorescence peak where the DCL lies. Testing the algorithms with data from the Great Lakes, we obtained similar results to human judgments from historical surveys. The algorithms are able to reveal spatial and temporal trends of the thermocline and DCL, as well as analyzing the shape of temperature and fluorescence profiles to detect unusual patterns such as a double thermocline. Finally, we develop a spatio-temporal interpolation framework that identifies the spatially varying temporal trend and estimates hourly hypoxia extent (dissolved oxygen [DO] concentration lower than 2mg/L) with estimation uncertainty. The framework is used to analyze spatio-temporal datasets of dissolved oxygen in Lake Erie, which were sampled from a logger network placed at the lake bottom in 2014, 2015, and 2016. The results show that hypoxia developed differently in these years. The locations with longest total hypoxic duration and longest continuous hypoxic duration are also different. Based on cross-validation results and DO time series patterns, some implications for optimizing logger locations are discussed.","abstract_html":"Lakes are complex systems that involve numerous physical, chemical and biological processes. With modern sensor technology, large amounts of sensor data on lake water chemistry are being generated to help researchers understand the spatial and temporal patterns of these lake processes. Each sensor generates different datasets and effectively utilizing the resulting large and diverse datasets to improve understanding of lake processes and optimize sampling strategies is essential to protect and improve lake resources. For example, in the Great Lakes, the case study in this thesis, the US Environmental Protection Agency (USEPA) conducts several monitoring programs with various sensors, including the TRIAXUS undulating vehicle, the Sea-Bird CTD (Conductivity, Temperature, Depth) depth profiler, and a dissolved oxygen (DO) logger network that are the focus of this study. In this work, we develop three data analysis frameworks to support limnologists in more effectively collecting and analyzing these types of datasets, providing a lake system perspective. The frameworks have been made available to the research community as open-source code, including three prototype interactive Web applications. For towed undulating vehicles such as TRIAXUS, we propose a geospatial analysis framework and software to interpret water-quality sampling data in near-real time. The framework includes data quality assurance and quality control processes, automated kriging interpolation along undulating paths, and local hotspot and cluster analyses. The approach is demonstrated using historical sampling data from an undulating vehicle deployed at three rivermouth sites in Lake Michigan during 2011. The normalized root-mean-square error (NRMSE) of the interpolation averages approximately 10% in 3-fold cross validation. The results show that the framework can be used to track river plume dynamics and provide insights on mixing, which could be related to wind and seiche events. Next, we develop and test algorithms for rapid and consistent analysis of depth profiling data sampled from CTD profilers to identify lake stratifications and deep chlorophyll layers (DCL). We develop a segmentation method to approximate vertical temperature profiles with linear segments using Piecewise Linear Representation (PLR) algorithm, from which stratification patterns can be extracted. We also propose an automated peak detection algorithm to identify the fluorescence peak where the DCL lies. Testing the algorithms with data from the Great Lakes, we obtained similar results to human judgments from historical surveys. The algorithms are able to reveal spatial and temporal trends of the thermocline and DCL, as well as analyzing the shape of temperature and fluorescence profiles to detect unusual patterns such as a double thermocline. Finally, we develop a spatio-temporal interpolation framework that identifies the spatially varying temporal trend and estimates hourly hypoxia extent (dissolved oxygen [DO] concentration lower than 2mg/L) with estimation uncertainty. The framework is used to analyze spatio-temporal datasets of dissolved oxygen in Lake Erie, which were sampled from a logger network placed at the lake bottom in 2014, 2015, and 2016. The results show that hypoxia developed differently in these years. The locations with longest total hypoxic duration and longest continuous hypoxic duration are also different. Based on cross-validation results and DO time series patterns, some implications for optimizing logger locations are discussed.","abstract_has_math":false,"creators":["Xu, Wenzhao"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Environ Engr in Civil Engr","degree_department":null,"school":null,"contributors":["Minsker, Barbara","Valocchi, Albert","Collingsworth, Paris","Liang, Feng"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2018,"date_issued":"2018-03-13T15:48:56Z","date_published":"2018-03-13T15:48:56Z","updated_at":"2026-07-22T22:24:37Z","subjects":["Water quality","Decision support","Adaptive sampling","Data mining","Plumes","Lake stratification","Deep chlorophyll layers (DCL)","Hypoxia"],"languages":["en"],"rights":["Copyright 2017 Wenzhao Xu"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/99371","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Minsker, Barbara","Valocchi, Albert","Collingsworth, Paris","Liang, Feng"]},{"key":"dc:creator","label":"Author","values":["Xu, Wenzhao"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2018-03-13T15:48:56Z","2017-12-05","2017-12"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Environ Engr in Civil Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Water quality","Decision support","Adaptive sampling","Data mining","Plumes","Lake stratification","Deep chlorophyll layers (DCL)","Hypoxia"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2017 Wenzhao Xu"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/99371"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Lakes are complex systems that involve numerous physical, chemical and biological processes. With modern sensor technology, large amounts of sensor data on lake water chemistry are being generated to help researchers understand the spatial and temporal patterns of these lake processes. Each sensor generates different datasets and effectively utilizing the resulting large and diverse datasets to improve understanding of lake processes and optimize sampling strategies is essential to protect and improve lake resources. For example, in the Great Lakes, the case study in this thesis, the US Environmental Protection Agency (USEPA) conducts several monitoring programs with various sensors, including the TRIAXUS undulating vehicle, the Sea-Bird CTD (Conductivity, Temperature, Depth) depth profiler, and a dissolved oxygen (DO) logger network that are the focus of this study. In this work, we develop three data analysis frameworks to support limnologists in more effectively collecting and analyzing these types of datasets, providing a lake system perspective. The frameworks have been made available to the research community as open-source code, including three prototype interactive Web applications. For towed undulating vehicles such as TRIAXUS, we propose a geospatial analysis framework and software to interpret water-quality sampling data in near-real time. The framework includes data quality assurance and quality control processes, automated kriging interpolation along undulating paths, and local hotspot and cluster analyses. The approach is demonstrated using historical sampling data from an undulating vehicle deployed at three rivermouth sites in Lake Michigan during 2011. The normalized root-mean-square error (NRMSE) of the interpolation averages approximately 10% in 3-fold cross validation. The results show that the framework can be used to track river plume dynamics and provide insights on mixing, which could be related to wind and seiche events. Next, we develop and test algorithms for rapid and consistent analysis of depth profiling data sampled from CTD profilers to identify lake stratifications and deep chlorophyll layers (DCL). We develop a segmentation method to approximate vertical temperature profiles with linear segments using Piecewise Linear Representation (PLR) algorithm, from which stratification patterns can be extracted. We also propose an automated peak detection algorithm to identify the fluorescence peak where the DCL lies. Testing the algorithms with data from the Great Lakes, we obtained similar results to human judgments from historical surveys. The algorithms are able to reveal spatial and temporal trends of the thermocline and DCL, as well as analyzing the shape of temperature and fluorescence profiles to detect unusual patterns such as a double thermocline. Finally, we develop a spatio-temporal interpolation framework that identifies the spatially varying temporal trend and estimates hourly hypoxia extent (dissolved oxygen [DO] concentration lower than 2mg/L) with estimation uncertainty. The framework is used to analyze spatio-temporal datasets of dissolved oxygen in Lake Erie, which were sampled from a logger network placed at the lake bottom in 2014, 2015, and 2016. The results show that hypoxia developed differently in these years. The locations with longest total hypoxic duration and longest continuous hypoxic duration are also different. Based on cross-validation results and DO time series patterns, some implications for optimizing logger locations are discussed.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2018-03-13 without embargo terms","The student, Wenzhao Xu, accepted the attached license on 2017-12-05 at 00:07.","The student, Wenzhao Xu, submitted this Dissertation for approval on 2017-12-05 at 00:13.","This Dissertation was approved for publication on 2017-12-05 at 17:02.","DSpace SAF Submission Ingestion Package generated from Vireo submission #11850 on 2018-03-13 at 10:10:43","Made available in DSpace on 2018-03-13T15:48:56Z (GMT). No. of bitstreams: 3 XU-DISSERTATION-2017.pdf: 23661547 bytes, checksum: a848fa7f016ed246b4dd590915a6c574 (MD5) LICENSE.txt: 4207 bytes, checksum: ac64e6a2ce955571a7e8e2cf7e795c50 (MD5) PROQUEST_LICENSE.txt: 4553 bytes, checksum: 0a95c5649a43db9193c6bb3fb5a22a09 (MD5) Previous issue date: 2017-12-05"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Sensor data analytics and web applications to improve monitoring and understanding of lake processes"]}]}],"canonical_facts":{"dc:contributor":["Minsker, Barbara","Valocchi, Albert","Collingsworth, Paris","Liang, Feng"],"dc:creator":["Xu, Wenzhao"],"dc:date":["2018-03-13T15:48:56Z","2017-12-05","2017-12"],"dc:description":["Lakes are complex systems that involve numerous physical, chemical and biological processes. With modern sensor technology, large amounts of sensor data on lake water chemistry are being generated to help researchers understand the spatial and temporal patterns of these lake processes. Each sensor generates different datasets and effectively utilizing the resulting large and diverse datasets to improve understanding of lake processes and optimize sampling strategies is essential to protect and improve lake resources. For example, in the Great Lakes, the case study in this thesis, the US Environmental Protection Agency (USEPA) conducts several monitoring programs with various sensors, including the TRIAXUS undulating vehicle, the Sea-Bird CTD (Conductivity, Temperature, Depth) depth profiler, and a dissolved oxygen (DO) logger network that are the focus of this study. In this work, we develop three data analysis frameworks to support limnologists in more effectively collecting and analyzing these types of datasets, providing a lake system perspective. The frameworks have been made available to the research community as open-source code, including three prototype interactive Web applications. For towed undulating vehicles such as TRIAXUS, we propose a geospatial analysis framework and software to interpret water-quality sampling data in near-real time. The framework includes data quality assurance and quality control processes, automated kriging interpolation along undulating paths, and local hotspot and cluster analyses. The approach is demonstrated using historical sampling data from an undulating vehicle deployed at three rivermouth sites in Lake Michigan during 2011. The normalized root-mean-square error (NRMSE) of the interpolation averages approximately 10% in 3-fold cross validation. The results show that the framework can be used to track river plume dynamics and provide insights on mixing, which could be related to wind and seiche events. Next, we develop and test algorithms for rapid and consistent analysis of depth profiling data sampled from CTD profilers to identify lake stratifications and deep chlorophyll layers (DCL). We develop a segmentation method to approximate vertical temperature profiles with linear segments using Piecewise Linear Representation (PLR) algorithm, from which stratification patterns can be extracted. We also propose an automated peak detection algorithm to identify the fluorescence peak where the DCL lies. Testing the algorithms with data from the Great Lakes, we obtained similar results to human judgments from historical surveys. The algorithms are able to reveal spatial and temporal trends of the thermocline and DCL, as well as analyzing the shape of temperature and fluorescence profiles to detect unusual patterns such as a double thermocline. Finally, we develop a spatio-temporal interpolation framework that identifies the spatially varying temporal trend and estimates hourly hypoxia extent (dissolved oxygen [DO] concentration lower than 2mg/L) with estimation uncertainty. The framework is used to analyze spatio-temporal datasets of dissolved oxygen in Lake Erie, which were sampled from a logger network placed at the lake bottom in 2014, 2015, and 2016. The results show that hypoxia developed differently in these years. The locations with longest total hypoxic duration and longest continuous hypoxic duration are also different. Based on cross-validation results and DO time series patterns, some implications for optimizing logger locations are discussed.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2018-03-13 without embargo terms","The student, Wenzhao Xu, accepted the attached license on 2017-12-05 at 00:07.","The student, Wenzhao Xu, submitted this Dissertation for approval on 2017-12-05 at 00:13.","This Dissertation was approved for publication on 2017-12-05 at 17:02.","DSpace SAF Submission Ingestion Package generated from Vireo submission #11850 on 2018-03-13 at 10:10:43","Made available in DSpace on 2018-03-13T15:48:56Z (GMT). No. of bitstreams: 3 XU-DISSERTATION-2017.pdf: 23661547 bytes, checksum: a848fa7f016ed246b4dd590915a6c574 (MD5) LICENSE.txt: 4207 bytes, checksum: ac64e6a2ce955571a7e8e2cf7e795c50 (MD5) PROQUEST_LICENSE.txt: 4553 bytes, checksum: 0a95c5649a43db9193c6bb3fb5a22a09 (MD5) Previous issue date: 2017-12-05"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/99371"],"dc:language":["en"],"dc:rights":["Copyright 2017 Wenzhao Xu"],"dc:subject":["Water quality","Decision support","Adaptive sampling","Data mining","Plumes","Lake stratification","Deep chlorophyll layers (DCL)","Hypoxia"],"dc:title":["Sensor data analytics and web applications to improve monitoring and understanding of lake processes"],"dc:type":["text"],"thesis:degree_discipline":["Environ Engr in Civil Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:37Z"}