{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/97501"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/97501","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"GPS-LiDAR sensor fusion aided by 3D city models for UAVs","abstract":"Recently, there has been an increase in outdoor applications for small-scale Unmanned Aerial Vehicles (UAVs), such as 3D modelling, filming, surveillance, and search and rescue. To perform these tasks safely and reliably, a continuous and accurate estimate of the UAVs’ positions is needed. Global Positioning System (GPS) receivers are commonly used for this purpose. However, navigating in urban areas using only GPS is challenging, since satellite signals might be reflected or blocked by buildings, resulting in multipath errors or non-line-of-sight (NLOS) situations. In such cases, additional on-board sensors are desirable to improve global positioning of the UAV. Light Detection and Ranging (LiDAR), one such sensor, provides a real-time point cloud of its surroundings. In a dense urban environment, LiDAR is able to detect a large number of features of surrounding structures, such as buildings, as opposed to in an open-sky environment. This characteristic of LiDAR complements GPS, which is accurate in open-sky environments, but may suffer large errors in urban areas. To fuse GPS and LiDAR measurements, Kalman Filtering and its variations are commonly used. However, it is important, yet challenging, to accurately characterize the error covariance of the sensor measurements. In this thesis, we propose a GPS-LiDAR fusion technique with a novel method for efficiently modelling the error covariance in position measurements based on LiDAR point clouds. For GPS measurements, we eliminate NLOS satellites and model the covariance based on the measurement signal-to-noise ratio (SNR) values. We use the LiDAR point clouds in two ways: to estimate incremental motion by matching consecutive point clouds; and, to estimate global pose by matching with a 3D city model. We aim to characterize the error covariance matrices in these two aspects as a function of the distribution of features in the LiDAR point cloud. To estimate the incremental motion between two consecutive LiDAR point clouds, we use the Iterative Closest Point (ICP) algorithm. We perform simulations in different environments to showcase the dependence of ICP on features in the point cloud. While navigating in urban areas, we expect the LiDAR to detect structured objects, such as buildings, which are primarily composed of surfaces and edges. Thus, we develop an efficient way for modelling the error covariance in the estimated incremental position based on each surface and edge feature point in the point cloud. A surface point helps to estimate motion of the LiDAR perpendicular to the surface, while an edge point helps to estimate motion of the LiDAR perpendicular to the edge. We treat each feature point independently and combine their individual error covariance to obtain a total error covariance ellipsoid for the estimated incremental position. For our 3D city model, we use elevation data of the State of Illinois available online and combine it with building information extracted from OpenStreetMap, a crowd-sourced mapping platform. We again use the ICP algorithm to match the LiDAR point cloud with our 3D city model, which provides us with an estimate of the UAV's global pose. Additionally, we also use the 3D city model to determine and eliminate NLOS GPS satellites. We use remaining pseudorange measurements from the on-board GPS receiver and a stationary reference receiver to create a vector of double-difference measurements. We create a covariance matrix for the GPS double-difference measurement vector based on SNR of the individual pseudorange measurements. Finally, all the above measurements and error covariance matrices are provided as an input to an Unscented Kalman Filter (UKF). The states of the filter include the globally referenced pose of the UAV. Before implementation, we perform an observability analysis for our filter. To validate our algorithm, we conduct UAV experiments in GPS-challenged urban environments on the University of Illinois at Urbana-Champaign campus. We observe that our model for the covariance ellipsoid from on-board LiDAR point clouds accurately represents the position errors and improves the filter output. We demonstrate a clear improvement in the UAV's global pose estimates using the proposed sensor fusion technique.","abstract_html":"Recently, there has been an increase in outdoor applications for small-scale Unmanned Aerial Vehicles (UAVs), such as 3D modelling, filming, surveillance, and search and rescue. To perform these tasks safely and reliably, a continuous and accurate estimate of the UAVs’ positions is needed. Global Positioning System (GPS) receivers are commonly used for this purpose. However, navigating in urban areas using only GPS is challenging, since satellite signals might be reflected or blocked by buildings, resulting in multipath errors or non-line-of-sight (NLOS) situations. In such cases, additional on-board sensors are desirable to improve global positioning of the UAV. Light Detection and Ranging (LiDAR), one such sensor, provides a real-time point cloud of its surroundings. In a dense urban environment, LiDAR is able to detect a large number of features of surrounding structures, such as buildings, as opposed to in an open-sky environment. This characteristic of LiDAR complements GPS, which is accurate in open-sky environments, but may suffer large errors in urban areas. To fuse GPS and LiDAR measurements, Kalman Filtering and its variations are commonly used. However, it is important, yet challenging, to accurately characterize the error covariance of the sensor measurements. In this thesis, we propose a GPS-LiDAR fusion technique with a novel method for efficiently modelling the error covariance in position measurements based on LiDAR point clouds. For GPS measurements, we eliminate NLOS satellites and model the covariance based on the measurement signal-to-noise ratio (SNR) values. We use the LiDAR point clouds in two ways: to estimate incremental motion by matching consecutive point clouds; and, to estimate global pose by matching with a 3D city model. We aim to characterize the error covariance matrices in these two aspects as a function of the distribution of features in the LiDAR point cloud. To estimate the incremental motion between two consecutive LiDAR point clouds, we use the Iterative Closest Point (ICP) algorithm. We perform simulations in different environments to showcase the dependence of ICP on features in the point cloud. While navigating in urban areas, we expect the LiDAR to detect structured objects, such as buildings, which are primarily composed of surfaces and edges. Thus, we develop an efficient way for modelling the error covariance in the estimated incremental position based on each surface and edge feature point in the point cloud. A surface point helps to estimate motion of the LiDAR perpendicular to the surface, while an edge point helps to estimate motion of the LiDAR perpendicular to the edge. We treat each feature point independently and combine their individual error covariance to obtain a total error covariance ellipsoid for the estimated incremental position. For our 3D city model, we use elevation data of the State of Illinois available online and combine it with building information extracted from OpenStreetMap, a crowd-sourced mapping platform. We again use the ICP algorithm to match the LiDAR point cloud with our 3D city model, which provides us with an estimate of the UAV's global pose. Additionally, we also use the 3D city model to determine and eliminate NLOS GPS satellites. We use remaining pseudorange measurements from the on-board GPS receiver and a stationary reference receiver to create a vector of double-difference measurements. We create a covariance matrix for the GPS double-difference measurement vector based on SNR of the individual pseudorange measurements. Finally, all the above measurements and error covariance matrices are provided as an input to an Unscented Kalman Filter (UKF). The states of the filter include the globally referenced pose of the UAV. Before implementation, we perform an observability analysis for our filter. To validate our algorithm, we conduct UAV experiments in GPS-challenged urban environments on the University of Illinois at Urbana-Champaign campus. We observe that our model for the covariance ellipsoid from on-board LiDAR point clouds accurately represents the position errors and improves the filter output. We demonstrate a clear improvement in the UAV's global pose estimates using the proposed sensor fusion technique.","abstract_has_math":false,"creators":["Shetty, Akshay Prabhakar"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Aerospace Engineering","degree_department":null,"school":null,"contributors":["Gao, Grace Xingxin"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2017,"date_issued":"2017-08-10T19:16:18Z","date_published":"2017-08-10T19:16:18Z","updated_at":"2026-07-22T22:24:34Z","subjects":["Global positioning system (GPS)","Light detection and ranging (LiDAR)","Unmanned aerial vehicles","Sensor fusion","Outdoor navigation","Light detection and ranging (LiDAR) covariance","Iterative closest point"],"languages":["en"],"rights":["Copyright 2017 Akshay Shetty"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/97501","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Gao, Grace Xingxin"]},{"key":"dc:creator","label":"Author","values":["Shetty, Akshay Prabhakar"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2017-08-10T19:16:18Z","2017-04-27","2017-05"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Aerospace Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Global positioning system (GPS)","Light detection and ranging (LiDAR)","Unmanned aerial vehicles","Sensor fusion","Outdoor navigation","Light detection and ranging (LiDAR) covariance","Iterative closest point"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2017 Akshay Shetty"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/97501"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Recently, there has been an increase in outdoor applications for small-scale Unmanned Aerial Vehicles (UAVs), such as 3D modelling, filming, surveillance, and search and rescue. To perform these tasks safely and reliably, a continuous and accurate estimate of the UAVs’ positions is needed. Global Positioning System (GPS) receivers are commonly used for this purpose. However, navigating in urban areas using only GPS is challenging, since satellite signals might be reflected or blocked by buildings, resulting in multipath errors or non-line-of-sight (NLOS) situations. In such cases, additional on-board sensors are desirable to improve global positioning of the UAV. Light Detection and Ranging (LiDAR), one such sensor, provides a real-time point cloud of its surroundings. In a dense urban environment, LiDAR is able to detect a large number of features of surrounding structures, such as buildings, as opposed to in an open-sky environment. This characteristic of LiDAR complements GPS, which is accurate in open-sky environments, but may suffer large errors in urban areas. To fuse GPS and LiDAR measurements, Kalman Filtering and its variations are commonly used. However, it is important, yet challenging, to accurately characterize the error covariance of the sensor measurements. In this thesis, we propose a GPS-LiDAR fusion technique with a novel method for efficiently modelling the error covariance in position measurements based on LiDAR point clouds. For GPS measurements, we eliminate NLOS satellites and model the covariance based on the measurement signal-to-noise ratio (SNR) values. We use the LiDAR point clouds in two ways: to estimate incremental motion by matching consecutive point clouds; and, to estimate global pose by matching with a 3D city model. We aim to characterize the error covariance matrices in these two aspects as a function of the distribution of features in the LiDAR point cloud. To estimate the incremental motion between two consecutive LiDAR point clouds, we use the Iterative Closest Point (ICP) algorithm. We perform simulations in different environments to showcase the dependence of ICP on features in the point cloud. While navigating in urban areas, we expect the LiDAR to detect structured objects, such as buildings, which are primarily composed of surfaces and edges. Thus, we develop an efficient way for modelling the error covariance in the estimated incremental position based on each surface and edge feature point in the point cloud. A surface point helps to estimate motion of the LiDAR perpendicular to the surface, while an edge point helps to estimate motion of the LiDAR perpendicular to the edge. We treat each feature point independently and combine their individual error covariance to obtain a total error covariance ellipsoid for the estimated incremental position. For our 3D city model, we use elevation data of the State of Illinois available online and combine it with building information extracted from OpenStreetMap, a crowd-sourced mapping platform. We again use the ICP algorithm to match the LiDAR point cloud with our 3D city model, which provides us with an estimate of the UAV's global pose. Additionally, we also use the 3D city model to determine and eliminate NLOS GPS satellites. We use remaining pseudorange measurements from the on-board GPS receiver and a stationary reference receiver to create a vector of double-difference measurements. We create a covariance matrix for the GPS double-difference measurement vector based on SNR of the individual pseudorange measurements. Finally, all the above measurements and error covariance matrices are provided as an input to an Unscented Kalman Filter (UKF). The states of the filter include the globally referenced pose of the UAV. Before implementation, we perform an observability analysis for our filter. To validate our algorithm, we conduct UAV experiments in GPS-challenged urban environments on the University of Illinois at Urbana-Champaign campus. We observe that our model for the covariance ellipsoid from on-board LiDAR point clouds accurately represents the position errors and improves the filter output. We demonstrate a clear improvement in the UAV's global pose estimates using the proposed sensor fusion technique.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2017-08-10 without embargo terms","The student, Akshay Shetty, accepted the attached license on 2017-04-26 at 17:59.","The student, Akshay Shetty, submitted this Thesis for approval on 2017-04-26 at 18:08.","This Thesis was approved for publication on 2017-04-27 at 14:08.","DSpace SAF Submission Ingestion Package generated from Vireo submission #11102 on 2017-08-10 at 13:46:51","Made available in DSpace on 2017-08-10T19:16:18Z (GMT). No. of bitstreams: 2 SHETTY-THESIS-2017.pdf: 9485208 bytes, checksum: c3a9478c9900a4586d0050997d620b67 (MD5) LICENSE.txt: 4210 bytes, checksum: bfae4bcfb76c2774a955b81c48e3d796 (MD5) Previous issue date: 2017-04-27"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["GPS-LiDAR sensor fusion aided by 3D city models for UAVs"]}]}],"canonical_facts":{"dc:contributor":["Gao, Grace Xingxin"],"dc:creator":["Shetty, Akshay Prabhakar"],"dc:date":["2017-08-10T19:16:18Z","2017-04-27","2017-05"],"dc:description":["Recently, there has been an increase in outdoor applications for small-scale Unmanned Aerial Vehicles (UAVs), such as 3D modelling, filming, surveillance, and search and rescue. To perform these tasks safely and reliably, a continuous and accurate estimate of the UAVs’ positions is needed. Global Positioning System (GPS) receivers are commonly used for this purpose. However, navigating in urban areas using only GPS is challenging, since satellite signals might be reflected or blocked by buildings, resulting in multipath errors or non-line-of-sight (NLOS) situations. In such cases, additional on-board sensors are desirable to improve global positioning of the UAV. Light Detection and Ranging (LiDAR), one such sensor, provides a real-time point cloud of its surroundings. In a dense urban environment, LiDAR is able to detect a large number of features of surrounding structures, such as buildings, as opposed to in an open-sky environment. This characteristic of LiDAR complements GPS, which is accurate in open-sky environments, but may suffer large errors in urban areas. To fuse GPS and LiDAR measurements, Kalman Filtering and its variations are commonly used. However, it is important, yet challenging, to accurately characterize the error covariance of the sensor measurements. In this thesis, we propose a GPS-LiDAR fusion technique with a novel method for efficiently modelling the error covariance in position measurements based on LiDAR point clouds. For GPS measurements, we eliminate NLOS satellites and model the covariance based on the measurement signal-to-noise ratio (SNR) values. We use the LiDAR point clouds in two ways: to estimate incremental motion by matching consecutive point clouds; and, to estimate global pose by matching with a 3D city model. We aim to characterize the error covariance matrices in these two aspects as a function of the distribution of features in the LiDAR point cloud. To estimate the incremental motion between two consecutive LiDAR point clouds, we use the Iterative Closest Point (ICP) algorithm. We perform simulations in different environments to showcase the dependence of ICP on features in the point cloud. While navigating in urban areas, we expect the LiDAR to detect structured objects, such as buildings, which are primarily composed of surfaces and edges. Thus, we develop an efficient way for modelling the error covariance in the estimated incremental position based on each surface and edge feature point in the point cloud. A surface point helps to estimate motion of the LiDAR perpendicular to the surface, while an edge point helps to estimate motion of the LiDAR perpendicular to the edge. We treat each feature point independently and combine their individual error covariance to obtain a total error covariance ellipsoid for the estimated incremental position. For our 3D city model, we use elevation data of the State of Illinois available online and combine it with building information extracted from OpenStreetMap, a crowd-sourced mapping platform. We again use the ICP algorithm to match the LiDAR point cloud with our 3D city model, which provides us with an estimate of the UAV's global pose. Additionally, we also use the 3D city model to determine and eliminate NLOS GPS satellites. We use remaining pseudorange measurements from the on-board GPS receiver and a stationary reference receiver to create a vector of double-difference measurements. We create a covariance matrix for the GPS double-difference measurement vector based on SNR of the individual pseudorange measurements. Finally, all the above measurements and error covariance matrices are provided as an input to an Unscented Kalman Filter (UKF). The states of the filter include the globally referenced pose of the UAV. Before implementation, we perform an observability analysis for our filter. To validate our algorithm, we conduct UAV experiments in GPS-challenged urban environments on the University of Illinois at Urbana-Champaign campus. We observe that our model for the covariance ellipsoid from on-board LiDAR point clouds accurately represents the position errors and improves the filter output. We demonstrate a clear improvement in the UAV's global pose estimates using the proposed sensor fusion technique.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2017-08-10 without embargo terms","The student, Akshay Shetty, accepted the attached license on 2017-04-26 at 17:59.","The student, Akshay Shetty, submitted this Thesis for approval on 2017-04-26 at 18:08.","This Thesis was approved for publication on 2017-04-27 at 14:08.","DSpace SAF Submission Ingestion Package generated from Vireo submission #11102 on 2017-08-10 at 13:46:51","Made available in DSpace on 2017-08-10T19:16:18Z (GMT). No. of bitstreams: 2 SHETTY-THESIS-2017.pdf: 9485208 bytes, checksum: c3a9478c9900a4586d0050997d620b67 (MD5) LICENSE.txt: 4210 bytes, checksum: bfae4bcfb76c2774a955b81c48e3d796 (MD5) Previous issue date: 2017-04-27"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/97501"],"dc:language":["en"],"dc:rights":["Copyright 2017 Akshay Shetty"],"dc:subject":["Global positioning system (GPS)","Light detection and ranging (LiDAR)","Unmanned aerial vehicles","Sensor fusion","Outdoor navigation","Light detection and ranging (LiDAR) covariance","Iterative closest point"],"dc:title":["GPS-LiDAR sensor fusion aided by 3D city models for UAVs"],"dc:type":["text"],"thesis:degree_discipline":["Aerospace Engineering"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:34Z"}