{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/119761"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/119761","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"A deep learning approach to state estimation from videos","abstract":"Kalman lters have been commonly used for estimating the state of a vehicle from a video. Multi-State Constraint Kalman Filter (MSCKF) is an EKF-based state estimator that uses feature measurements for pose estimation of a vehicle. These models require a lot of hands-on engineering time to dene the measurement functions. We propose a data-driven approach by training deep neural networks on high-dimensional navigation image data generated from a simulation. We describe a CNN model that robustly learns reliable features from the input and gives promising results to model temporal data. We show that a deep learning approach can be a replacement for the MSCKF model for estimating the velocity of a moving vehicle.","abstract_html":"Kalman lters have been commonly used for estimating the state of a vehicle from a video. Multi-State Constraint Kalman Filter (MSCKF) is an EKF-based state estimator that uses feature measurements for pose estimation of a vehicle. These models require a lot of hands-on engineering time to dene the measurement functions. We propose a data-driven approach by training deep neural networks on high-dimensional navigation image data generated from a simulation. We describe a CNN model that robustly learns reliable features from the input and gives promising results to model temporal data. We show that a deep learning approach can be a replacement for the MSCKF model for estimating the velocity of a moving vehicle.","abstract_has_math":false,"creators":["Doshi, Chandani"],"institution":"Massachusetts Institute of Technology","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.","school":null,"contributors":[],"advisors":["Rebecca L. Russell and Leslie P. Kaelbling."],"committee_chairs":[],"committee_members":[],"year":2018,"date_issued":"2018","date_published":"2018","updated_at":"2026-07-22T22:21:16Z","subjects":["Electrical Engineering and Computer Science."],"languages":["eng"],"rights":["MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission."],"rights_urls":["http://dspace.mit.edu/handle/1721.1/7582"],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/1721.1/119761","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Rebecca L. Russell and Leslie P. Kaelbling."]},{"key":"dc:contributor.department","label":"Department","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."]},{"key":"dc:creator","label":"Author","values":["Doshi, Chandani"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2018-12-18T19:48:55Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2018-12-18T19:48:55Z"]},{"key":"dc:date.issued","label":"Date","values":["2018"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Electrical Engineering and Computer Science."]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission."]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://dspace.mit.edu/handle/1721.1/7582"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/1721.1/119761"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2018.","This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.","Cataloged from student-submitted PDF version of thesis.","Includes bibliographical references (pages 45-47)."]},{"key":"dc:description.abstract","label":"Abstract","values":["Kalman lters have been commonly used for estimating the state of a vehicle from a video. Multi-State Constraint Kalman Filter (MSCKF) is an EKF-based state estimator that uses feature measurements for pose estimation of a vehicle. These models require a lot of hands-on engineering time to dene the measurement functions. We propose a data-driven approach by training deep neural networks on high-dimensional navigation image data generated from a simulation. We describe a CNN model that robustly learns reliable features from the input and gives promising results to model temporal data. We show that a deep learning approach can be a replacement for the MSCKF model for estimating the velocity of a moving vehicle."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["M. Eng."]},{"key":"dc:title","label":"Title","values":["A deep learning approach to state estimation from videos"]}]}],"canonical_facts":{"dc:contributor.advisor":["Rebecca L. Russell and Leslie P. Kaelbling."],"dc:contributor.department":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."],"dc:contributor.other":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."],"dc:creator":["Doshi, Chandani"],"dc:date.accessioned":["2018-12-18T19:48:55Z"],"dc:date.available":["2018-12-18T19:48:55Z"],"dc:date.issued":["2018"],"dc:description":["Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2018.","This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.","Cataloged from student-submitted PDF version of thesis.","Includes bibliographical references (pages 45-47)."],"dc:description.abstract":["Kalman lters have been commonly used for estimating the state of a vehicle from a video. Multi-State Constraint Kalman Filter (MSCKF) is an EKF-based state estimator that uses feature measurements for pose estimation of a vehicle. These models require a lot of hands-on engineering time to dene the measurement functions. We propose a data-driven approach by training deep neural networks on high-dimensional navigation image data generated from a simulation. We describe a CNN model that robustly learns reliable features from the input and gives promising results to model temporal data. We show that a deep learning approach can be a replacement for the MSCKF model for estimating the velocity of a moving vehicle."],"dc:description.degree":["M. Eng."],"dc:identifier.uri":["http://hdl.handle.net/1721.1/119761"],"dc:language.iso":["eng"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission."],"dc:rights.uri":["http://dspace.mit.edu/handle/1721.1/7582"],"dc:subject":["Electrical Engineering and Computer Science."],"dc:title":["A deep learning approach to state estimation from videos"],"dc:type":["Thesis"]},"updated_at":"2026-07-22T22:21:16Z"}