{"id":{"repo_id":"vt","oai_identifier":"oai:vtechworks.lib.vt.edu:10919/125112"},"canonical_url":"https://search.dev.ndltd.org/etd/vt/oai:vtechworks.lib.vt.edu:10919/125112","repository":{"repo_id":"vt","name":"Virginia Tech","base_url":"https://vtechworks.lib.vt.edu/oai/request"},"display":{"title":"Extraction of Blood Volume Pulse Morphology from Facial Videos Using an LSTM-Based Temporal Encoder-Decoder Model","abstract":"This thesis introduces a method for extracting blood volume pulse (BVP) signals from facial videos, moving beyond basic heart rate estimation to capture full pulse waveforms. Our approach adapts techniques from audio signal separation and applies them to video, using a machine learning model capable of processing complex time-based data. By incorporating both regular RGB (red, green, blue) and infrared (850nm, 940nm) video, we enhance the quality of the extracted signals, making signal extraction more reliable under different lighting conditions. This method not only improves accuracy in measuring real-time heart rate but also captures unique heart patterns that could support biometric identification. Our findings show that this approach effectively recovers detailed BVP shapes from video, paving the way for advancements in health monitoring and identity verification technologies.","abstract_html":"This thesis introduces a method for extracting blood volume pulse (BVP) signals from facial videos, moving beyond basic heart rate estimation to capture full pulse waveforms. Our approach adapts techniques from audio signal separation and applies them to video, using a machine learning model capable of processing complex time-based data. By incorporating both regular RGB (red, green, blue) and infrared (850nm, 940nm) video, we enhance the quality of the extracted signals, making signal extraction more reliable under different lighting conditions. This method not only improves accuracy in measuring real-time heart rate but also captures unique heart patterns that could support biometric identification. Our findings show that this approach effectively recovers detailed BVP shapes from video, paving the way for advancements in health monitoring and identity verification technologies.","abstract_has_math":false,"creators":["Tyler, Jonathan David"],"institution":"Virginia Tech","degree_name":"Master of Science","degree_level":"masters","degree_discipline":"Computer Engineering","degree_department":"Electrical and Computer Engineering","school":null,"contributors":[],"advisors":[],"committee_chairs":["Abbott, Amos L."],"committee_members":["Sarkar, Abhijit","Jones, Creed Farris"],"year":2025,"date_issued":"2025-03-28","date_published":"2025-03-28","updated_at":"2026-07-22T22:18:47Z","subjects":["Temporal Encoder-Decoder","Machine Learning","Remote Photoplethysmography","iPPG","BVP","Instantaneous Heart Rate"],"languages":["en"],"rights":["Creative Commons Attribution 4.0 International"],"rights_urls":["http://creativecommons.org/licenses/by/4.0/"],"identifier_entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["vt_gsexam:42552"],"render_values":[{"text":"vt_gsexam:42552","href":null,"code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/10919/125112","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.committeechair","label":"Committee Chair","values":["Abbott, Amos L."]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Sarkar, Abhijit","Jones, Creed Farris"]},{"key":"dc:contributor.department","label":"Department","values":["Electrical and Computer Engineering"]},{"key":"dc:creator","label":"Author","values":["Tyler, Jonathan David"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2025-03-29T08:00:37Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2025-03-29T08:00:37Z"]},{"key":"dc:date.issued","label":"Date","values":["2025-03-28"]},{"key":"dc:publisher","label":"Institution","values":["Virginia Tech"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Virginia Polytechnic Institute and State University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Temporal Encoder-Decoder","Machine Learning","Remote Photoplethysmography","iPPG","BVP","Instantaneous Heart Rate"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Creative Commons Attribution 4.0 International"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://creativecommons.org/licenses/by/4.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["vt_gsexam:42552"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/10919/125112"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["This thesis introduces a method for extracting blood volume pulse (BVP) signals from facial videos, moving beyond basic heart rate estimation to capture full pulse waveforms. Our approach adapts techniques from audio signal separation and applies them to video, using a machine learning model capable of processing complex time-based data. By incorporating both regular RGB (red, green, blue) and infrared (850nm, 940nm) video, we enhance the quality of the extracted signals, making signal extraction more reliable under different lighting conditions. This method not only improves accuracy in measuring real-time heart rate but also captures unique heart patterns that could support biometric identification. Our findings show that this approach effectively recovers detailed BVP shapes from video, paving the way for advancements in health monitoring and identity verification technologies."]},{"key":"dc:description.abstractgeneral","label":"General Abstract","values":["This thesis focuses on how to measure heart signals from facial videos in a way that captures more detail than just average heart rate. We use a machine learning model designed for an audio separation task, adapting it to separate blood flow signals from noise in signals extracted from video of the face. By adding infrared video data along with regular color channels, our method becomes more accurate, especially in low-light situations. This allows us to not only calculate a person's heart rate more precisely but also to create unique patterns from their heartbeat, which could help in personal identification. Through testing, we show that our method can successfully extract clear heart signals from video, opening up new uses for health monitoring and security."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Master of Science"]},{"key":"dc:format.medium","label":"Dc Format Medium","values":["ETD"]},{"key":"dc:title","label":"Title","values":["Extraction of Blood Volume Pulse Morphology from Facial Videos Using an LSTM-Based Temporal Encoder-Decoder Model"]}]}],"canonical_facts":{"dc:contributor.committeechair":["Abbott, Amos L."],"dc:contributor.committeemember":["Sarkar, Abhijit","Jones, Creed Farris"],"dc:contributor.department":["Electrical and Computer Engineering"],"dc:creator":["Tyler, Jonathan David"],"dc:date.accessioned":["2025-03-29T08:00:37Z"],"dc:date.available":["2025-03-29T08:00:37Z"],"dc:date.issued":["2025-03-28"],"dc:description.abstract":["This thesis introduces a method for extracting blood volume pulse (BVP) signals from facial videos, moving beyond basic heart rate estimation to capture full pulse waveforms. Our approach adapts techniques from audio signal separation and applies them to video, using a machine learning model capable of processing complex time-based data. By incorporating both regular RGB (red, green, blue) and infrared (850nm, 940nm) video, we enhance the quality of the extracted signals, making signal extraction more reliable under different lighting conditions. This method not only improves accuracy in measuring real-time heart rate but also captures unique heart patterns that could support biometric identification. Our findings show that this approach effectively recovers detailed BVP shapes from video, paving the way for advancements in health monitoring and identity verification technologies."],"dc:description.abstractgeneral":["This thesis focuses on how to measure heart signals from facial videos in a way that captures more detail than just average heart rate. We use a machine learning model designed for an audio separation task, adapting it to separate blood flow signals from noise in signals extracted from video of the face. By adding infrared video data along with regular color channels, our method becomes more accurate, especially in low-light situations. This allows us to not only calculate a person's heart rate more precisely but also to create unique patterns from their heartbeat, which could help in personal identification. Through testing, we show that our method can successfully extract clear heart signals from video, opening up new uses for health monitoring and security."],"dc:description.degree":["Master of Science"],"dc:format.medium":["ETD"],"dc:identifier.other":["vt_gsexam:42552"],"dc:identifier.uri":["https://hdl.handle.net/10919/125112"],"dc:language.iso":["en"],"dc:publisher":["Virginia Tech"],"dc:rights":["Creative Commons Attribution 4.0 International"],"dc:rights.uri":["http://creativecommons.org/licenses/by/4.0/"],"dc:subject":["Temporal Encoder-Decoder","Machine Learning","Remote Photoplethysmography","iPPG","BVP","Instantaneous Heart Rate"],"dc:title":["Extraction of Blood Volume Pulse Morphology from Facial Videos Using an LSTM-Based Temporal Encoder-Decoder Model"],"dc:type":["Thesis"],"thesis:degree_discipline":["Computer Engineering"],"thesis:degree_level":["masters"],"thesis:degree_name":["Master of Science"],"thesis:institution_name":["Virginia Polytechnic Institute and State University"]},"updated_at":"2026-07-22T22:18:47Z"}