{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/129294"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/129294","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Domain generalization for sequential data via invariant subspace recovery","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-19 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-19 without embargo terms","abstract_has_math":false,"creators":["Sharma, Ashutosh"],"institution":"University of Illinois Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Zhao, Han"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-05-05","date_published":"2025-05-05","updated_at":"2026-07-22T22:25:04Z","subjects":["Domain Generalization","Kalman Filter, Invariant Subspace Recovery, Invariant Features, Sequential Data"],"languages":["en","eng"],"rights":["Copyright 2025 Ashutosh Sharma"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/129294","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Zhao, Han"]},{"key":"dc:creator","label":"Author","values":["Sharma, Ashutosh"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-05-05","2025-05"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Domain Generalization","Kalman Filter, Invariant Subspace Recovery, Invariant Features, Sequential Data"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Ashutosh Sharma"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/129294"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-19 without embargo terms","The student, Ashutosh Sharma, accepted the attached license on 2025-05-01 at 05:39.","The student, Ashutosh Sharma, submitted this Thesis for approval on 2025-05-01 at 05:44.","This Thesis was approved for publication on 2025-05-05 at 10:55.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22142 on 2025-10-19 at 18:11:27","Recent works have explored continuous and discrete temporal domain generalization, which given input data from multiple temporally indexed domains, aims to train a model generalized across time. State of the art systems like DRAIN [1] model the temporal evolution of the input domain and the model dynamics jointly for training optimal predictors, but these approaches cannot generalize to multiple categorically indexed domains with temporally evolving data. In another line of work, ISR [2] trains invariant predictors for a set of categorical domains assuming i.i.d sampled observed data points for recovering the invariant subspace, but this cannot be applied directly to sequentially sampled data. In this work, we propose leveraging subspace recovery techniques for training invariant predictors over temporally evolving data. We formalize the data generation model as a Dynamic Bayesian Network where latent representation at any time causally depend only on the current time’s label & last time’s latent variable. Assuming access to only the observations (and labels for training environments) for each environment, we first estimate the parameters of the model from training data via Expectation-Maximization. We then derive an optimal online predictor for the test environment which forms the strong baseline for our work. We then estimate invariant feature subspace from the latent variable distribution of the training data and project the observed features to this space. These invariant features are then used for generating invariant predictions. Similar to [3], we also propose a set of linear unit tests benchmark for this novel setting. Our experiments on the benchmark show that our strong baseline outperforms i.i.d. classifier by 17% and our invariant predictor further improves the accuracy by 3% over our strong baseline, validating the efficacy of our method."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Domain generalization for sequential data via invariant subspace recovery"]}]}],"canonical_facts":{"dc:contributor":["Zhao, Han"],"dc:creator":["Sharma, Ashutosh"],"dc:date":["2025-05-05","2025-05"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-19 without embargo terms","The student, Ashutosh Sharma, accepted the attached license on 2025-05-01 at 05:39.","The student, Ashutosh Sharma, submitted this Thesis for approval on 2025-05-01 at 05:44.","This Thesis was approved for publication on 2025-05-05 at 10:55.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22142 on 2025-10-19 at 18:11:27","Recent works have explored continuous and discrete temporal domain generalization, which given input data from multiple temporally indexed domains, aims to train a model generalized across time. State of the art systems like DRAIN [1] model the temporal evolution of the input domain and the model dynamics jointly for training optimal predictors, but these approaches cannot generalize to multiple categorically indexed domains with temporally evolving data. In another line of work, ISR [2] trains invariant predictors for a set of categorical domains assuming i.i.d sampled observed data points for recovering the invariant subspace, but this cannot be applied directly to sequentially sampled data. In this work, we propose leveraging subspace recovery techniques for training invariant predictors over temporally evolving data. We formalize the data generation model as a Dynamic Bayesian Network where latent representation at any time causally depend only on the current time’s label & last time’s latent variable. Assuming access to only the observations (and labels for training environments) for each environment, we first estimate the parameters of the model from training data via Expectation-Maximization. We then derive an optimal online predictor for the test environment which forms the strong baseline for our work. We then estimate invariant feature subspace from the latent variable distribution of the training data and project the observed features to this space. These invariant features are then used for generating invariant predictions. Similar to [3], we also propose a set of linear unit tests benchmark for this novel setting. Our experiments on the benchmark show that our strong baseline outperforms i.i.d. classifier by 17% and our invariant predictor further improves the accuracy by 3% over our strong baseline, validating the efficacy of our method."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/129294"],"dc:language":["en","eng"],"dc:rights":["Copyright 2025 Ashutosh Sharma"],"dc:subject":["Domain Generalization","Kalman Filter, Invariant Subspace Recovery, Invariant Features, Sequential Data"],"dc:title":["Domain generalization for sequential data via invariant subspace recovery"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:04Z"}