{"id":{"repo_id":"vt","oai_identifier":"oai:vtechworks.lib.vt.edu:10919/9709"},"canonical_url":"https://search.dev.ndltd.org/etd/vt/oai:vtechworks.lib.vt.edu:10919/9709","repository":{"repo_id":"vt","name":"Virginia Tech","base_url":"https://vtechworks.lib.vt.edu/oai/request"},"display":{"title":"Stochastic Learning Feedback Hybrid Automata for Dynamic Power Management in Embedded Systems","abstract":"Dynamic Power Management (DPM) refers to the strategies employed at system level to reduce energy expenditure (i.e. to prolong battery life) in embedded systems. The trade-off involved in DPM techniques is between the reductions of energy consumption and latency incurred by the jobs to be executed by the system. Such trade-offs need to be decided at runtime making DPM an on-line problem. In this context, the contributions of this thesis are two-fold. Firstly, we formulate the DPM problem as a hybrid automaton control problem. We model a timed hybrid automaton to mathematically analyze various opportunities in optimizing energy in a given system model. Secondly, stochastic control is added to the automata model, whose control strategy is learnt dynamically using stochastic learning automata (SLA). Several linear and non-linear feedback algorithms are incorporated in the final Stochastic Learning Hybrid Automata (SLHA) model. Simulation-based experiments show the expediency of the feedback systems in stationary environments. Further experiments are conducted using real trace data to compare stochastic learning strategies to the outcomes of several former predictive algorithms. These reveal that SLHA attains better trade-offs than the other studied methods under certain trace data. Advanced characterization of trace sequences, which allows a better performance of SLHA, is a subject of further study.","abstract_html":"Dynamic Power Management (DPM) refers to the strategies employed at system level to reduce energy expenditure (i.e. to prolong battery life) in embedded systems. The trade-off involved in DPM techniques is between the reductions of energy consumption and latency incurred by the jobs to be executed by the system. Such trade-offs need to be decided at runtime making DPM an on-line problem. In this context, the contributions of this thesis are two-fold. Firstly, we formulate the DPM problem as a hybrid automaton control problem. We model a timed hybrid automaton to mathematically analyze various opportunities in optimizing energy in a given system model. Secondly, stochastic control is added to the automata model, whose control strategy is learnt dynamically using stochastic learning automata (SLA). Several linear and non-linear feedback algorithms are incorporated in the final Stochastic Learning Hybrid Automata (SLHA) model. Simulation-based experiments show the expediency of the feedback systems in stationary environments. Further experiments are conducted using real trace data to compare stochastic learning strategies to the outcomes of several former predictive algorithms. These reveal that SLHA attains better trade-offs than the other studied methods under certain trace data. Advanced characterization of trace sequences, which allows a better performance of SLHA, is a subject of further study.","abstract_has_math":false,"creators":["Erbes, Teodora"],"institution":"Virginia Tech","degree_name":"Master of Science","degree_level":"masters","degree_discipline":"Electrical and Computer Engineering","degree_department":"Electrical and Computer Engineering","school":null,"contributors":[],"advisors":[],"committee_chairs":["Shukla, Sandeep K.","Kachroo, Pushkin"],"committee_members":["Abbott, A. Lynn"],"year":2004,"date_issued":"2004-01-13","date_published":"2004-01-13","updated_at":"2026-07-22T22:18:49Z","subjects":["Stochastic","Hybrid","Automata","Reinforcement","Non-Linear","Linear","Feedback","Learning","Dynamic","Power Management","Non-Stationary","Stationary"],"languages":[],"rights":["In Copyright"],"rights_urls":["http://rightsstatements.org/vocab/InC/1.0/"],"identifier_entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["etd-01302004-163210"],"render_values":[{"text":"etd-01302004-163210","href":null,"code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/10919/9709","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.committeechair","label":"Committee Chair","values":["Shukla, Sandeep K.","Kachroo, Pushkin"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Abbott, A. Lynn"]},{"key":"dc:contributor.department","label":"Department","values":["Electrical and Computer Engineering"]},{"key":"dc:creator","label":"Author","values":["Erbes, Teodora"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2011-08-06T14:45:40Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2011-08-06T14:45:40Z","2004-02-11"]},{"key":"dc:date.issued","label":"Date","values":["2004-01-13"]},{"key":"dc:publisher","label":"Institution","values":["Virginia Tech"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical and Computer Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Virginia Polytechnic Institute and State University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Stochastic","Hybrid","Automata","Reinforcement","Non-Linear","Linear","Feedback","Learning","Dynamic","Power Management","Non-Stationary","Stationary"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights","label":"Dc Rights","values":["In Copyright"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://rightsstatements.org/vocab/InC/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["etd-01302004-163210"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/10919/9709"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Dynamic Power Management (DPM) refers to the strategies employed at system level to reduce energy expenditure (i.e. to prolong battery life) in embedded systems. The trade-off involved in DPM techniques is between the reductions of energy consumption and latency incurred by the jobs to be executed by the system. Such trade-offs need to be decided at runtime making DPM an on-line problem. In this context, the contributions of this thesis are two-fold. Firstly, we formulate the DPM problem as a hybrid automaton control problem. We model a timed hybrid automaton to mathematically analyze various opportunities in optimizing energy in a given system model. Secondly, stochastic control is added to the automata model, whose control strategy is learnt dynamically using stochastic learning automata (SLA). Several linear and non-linear feedback algorithms are incorporated in the final Stochastic Learning Hybrid Automata (SLHA) model. Simulation-based experiments show the expediency of the feedback systems in stationary environments. Further experiments are conducted using real trace data to compare stochastic learning strategies to the outcomes of several former predictive algorithms. These reveal that SLHA attains better trade-offs than the other studied methods under certain trace data. Advanced characterization of trace sequences, which allows a better performance of SLHA, is a subject of further study."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Master of Science"]},{"key":"dc:format.medium","label":"Dc Format Medium","values":["ETD"]},{"key":"dc:title","label":"Title","values":["Stochastic Learning Feedback Hybrid Automata for Dynamic Power Management in Embedded Systems"]}]}],"canonical_facts":{"dc:contributor.committeechair":["Shukla, Sandeep K.","Kachroo, Pushkin"],"dc:contributor.committeemember":["Abbott, A. Lynn"],"dc:contributor.department":["Electrical and Computer Engineering"],"dc:creator":["Erbes, Teodora"],"dc:date.accessioned":["2011-08-06T14:45:40Z"],"dc:date.available":["2011-08-06T14:45:40Z","2004-02-11"],"dc:date.issued":["2004-01-13"],"dc:description.abstract":["Dynamic Power Management (DPM) refers to the strategies employed at system level to reduce energy expenditure (i.e. to prolong battery life) in embedded systems. The trade-off involved in DPM techniques is between the reductions of energy consumption and latency incurred by the jobs to be executed by the system. Such trade-offs need to be decided at runtime making DPM an on-line problem. In this context, the contributions of this thesis are two-fold. Firstly, we formulate the DPM problem as a hybrid automaton control problem. We model a timed hybrid automaton to mathematically analyze various opportunities in optimizing energy in a given system model. Secondly, stochastic control is added to the automata model, whose control strategy is learnt dynamically using stochastic learning automata (SLA). Several linear and non-linear feedback algorithms are incorporated in the final Stochastic Learning Hybrid Automata (SLHA) model. Simulation-based experiments show the expediency of the feedback systems in stationary environments. Further experiments are conducted using real trace data to compare stochastic learning strategies to the outcomes of several former predictive algorithms. These reveal that SLHA attains better trade-offs than the other studied methods under certain trace data. Advanced characterization of trace sequences, which allows a better performance of SLHA, is a subject of further study."],"dc:description.degree":["Master of Science"],"dc:format.medium":["ETD"],"dc:identifier.other":["etd-01302004-163210"],"dc:identifier.uri":["http://hdl.handle.net/10919/9709"],"dc:publisher":["Virginia Tech"],"dc:rights":["In Copyright"],"dc:rights.uri":["http://rightsstatements.org/vocab/InC/1.0/"],"dc:subject":["Stochastic","Hybrid","Automata","Reinforcement","Non-Linear","Linear","Feedback","Learning","Dynamic","Power Management","Non-Stationary","Stationary"],"dc:title":["Stochastic Learning Feedback Hybrid Automata for Dynamic Power Management in Embedded Systems"],"dc:type":["Thesis"],"thesis:degree_discipline":["Electrical and Computer Engineering"],"thesis:degree_level":["masters"],"thesis:degree_name":["Master of Science"],"thesis:institution_name":["Virginia Polytechnic Institute and State University"]},"updated_at":"2026-07-22T22:18:49Z"}