{"id":{"repo_id":"vt","oai_identifier":"oai:vtechworks.lib.vt.edu:10919/123754"},"canonical_url":"https://search.dev.ndltd.org/etd/vt/oai:vtechworks.lib.vt.edu:10919/123754","repository":{"repo_id":"vt","name":"Virginia Tech","base_url":"https://vtechworks.lib.vt.edu/oai/request"},"display":{"title":"Reinforcement Learning for the Cybersecurity of Grid-Forming and Grid-Following Inverters","abstract":"The U.S. movement toward clean energy generation has increased the number of installed inverter-based resources (IBR) in the grid, introducing new challenges in IBR control and cybersecurity. IBRs receive their set point through the communication link, which may expose them to cyber threats. Previous work has developed various techniques to detect and mitigate cyberattacks on IBRs, developing schemes for new inverters being installed in the grid. This work focuses on developing model-free control techniques for already installed IBR in the grid without the need to access IBR internal control parameters. The proposed method is tested for both the grid-forming and grid-following inverter control. Separate detection and mitigation algorithms are used to enhance the accuracy of the proposed method. The proposed method is tested using the modified CIGRE 14-bus North American grid with 7 IBRs in PSCAD/EMTDC. Finally, the performance of the detection algorithm is tested under grid normal transients, such as set point change, load change, and short-circuit fault, to make sure the proposed detection method does not provide false positives.","abstract_html":"The U.S. movement toward clean energy generation has increased the number of installed inverter-based resources (IBR) in the grid, introducing new challenges in IBR control and cybersecurity. IBRs receive their set point through the communication link, which may expose them to cyber threats. Previous work has developed various techniques to detect and mitigate cyberattacks on IBRs, developing schemes for new inverters being installed in the grid. This work focuses on developing model-free control techniques for already installed IBR in the grid without the need to access IBR internal control parameters. The proposed method is tested for both the grid-forming and grid-following inverter control. Separate detection and mitigation algorithms are used to enhance the accuracy of the proposed method. The proposed method is tested using the modified CIGRE 14-bus North American grid with 7 IBRs in PSCAD/EMTDC. Finally, the performance of the detection algorithm is tested under grid normal transients, such as set point change, load change, and short-circuit fault, to make sure the proposed detection method does not provide false positives.","abstract_has_math":false,"creators":["Kwiatkowski, Brian Michael"],"institution":"Virginia Tech","degree_name":"Master of Science","degree_level":"masters","degree_discipline":"Electrical Engineering","degree_department":"Electrical Engineering","school":null,"contributors":[],"advisors":[],"committee_chairs":["Mehrizi-Sani, Ali"],"committee_members":["Centeno, Virgilio A.","Liu, Chen-Ching"],"year":2024,"date_issued":"2024-12-06","date_published":"2024-12-06","updated_at":"2026-07-22T22:20:08Z","subjects":["Cyberattack","inverter-based resources (IBR)","power system control","reinforcement learning (RL)","renewable energy sources"],"languages":["en"],"rights":["In Copyright"],"rights_urls":["http://rightsstatements.org/vocab/InC/1.0/"],"identifier_entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["vt_gsexam:42081"],"render_values":[{"text":"vt_gsexam:42081","href":null,"code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/10919/123754","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.committeechair","label":"Committee Chair","values":["Mehrizi-Sani, Ali"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Centeno, Virgilio A.","Liu, Chen-Ching"]},{"key":"dc:contributor.department","label":"Department","values":["Electrical Engineering"]},{"key":"dc:creator","label":"Author","values":["Kwiatkowski, Brian Michael"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2024-12-07T09:00:29Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2024-12-07T09:00:29Z"]},{"key":"dc:date.issued","label":"Date","values":["2024-12-06"]},{"key":"dc:publisher","label":"Institution","values":["Virginia Tech"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Virginia Polytechnic Institute and State University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Cyberattack","inverter-based resources (IBR)","power system control","reinforcement learning (RL)","renewable energy sources"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["In Copyright"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://rightsstatements.org/vocab/InC/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["vt_gsexam:42081"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/10919/123754"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["The U.S. movement toward clean energy generation has increased the number of installed inverter-based resources (IBR) in the grid, introducing new challenges in IBR control and cybersecurity. IBRs receive their set point through the communication link, which may expose them to cyber threats. Previous work has developed various techniques to detect and mitigate cyberattacks on IBRs, developing schemes for new inverters being installed in the grid. This work focuses on developing model-free control techniques for already installed IBR in the grid without the need to access IBR internal control parameters. The proposed method is tested for both the grid-forming and grid-following inverter control. Separate detection and mitigation algorithms are used to enhance the accuracy of the proposed method. The proposed method is tested using the modified CIGRE 14-bus North American grid with 7 IBRs in PSCAD/EMTDC. Finally, the performance of the detection algorithm is tested under grid normal transients, such as set point change, load change, and short-circuit fault, to make sure the proposed detection method does not provide false positives."]},{"key":"dc:description.abstractgeneral","label":"General Abstract","values":["Due to the increasing presence of renewable energy resources such as photovoltaic and solar has introduced new challenges to the grid as the United States shifts towards clean energy. Those resources rely on devices called inverters to transform the energy to match the conditions of the grid. Inverters receive instructions to change their values before making the connection, making them potentially vulnerable to cyberattacks. While there has been progress in developing protection methods for inverters, existing inverters require additional protection to ensure their safe and reliable function. This work proposes a way to improve the reliability of existing inverters without changing the values of their internal settings. The method, tested under several conditions, successfully detects and counters potential cyberattacks without mistaking normal grid operations such as adjustments in demand and short circuit events."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Master of Science"]},{"key":"dc:format.medium","label":"Dc Format Medium","values":["ETD"]},{"key":"dc:title","label":"Title","values":["Reinforcement Learning for the Cybersecurity of Grid-Forming and Grid-Following Inverters"]}]}],"canonical_facts":{"dc:contributor.committeechair":["Mehrizi-Sani, Ali"],"dc:contributor.committeemember":["Centeno, Virgilio A.","Liu, Chen-Ching"],"dc:contributor.department":["Electrical Engineering"],"dc:creator":["Kwiatkowski, Brian Michael"],"dc:date.accessioned":["2024-12-07T09:00:29Z"],"dc:date.available":["2024-12-07T09:00:29Z"],"dc:date.issued":["2024-12-06"],"dc:description.abstract":["The U.S. movement toward clean energy generation has increased the number of installed inverter-based resources (IBR) in the grid, introducing new challenges in IBR control and cybersecurity. IBRs receive their set point through the communication link, which may expose them to cyber threats. Previous work has developed various techniques to detect and mitigate cyberattacks on IBRs, developing schemes for new inverters being installed in the grid. This work focuses on developing model-free control techniques for already installed IBR in the grid without the need to access IBR internal control parameters. The proposed method is tested for both the grid-forming and grid-following inverter control. Separate detection and mitigation algorithms are used to enhance the accuracy of the proposed method. The proposed method is tested using the modified CIGRE 14-bus North American grid with 7 IBRs in PSCAD/EMTDC. Finally, the performance of the detection algorithm is tested under grid normal transients, such as set point change, load change, and short-circuit fault, to make sure the proposed detection method does not provide false positives."],"dc:description.abstractgeneral":["Due to the increasing presence of renewable energy resources such as photovoltaic and solar has introduced new challenges to the grid as the United States shifts towards clean energy. Those resources rely on devices called inverters to transform the energy to match the conditions of the grid. Inverters receive instructions to change their values before making the connection, making them potentially vulnerable to cyberattacks. While there has been progress in developing protection methods for inverters, existing inverters require additional protection to ensure their safe and reliable function. This work proposes a way to improve the reliability of existing inverters without changing the values of their internal settings. The method, tested under several conditions, successfully detects and counters potential cyberattacks without mistaking normal grid operations such as adjustments in demand and short circuit events."],"dc:description.degree":["Master of Science"],"dc:format.medium":["ETD"],"dc:identifier.other":["vt_gsexam:42081"],"dc:identifier.uri":["https://hdl.handle.net/10919/123754"],"dc:language.iso":["en"],"dc:publisher":["Virginia Tech"],"dc:rights":["In Copyright"],"dc:rights.uri":["http://rightsstatements.org/vocab/InC/1.0/"],"dc:subject":["Cyberattack","inverter-based resources (IBR)","power system control","reinforcement learning (RL)","renewable energy sources"],"dc:title":["Reinforcement Learning for the Cybersecurity of Grid-Forming and Grid-Following Inverters"],"dc:type":["Thesis"],"thesis:degree_discipline":["Electrical Engineering"],"thesis:degree_level":["masters"],"thesis:degree_name":["Master of Science"],"thesis:institution_name":["Virginia Polytechnic Institute and State University"]},"updated_at":"2026-07-22T22:20:08Z"}