{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/42195"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/42195","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Data mining and graph theory focused solutions to Smart Grid challenges","abstract":"The Smart Grid represents a transition of the power and energy industry into a new era of improved efficiency, reliability, availability, and security, while contributing to economic and environmental health. However, several challenges must be addressed for real-life implementation of Smart Grids. Demonstrating the effectiveness of data mining and graph theory in solving some of these problems is the motivation of this dissertation. One of the key challenges in taking advantage of what the Smart Grid offers is to extract information from volumes of power system data accumulated by a suite of new sensors and measurement devices. Data presents unprecedented potential of developing better understanding of the underlying system. Handling “data explosion” in power systems and mining it for information is hence a critical challenge, necessitating the development of sophisticated algorithms. To address this need, a particular instance of power system data, namely transient stability data is studied. Generator frequencies in a large power system are analyzed with data mining techniques to extract information such as groups of coherent generators. An effective visualization method based on “spark-lines” is also presented answering a long-time question of how to best display time-varying power system data. Spark-lines are automatically placed on a geographical map of the system employing methods of graph drawing. Developed methods detected abnormal behavior in two generators of the system which was caused by errors in the generators’ simulation models that were previously undetected and subsequently corrected. This brings out the power of the developed methodology. Another important aspect of the Smart Grid is to enable integration of large quantities of renewables such as wind power. This requires installation of large wind farms and in turn availability of advanced methods for designing wind farms. The electrical collector system is the single most important element of a wind farm after the wind turbines, and its optimal design is necessary for optimal wind farm operation. However, there is a need for algorithms to automatically design optimal wind farm collector systems. This represents the second problem addressed in this dissertation. A graph-theoretic approach has been applied to design an optimal wind farm collector system with minimum total trenching length. Clustering techniques have also been found extremely useful in handling specific design constraints. Application of the developed methods generated designs with significantly lower costs compared to an actual real-world wind farm. The third and final challenge addressed is reliably integrating large quantities of wind power into the system. Inherent problems of variability of wind power can be overcome by developing better wind power forecasting methods and incorporating energy storage units such as batteries. A least squares estimation based short-term wind power forecasting method has been presented. Additionally, methods have been developed to determine optimal storage capacity required and optimal generation commitment for a wind farm with on-site energy storage. Both methods have been found to be extremely sensitive to the statistical properties of wind and load forecast data. In summary, this work applies tools, techniques, and concepts from the areas of graph theory and data mining to address three critical challenges of real-life implementation of Smart Grids. It is anticipated that the work presented in this dissertation will encourage future research in application of graph theory and data mining to other Smart Grid challenges.","abstract_html":"The Smart Grid represents a transition of the power and energy industry into a new era of improved efficiency, reliability, availability, and security, while contributing to economic and environmental health. However, several challenges must be addressed for real-life implementation of Smart Grids. Demonstrating the effectiveness of data mining and graph theory in solving some of these problems is the motivation of this dissertation. One of the key challenges in taking advantage of what the Smart Grid offers is to extract information from volumes of power system data accumulated by a suite of new sensors and measurement devices. Data presents unprecedented potential of developing better understanding of the underlying system. Handling “data explosion” in power systems and mining it for information is hence a critical challenge, necessitating the development of sophisticated algorithms. To address this need, a particular instance of power system data, namely transient stability data is studied. Generator frequencies in a large power system are analyzed with data mining techniques to extract information such as groups of coherent generators. An effective visualization method based on “spark-lines” is also presented answering a long-time question of how to best display time-varying power system data. Spark-lines are automatically placed on a geographical map of the system employing methods of graph drawing. Developed methods detected abnormal behavior in two generators of the system which was caused by errors in the generators’ simulation models that were previously undetected and subsequently corrected. This brings out the power of the developed methodology. Another important aspect of the Smart Grid is to enable integration of large quantities of renewables such as wind power. This requires installation of large wind farms and in turn availability of advanced methods for designing wind farms. The electrical collector system is the single most important element of a wind farm after the wind turbines, and its optimal design is necessary for optimal wind farm operation. However, there is a need for algorithms to automatically design optimal wind farm collector systems. This represents the second problem addressed in this dissertation. A graph-theoretic approach has been applied to design an optimal wind farm collector system with minimum total trenching length. Clustering techniques have also been found extremely useful in handling specific design constraints. Application of the developed methods generated designs with significantly lower costs compared to an actual real-world wind farm. The third and final challenge addressed is reliably integrating large quantities of wind power into the system. Inherent problems of variability of wind power can be overcome by developing better wind power forecasting methods and incorporating energy storage units such as batteries. A least squares estimation based short-term wind power forecasting method has been presented. Additionally, methods have been developed to determine optimal storage capacity required and optimal generation commitment for a wind farm with on-site energy storage. Both methods have been found to be extremely sensitive to the statistical properties of wind and load forecast data. In summary, this work applies tools, techniques, and concepts from the areas of graph theory and data mining to address three critical challenges of real-life implementation of Smart Grids. It is anticipated that the work presented in this dissertation will encourage future research in application of graph theory and data mining to other Smart Grid challenges.","abstract_has_math":false,"creators":["Dutta, Sudipta"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Overbye, Thomas J.","Sauer, Peter W.","Domínguez-García, Alejandro D.","Nicol, David M.","Weber, James D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2013,"date_issued":"2013-02-03T19:27:32Z","date_published":"2013-02-03T19:27:32Z","updated_at":"2026-07-22T22:25:33Z","subjects":["Data mining","Graph Theory","Spanning trees","Steiner tree","wind farm collector system","wind power integration","coordination of wind power with energy storage","energy storage sizing","wind power forecasting","pattern identification","data volume reduction","power system visualization","spark-lines","Smart Grid"],"languages":["en"],"rights":["Copyright 2012 Sudipta Dutta"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/42195","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Overbye, Thomas J.","Sauer, Peter W.","Domínguez-García, Alejandro D.","Nicol, David M.","Weber, James D."]},{"key":"dc:creator","label":"Author","values":["Dutta, Sudipta"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2013-02-03T19:27:32Z","2012-12"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Data mining","Graph Theory","Spanning trees","Steiner tree","wind farm collector system","wind power integration","coordination of wind power with energy storage","energy storage sizing","wind power forecasting","pattern identification","data volume reduction","power system visualization","spark-lines","Smart Grid"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2012 Sudipta Dutta"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/42195"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["The Smart Grid represents a transition of the power and energy industry into a new era of improved efficiency, reliability, availability, and security, while contributing to economic and environmental health. However, several challenges must be addressed for real-life implementation of Smart Grids. Demonstrating the effectiveness of data mining and graph theory in solving some of these problems is the motivation of this dissertation. One of the key challenges in taking advantage of what the Smart Grid offers is to extract information from volumes of power system data accumulated by a suite of new sensors and measurement devices. Data presents unprecedented potential of developing better understanding of the underlying system. Handling “data explosion” in power systems and mining it for information is hence a critical challenge, necessitating the development of sophisticated algorithms. To address this need, a particular instance of power system data, namely transient stability data is studied. Generator frequencies in a large power system are analyzed with data mining techniques to extract information such as groups of coherent generators. An effective visualization method based on “spark-lines” is also presented answering a long-time question of how to best display time-varying power system data. Spark-lines are automatically placed on a geographical map of the system employing methods of graph drawing. Developed methods detected abnormal behavior in two generators of the system which was caused by errors in the generators’ simulation models that were previously undetected and subsequently corrected. This brings out the power of the developed methodology. Another important aspect of the Smart Grid is to enable integration of large quantities of renewables such as wind power. This requires installation of large wind farms and in turn availability of advanced methods for designing wind farms. The electrical collector system is the single most important element of a wind farm after the wind turbines, and its optimal design is necessary for optimal wind farm operation. However, there is a need for algorithms to automatically design optimal wind farm collector systems. This represents the second problem addressed in this dissertation. A graph-theoretic approach has been applied to design an optimal wind farm collector system with minimum total trenching length. Clustering techniques have also been found extremely useful in handling specific design constraints. Application of the developed methods generated designs with significantly lower costs compared to an actual real-world wind farm. The third and final challenge addressed is reliably integrating large quantities of wind power into the system. Inherent problems of variability of wind power can be overcome by developing better wind power forecasting methods and incorporating energy storage units such as batteries. A least squares estimation based short-term wind power forecasting method has been presented. Additionally, methods have been developed to determine optimal storage capacity required and optimal generation commitment for a wind farm with on-site energy storage. Both methods have been found to be extremely sensitive to the statistical properties of wind and load forecast data. In summary, this work applies tools, techniques, and concepts from the areas of graph theory and data mining to address three critical challenges of real-life implementation of Smart Grids. It is anticipated that the work presented in this dissertation will encourage future research in application of graph theory and data mining to other Smart Grid challenges.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2012-11-06T20:46:49Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 2 thesis_11_6.docx: 11438114 bytes, checksum: 57ae439a67e87937df979a40babb2b13 (MD5) Dutta_Sudipta.pdf: 3048801 bytes, checksum: 466b1beb894a0c76b0a9e3fa6d1c05a0 (MD5)","Made available in DSpace on 2013-02-03T19:27:32Z (GMT). No. of bitstreams: 3 Sudipta_Dutta.pdf: 3048801 bytes, checksum: 466b1beb894a0c76b0a9e3fa6d1c05a0 (MD5) thesis_11_6.docx: 11438114 bytes, checksum: 57ae439a67e87937df979a40babb2b13 (MD5) license.txt: 4061 bytes, checksum: 58e43671e0cd2aa5b4f5eb5eaaf7c041 (MD5)"]},{"key":"dc:title","label":"Title","values":["Data mining and graph theory focused solutions to Smart Grid challenges"]}]}],"canonical_facts":{"dc:contributor":["Overbye, Thomas J.","Sauer, Peter W.","Domínguez-García, Alejandro D.","Nicol, David M.","Weber, James D."],"dc:creator":["Dutta, Sudipta"],"dc:date":["2013-02-03T19:27:32Z","2012-12"],"dc:description":["The Smart Grid represents a transition of the power and energy industry into a new era of improved efficiency, reliability, availability, and security, while contributing to economic and environmental health. However, several challenges must be addressed for real-life implementation of Smart Grids. Demonstrating the effectiveness of data mining and graph theory in solving some of these problems is the motivation of this dissertation. One of the key challenges in taking advantage of what the Smart Grid offers is to extract information from volumes of power system data accumulated by a suite of new sensors and measurement devices. Data presents unprecedented potential of developing better understanding of the underlying system. Handling “data explosion” in power systems and mining it for information is hence a critical challenge, necessitating the development of sophisticated algorithms. To address this need, a particular instance of power system data, namely transient stability data is studied. Generator frequencies in a large power system are analyzed with data mining techniques to extract information such as groups of coherent generators. An effective visualization method based on “spark-lines” is also presented answering a long-time question of how to best display time-varying power system data. Spark-lines are automatically placed on a geographical map of the system employing methods of graph drawing. Developed methods detected abnormal behavior in two generators of the system which was caused by errors in the generators’ simulation models that were previously undetected and subsequently corrected. This brings out the power of the developed methodology. Another important aspect of the Smart Grid is to enable integration of large quantities of renewables such as wind power. This requires installation of large wind farms and in turn availability of advanced methods for designing wind farms. The electrical collector system is the single most important element of a wind farm after the wind turbines, and its optimal design is necessary for optimal wind farm operation. However, there is a need for algorithms to automatically design optimal wind farm collector systems. This represents the second problem addressed in this dissertation. A graph-theoretic approach has been applied to design an optimal wind farm collector system with minimum total trenching length. Clustering techniques have also been found extremely useful in handling specific design constraints. Application of the developed methods generated designs with significantly lower costs compared to an actual real-world wind farm. The third and final challenge addressed is reliably integrating large quantities of wind power into the system. Inherent problems of variability of wind power can be overcome by developing better wind power forecasting methods and incorporating energy storage units such as batteries. A least squares estimation based short-term wind power forecasting method has been presented. Additionally, methods have been developed to determine optimal storage capacity required and optimal generation commitment for a wind farm with on-site energy storage. Both methods have been found to be extremely sensitive to the statistical properties of wind and load forecast data. In summary, this work applies tools, techniques, and concepts from the areas of graph theory and data mining to address three critical challenges of real-life implementation of Smart Grids. It is anticipated that the work presented in this dissertation will encourage future research in application of graph theory and data mining to other Smart Grid challenges.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2012-11-06T20:46:49Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 2 thesis_11_6.docx: 11438114 bytes, checksum: 57ae439a67e87937df979a40babb2b13 (MD5) Dutta_Sudipta.pdf: 3048801 bytes, checksum: 466b1beb894a0c76b0a9e3fa6d1c05a0 (MD5)","Made available in DSpace on 2013-02-03T19:27:32Z (GMT). No. of bitstreams: 3 Sudipta_Dutta.pdf: 3048801 bytes, checksum: 466b1beb894a0c76b0a9e3fa6d1c05a0 (MD5) thesis_11_6.docx: 11438114 bytes, checksum: 57ae439a67e87937df979a40babb2b13 (MD5) license.txt: 4061 bytes, checksum: 58e43671e0cd2aa5b4f5eb5eaaf7c041 (MD5)"],"dc:identifier":["http://hdl.handle.net/2142/42195"],"dc:language":["en"],"dc:rights":["Copyright 2012 Sudipta Dutta"],"dc:subject":["Data mining","Graph Theory","Spanning trees","Steiner tree","wind farm collector system","wind power integration","coordination of wind power with energy storage","energy storage sizing","wind power forecasting","pattern identification","data volume reduction","power system visualization","spark-lines","Smart Grid"],"dc:title":["Data mining and graph theory focused solutions to Smart Grid challenges"],"dc:type":["text"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:33Z"}