{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/97446"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/97446","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"On equivalence of additive-combinatorial inequalities for Shannon entropy and differential entropy","abstract":"Entropy inequalities are very important in information theory and they play a crucial role in various communication-theoretic problems, for example, in the study of the degrees of freedom of interference channels. In this thesis, we are concerned with the additive-combinatorial entropy inequalities which are motivated by their combinatorial counterparts: cardinality inequalities for subsets of abelian groups. As opposed to the existing approaches in the literature in the study of the discrete and continuous entropy inequalities, we consider a general framework of balanced linear entropy inequalities. In particular, we show a fundamental equivalence relationship between these classes of discrete and continuous entropy inequalities. In other words, we show that a balanced Shannon entropy inequality holds if and only if the corresponding differential entropy inequality holds. We also investigate these findings in a more general setting of connected abelian Lie groups and in the study of the sharp constants for entropy inequalities.","abstract_html":"Entropy inequalities are very important in information theory and they play a crucial role in various communication-theoretic problems, for example, in the study of the degrees of freedom of interference channels. In this thesis, we are concerned with the additive-combinatorial entropy inequalities which are motivated by their combinatorial counterparts: cardinality inequalities for subsets of abelian groups. As opposed to the existing approaches in the literature in the study of the discrete and continuous entropy inequalities, we consider a general framework of balanced linear entropy inequalities. In particular, we show a fundamental equivalence relationship between these classes of discrete and continuous entropy inequalities. In other words, we show that a balanced Shannon entropy inequality holds if and only if the corresponding differential entropy inequality holds. We also investigate these findings in a more general setting of connected abelian Lie groups and in the study of the sharp constants for entropy inequalities.","abstract_has_math":false,"creators":["Makkuva, Ashok Vardhan"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Viswanath, Pramod","Wu, Yihong"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2017,"date_issued":"2017-08-10T19:15:57Z","date_published":"2017-08-10T19:15:57Z","updated_at":"2026-07-22T22:24:34Z","subjects":["Shannon entropy","Differential entropy","Information theory","Additive combinatorics","Entropy inequalities"],"languages":["en"],"rights":["Copyright 2017 Ashok Makkuva"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/97446","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Viswanath, Pramod","Wu, Yihong"]},{"key":"dc:creator","label":"Author","values":["Makkuva, Ashok Vardhan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2017-08-10T19:15:57Z","2017-04-26","2017-05"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Shannon entropy","Differential entropy","Information theory","Additive combinatorics","Entropy inequalities"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2017 Ashok Makkuva"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/97446"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Entropy inequalities are very important in information theory and they play a crucial role in various communication-theoretic problems, for example, in the study of the degrees of freedom of interference channels. In this thesis, we are concerned with the additive-combinatorial entropy inequalities which are motivated by their combinatorial counterparts: cardinality inequalities for subsets of abelian groups. As opposed to the existing approaches in the literature in the study of the discrete and continuous entropy inequalities, we consider a general framework of balanced linear entropy inequalities. In particular, we show a fundamental equivalence relationship between these classes of discrete and continuous entropy inequalities. In other words, we show that a balanced Shannon entropy inequality holds if and only if the corresponding differential entropy inequality holds. We also investigate these findings in a more general setting of connected abelian Lie groups and in the study of the sharp constants for entropy inequalities.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2017-08-10 without embargo terms","The student, Ashok Makkuva, accepted the attached license on 2017-04-24 at 13:15.","The student, Ashok Makkuva, submitted this Thesis for approval on 2017-04-24 at 13:16.","This Thesis was approved for publication on 2017-04-26 at 17:46.","DSpace SAF Submission Ingestion Package generated from Vireo submission #10999 on 2017-08-10 at 13:45:33","Made available in DSpace on 2017-08-10T19:15:57Z (GMT). No. of bitstreams: 2 MAKKUVA-THESIS-2017.pdf: 599339 bytes, checksum: c2c6cb2ce9513dae120140237f937bf7 (MD5) LICENSE.txt: 4210 bytes, checksum: 0820f5de79755d3e01231f3919d544ec (MD5) Previous issue date: 2017-04-26"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["On equivalence of additive-combinatorial inequalities for Shannon entropy and differential entropy"]}]}],"canonical_facts":{"dc:contributor":["Viswanath, Pramod","Wu, Yihong"],"dc:creator":["Makkuva, Ashok Vardhan"],"dc:date":["2017-08-10T19:15:57Z","2017-04-26","2017-05"],"dc:description":["Entropy inequalities are very important in information theory and they play a crucial role in various communication-theoretic problems, for example, in the study of the degrees of freedom of interference channels. In this thesis, we are concerned with the additive-combinatorial entropy inequalities which are motivated by their combinatorial counterparts: cardinality inequalities for subsets of abelian groups. As opposed to the existing approaches in the literature in the study of the discrete and continuous entropy inequalities, we consider a general framework of balanced linear entropy inequalities. In particular, we show a fundamental equivalence relationship between these classes of discrete and continuous entropy inequalities. In other words, we show that a balanced Shannon entropy inequality holds if and only if the corresponding differential entropy inequality holds. We also investigate these findings in a more general setting of connected abelian Lie groups and in the study of the sharp constants for entropy inequalities.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2017-08-10 without embargo terms","The student, Ashok Makkuva, accepted the attached license on 2017-04-24 at 13:15.","The student, Ashok Makkuva, submitted this Thesis for approval on 2017-04-24 at 13:16.","This Thesis was approved for publication on 2017-04-26 at 17:46.","DSpace SAF Submission Ingestion Package generated from Vireo submission #10999 on 2017-08-10 at 13:45:33","Made available in DSpace on 2017-08-10T19:15:57Z (GMT). No. of bitstreams: 2 MAKKUVA-THESIS-2017.pdf: 599339 bytes, checksum: c2c6cb2ce9513dae120140237f937bf7 (MD5) LICENSE.txt: 4210 bytes, checksum: 0820f5de79755d3e01231f3919d544ec (MD5) Previous issue date: 2017-04-26"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/97446"],"dc:language":["en"],"dc:rights":["Copyright 2017 Ashok Makkuva"],"dc:subject":["Shannon entropy","Differential entropy","Information theory","Additive combinatorics","Entropy inequalities"],"dc:title":["On equivalence of additive-combinatorial inequalities for Shannon entropy and differential entropy"],"dc:type":["text"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:34Z"}