Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 8 of 8 for “"Differential entropy"”.
-
On equivalence of additive-combinatorial inequalities for Shannon entropy and differential entropy
Entropy inequalities are very important in information theory and they play a crucial role in various communication-theoretic problems, for example, in the study of the degrees of freedom of interference channels. In this thesis, we are concerned with the additive-combinatorial entropy inequalities …
-
Information theory meets big data: Theory, algorithms and applications to deep learning
… especially k-nearest neighbor estimators of differential entropy and mutual information; (2) designing novel algorithms of differential entropy and mutual information estimators for some special and challenging practical scenarios, as well as new information-theoretic measures to discover …
-
Deep Time: Deep Learning Extensions to Time Series Factor Analysis with Applications to Uncertainty Quantification in Economic and Financial Modeling
… the autoencoder framework. We utilize Shannon's differential entropy to accomplish the task of uncertainty quantification in a general nonlinear and non-Gaussian setting. Together with previously established connections between autoencoders and principal component analysis, we motivate the focus …
-
Some Information Theoretic Aspects of Reliable Communication With Transmitter Side Information
… yields a generalization of the classical vector entropy-power inequality (EPI). In another special case, this inequality sheds insight into the problem of maximizing the differential entropy of the sum of two jointly distributed random variables.
-
Theoretical Properties and Estimation In Weighted Weibull and Related Distributions
… the hazard functions. The standardized moments, differential entropy, Fisher information and results based on the likelihood function are given for each distribution as well. These results are also shown for the Rayleigh distribution, a special case of the Weibull distribution, and its weighted …
-
Information theoretic bounds for distributed computation
… in the function to be estimated, via its differential entropy, and the desired accuracy level, as specified by the mean square error criterion. Next, I demonstrate the use of this bound in a scenario where nodes communicate through erasure channels to learn a linear function of all the …
-
Entropy in Data Compression, Additive Combinatorics and Probability
… and its relationship with the conditional varentropy rate is established. Interestingly, the dispersion is different in reference-based and pair-based compression, and it is proved that the reference-based dispersion is in general smaller. Secondly, a discrete, asymptotic analogue of the …
-
Functional properties of white maize meal stored under tropical conditions
… for moisture adsorption showed that the differential enthalpy and differential entropy increased with decreasing moisture content. The isokinetic theory showed that the moisture adsorption process in white maize meal was enthalpy driven. The white maize meal browned during storage, …