Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 201 for “"Mutual information"”.
-
Mutual Information-based RBM Neural Networks
… are still nebulous. In this work, we use information theory to analyze the concatenated restricted Boltzmann machines (RBMs) and propose a mutual information-based RBM neural networks (MI-RBM). We develop a novel pretraining algorithm to maximize the mutual information between RBMs. …
-
Alignment by maximization of mutual information
Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1998.
-
Mutual information based tracking with mobile sensors
… problem with mobile sensor nodes. We utilize mutual information as the objective for optimal sensor placement. We show how a constrained dynamic programming approach allows us to balance estimation quality against mobility costs. However this constrained optimization problem is NP-hard. We …
-
Mutual information derived functional connectivity of the electroencephalogram (EEG)
… and rely on linear dependencies. Here we utilize mutual information (MI) as the metric for determining nonlinear statistical dependencies between electroencephalographic (EEG) channels. Previous work investigating MI between EEG channels in subjects with widespread diseases of the cerebral cortex …
-
Neural Data Shaping and Evaluation via Mutual Information Estimation
… such as HIPAA and GDPR and recent progress in information estimation literature motivate us to investigate the issue from an information theoretic perspective. In this thesis, we propose InfoShape, an encoder training scheme that aims to maintain privacy while also preserving utility for …
-
Mutual information-based gradient-ascent control for distributed robotics
… implementation of a novel class of decentralized mutual information-based gradient-ascent controllers that continuously move robots equipped with sensors to better observe their environment. We begin with the fundamental problem of deploying a single ground robot equipped with a range sensor and …
-
Mutual Information as a Predictor of Group Performance: Application to Soccer Teams
… demonstrate that a simple measure derived from information theory called mutual information is predictive of group performance. Mutual information captures the probabilistic dependency between two states, and can incorporate the time dimension to quantify dynamic interactions. Here we apply …
-
Mutual information relevance networks : functional genomic networks built from pair-wise entropy measurements
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
-
Efficient Computation of Map-scale Continuous Mutual Information on Chip in Real Time
… widely-studied technique involves computing the Mutual Information (MI) between the current map and future measurements, and utilizing this MI metric to decide the locations for future measurements. However, computing MI for reasonably-sized maps is computationally and energywise expensive, often …
-
Entropy, information rate and mutual information measures for the email content of information workers
Although most people agree that the use of information technology increases workplace productivity, the exact relationship between productivity and different characteristics of information employees send and receive, such as entropy, information rate and mutual information is not very well studied. …
-
Mutual Information of Two Distant Spheres and Expressions for Entropy in Nearly Conformal Gaussian Field Theories
… states. We use this method to compute the mutual information of two distant spheres in a massless scalar field and find that the lowest order term agrees with existing results found with other methods. We also use our method to compute the entropy difference of massless scalar fields …
-
Improving partial mutual information based input variable selection for data driven environmental and water resources models
… for the sake of more accurate IVS. Partial mutual information (PMI) is one of the most promising approaches to IVS, as it has a number of desirable properties, such as the ability to account for input relevance, the ability to cater to both linear and non-linear input-output relationships …
-
Mutual information: inferring tie strength and proximity in bipartite social network data with non-metric associations
… first step exploration of a new method that used mutual information-based measures to represent tie strength or proximity between individuals from bipartite social network data with non-metric associations. Unlike network datasets with explicit links between nodes, bipartite networks provide only …
-
Particle Image Velocimetry Correlation Signal-to-noise Metrics, Particle Image Pattern Mutual Information and Measurement uncertainty Quantification
… of noise sources. The inherent amount of signal mutual information between consecutive images governs the strength of the resulting PIV cross correlation and ultimately the accuracy and uncertainty of the produced PIV measurements. Hence we posit that the correlation signal-to-noise-ratio (SNR) …
-
Temporal dynamics of MEG phase information during speech perception: Segmentation and neural communication using mutual information and phase locking
… speech stream contains a rich amount of temporal information. In particular, information on slow time scales, the delta and theta band (125 - 1000 ms, 1 - 8 Hz), corresponds to prosodic and syllabic information while information on faster time scales (20-40 ms, 25 - 50 Hz) corresponds to …
-
An evaluation of the robustness of the natural-adversarial mutual information-based defense and malware classification against adversarial attacks for deep learning
… that was recently developed that aims to use mutual information (MI) as an additional feature for the adversarial training of classification models called natural-adversarial mutual information-based defense (NAMID). We will describe our extensive evaluation of NAMID, as well as introduce our …
-
A continuous approach to information-theoretic exploration with range sensors
… of robotic exploration: computing the expected information gain -- i.e. mutual information -- between an occupancy map and a range sensor measurement. The algorithm we derive has a lower complexity and in practice runs 200 to 1500 times faster than the state of the art CSQMI and FSMI algorithms. …
-
Noncoherent Communication Over Fading Channels
… we derive upper and lower bounds for the mutual information generated by the Gaussian input distribution. The upper bound shows that the mutual information remains bounded at high SNR. We obtain necessary and sufficient conditions that characterize good input distributions, using the …
-
Power allocation and linear precoding for wireless communications with finite-alphabet inputs
… precoding and power allocation. First, the mutual information or capacity region is derived for finite-alphabet inputs such as phase-shift keying (PSK), pulse-amplitude modulation (PAM), and quadrature amplitude modulation (QAM) signals. This approach, without the commonly used Gaussian …
-
An Information Theoretic Study on Linear Dispersion Codes and Low -Density Parity -Check Codes
In this dissertation, we focus on an information theoretic study of linear dispersion (LD) codes and low-density parity-check (LDPC) codes. For bit-linear LD codes, we find necessary and sufficient conditions on the dispersion matrices for the a posteriori distribution of the information bit vector …
Page 1 of 11