Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 9 of 9 for “"Information Bottleneck"”.
-
Unsupervised connectivity-based cortex parcellation using the information bottleneck method
In this dissertation, we embody an information-theoretic framework to compress and therefore cluster anatomical connectivity data that avoids many assumptions and drawbacks imposed by previous methods.
-
Information Retrieval with Dense and Sparse Representations
Information retrieval, at the core of numerous applications such as search engines and open-domain question-answering systems, relies on effective textual representation and semantic matching. However, current approaches can lose nuanced lexical detail information due to an information bottleneck …
-
Aggregated Learning: An Information Theoretic Framework to Learning with Neural Networks
… a novel approach to solve this problem under the Information Bottleneck (IB) principle. Based on the IB principle, we associate with the classification problem a representation learning problem, which we call ``IB learning". A careful investigation shows there is an unconventional quantization …
-
Chest X-Ray Image Classification with Deep Learning
… ConsultNet consists of a variational selective information bottleneck branch and a spatial-and-channel encoding branch. These two branches learn discriminative features collaboratively. In addition, each of the proposed methods is comprehensively verified and analysed by conducting various …
-
Statistical Methods for Out-of-distribution Detection
… auxiliary network to capture the OOD-sensitive information for the network? This thesis systematically studies how to effectively solve the aforementioned issues with experimental and theoretical support. Due to the significant difference between ID and OOD samples, it is essential to consider …
-
Speech perception in a sparse domain
… dynamic range of hearing. Thus there is an information bottleneck, whereby these devices must transform acoustical sounds with a large dynamic range into the smaller range of hearing impaired listeners. The limited dynamic range problem can be thought of as a communication channel with …
-
Large Scale Machine Learning in Biology
… used in spectral clustering and the relevance information as defined in the Information Bottleneck method. For fast-mixing graphs, we show that the regularized min-cut cost functions introduced by Shi and Malik over a decade ago can be well approximated as the rate of loss of predictive …
-
Deep concept reasoning: beyond the accuracy-interpretability trade-off
… enables Concept Embedding Models to overcome the information bottleneck, enabling them to achieve state-of-the-art accuracy without sacrificing model transparency. The fourth work addresses the limitations of Concept Embeddings Models which are unable to provide concept-based logic explanations …
-
The complexity of joint computation
… methods for this model. First, we study an information-theoretic lower-bound method due to Cherukhin, which gave the first improvement over the lower bounds provided by the well-known superconcentrator technique for constant depths. (The lower bounds are still barelysuperlinear, however) …