Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 8 of 8 for “"Duplicate detection"”.
-
Active duplicate detection with Bayesian nonparametric models
… of records that refer to the same entity. Called duplicate detection, this task is typically tedious to perform manually, and so a variety of automated methods have been developed for partitioning a collection of records into coreference sets. This task is complicated by ambiguous or noisy field …
-
Approximate string matching methods for duplicate detection and clustering tasks
… methods are utilized by a vast number of duplicate detection and clustering applications in various knowledge domains. The application area is expected to grow due to the recent significant increase in the amount of digital data and knowledge sources. Despite the large number of existing …
-
Efficient near duplicate document detection for specialized corpora
Knowledge of near duplicate documents can be adventagous to search engines, even those that only cover a small enterprise or specialized corpus. In this thesis, we investigate improvements to simhash, a signature-based method which can be used to efficiently detect near duplicate documents. We …
-
Dataset Deduplication with Datamodels
… aspect of data quality: train-test leakage or duplicate examples. These can cause overestimation of models’ performance on benchmarks among other issues. In this work, we apply datamodels, a framework for analyzing the behavior of a model class as a function of its training data, to deduplicate …
-
Automated similarity detection: identifying duplicated requirements
… the challenges of RE, it is highlighted the detection of duplicated requirements. If ignored, these duplicities may lead to redundancy in the textual information of a project and therefore this may lead to the duplicity of tasks. Moreover, the automation of this process and the standardized …
-
Advanced Methods for Large and Long String/Set Similarity Searches
… for database tasks like data cleaning and near-duplicate detection, which aims to find data objects meeting query criteria via similarity functions. Extensively studied for decades, SSS faces new challenges (low efficiency, high space consumption of traditional methods) and opportunities …
-
Automated Approaches to Community Question Answering
… of the new model on two tasks, i.e. question duplicate detection and question reranking, showing the advantages of injecting syntactic information in neural models. After that, we focus on more challenging tasks such as building a neural network architecture for ranking comments on a forum …
-
Statistical Methods for Human Rights and Child Mortality Estimation
This dissertation addresses statistical methodology commonly used in human rights research and child mortality estimation. We first consider two related problems, record linkage and multiple-systems estimation, typically used to estimate the number of civilian casualties in the wake of a conflict …