Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 21 for “"automatic evaluation"”.
-
Evolution of a text summarization system in an automatic evaluation framework
… to CALLISTO such as replacing the internal evaluation measure, testing other discretization processes, changing the learning algorithm or adding new features to characterize the input text. We found that Naive Bayes outperformed the current learner C5.0, by identifying one configuration …
-
Pain and social context: social, contextual and environmental factors in the perception of acute pain
… and it has been argued also that the process of automatic evaluation effects changes in affectivemotivational state through the activity of limbic structures associated with the detection and processing of emotionally valenced environmental information. This thesis proposes that through this …
-
Automated creation of Wikipedia articles
This thesis describes an automatic approach for producing Wikipedia articles. The wealth of information present on the Internet is currently untapped for many topics of secondary concern. Creating articles requires a great deal of time spent collecting information and editing. This thesis presents …
-
Task-Based Mass Optimization of Reconfigurable Robotic Manipulator Systems
… find mass-minimized solutions. To facilitate the automatic evaluation required by the genetic algorithm, Denavit-Hartenberg parameters are automatically generated from module combinations. Reconfigurable manipulators are shown to be lighter than fixed-topology manipulators, demonstrating the …
-
Automatic assessment of biological control effectiveness of the egg parasitoid Trichogramma bourarachar against Cadra cautella using machine vision
… primary objective of this research is to achieve automatic evaluation of the efficiency of using Trichogramma bourarachae for biological control of Cadra (=Ephestia) cautella by calculating the rate of parasitization. Cadra cautella is a moth feeding as a larva on dried fruit as well as stored …
-
Loss and Reward Functions for Generative Question Answering Systems
… on this foundation, we extended our approach to automatic evaluation systems for QA. In particular, we designed SQuAre (Sentence-level QUestion AnsweRing Evaluation), an innovative reference-based metric that utilizes multiple positive and negative references for evaluating QA systems. As …
-
Multimodal machine translation
… models are tested on multiple datasets using the automatic evaluation metrics like METEOR and BLEU. The experiments show that the proposed models outperform the text-only baseline model.
-
Micro-operation perturbations in chip level fault modeling
… fault at the chip level? In this thesis, an automatic evaluation system is developed to determine the best micro-operation perturbation. The measure used is the gate level stuck-at fault coverage achieved by the tests derived to cover the micro-operation perturbation faults. For small …
-
A novel dependency-based evaluation metric for machine translation
Automatic evaluation measures such as BLEU (Papineni et al. (2002)) and NIST (Doddington (2002)) are indispensable in the development of Machine Translation (MT) systems, because they allow MT developers to conduct frequent, fast, and cost-effective evaluations of their evolving translation models. …
-
CIRCUIT: A Benchmark for Circuit Interpretation and Reasoning Capabilities of LLMs
… we introduced a unique dataset design and evaluation metric that enable unit-test-like evaluation by grouping questions into unit tests. In this case, GPT-4o can only pass 27.45% of the unit tests, highlighting that the most advanced LLMs still struggle with understanding circuits, which …
-
Investigating the effects of controlled language on the reading and comprehension of machine translated texts: a mixed-methods approach
… which a number of quantitative and qualitative evaluation methods are combined. These include: eye tracking, automatic evaluation metrics (AEMs), retrospective interviews, human evaluations, memory recall testing, and readability indices. A further aim of the research is to investigate what, if …
-
An Investigation into Automatic Translation of Prepositions in IT Technical Documentation from English to Chinese
… The approaches include: firstly building an automatic preposition dictionary for the RBMT system; secondly exploring and modifing the process of Statistical Post-Editing (SPE) and thirdly pre-processing the source texts to better suit the RBMT system. Overall evaluation results (both human …
-
A remote access CT colonography training system
… of their training. They can also run an automatic evaluation of their work based on gold standard information previously gathered from specialists. This thesis also describes an initial implementation exclusively made up of Java Servlets. The evaluation of this system has been discussed …
-
People-search : searching for people sharing similar interests from the web
… to the main proposed algorithm. Two kinds of evaluations were conducted. In the automatic evaluation, precision, recall, F and Kruskal-Goodman F measures were used to compare these algorithms. In the human evaluation, the effectiveness of the main proposed algorithm and two other important …
-
Experimental Studies of Spacecraft Plasma Interactions: Facility Characterization and Initial Measurements
… in the chamber. A Matlab code was developed for automatic evaluation of the Langmuir probe traces. Two sets of measurements were preformed. The first measurement characterizes the plasma produced by the hot filament cathode in the chamber. Langmuir Probes were used to characterize the plasma …
-
Utilization of Natural Language Processing for Extracting Smart Cities Requirements from Large Social Media Text
… analysis, and validate these methods both using automatic evaluation and manual assessment. As a result, we are able to identify issues related to city development, senior citizens, taxes, and unemployment using our best performing models (BERTopic for topic modeling and few-shot learning using …
-
Algorithmic Developments for Sequence Analysis, Structure Modeling and Functional Prediction of Proteins
… structure information with sequence profiles. Evaluation on PFAM-based system shows that this method provides improved structure template detection ability and generates alignment of better quality. Third, in order to systematically assess the structure modeling abilities of different sequence …
-
Knowledge base integration in biomedical natural language processing applications
… agents for medication adherence, and automatic evaluation of medical students' chart notes. In the first task, we take as a use case simplifying medication instructions to enhance medication adherence among patients. Given the lack of an appropriate parallel corpus, the Unified Medical …
-
Improving Abstractive Summarization and Information Consistency Assessment
… highly expensive, motivating the need to develop automatic assessment methods. There are many attributes associated with good summaries such as fluency and consistency. Since generation systems based on foundation models are highly fluent, this work focuses on information consistency between the …
-
Response Generation in Longitudinal Dialogues
… set of persona statements. Advancement in human evaluation is another required step to make progress in dialogue system research. Current automatic evaluation measures are poor surrogates, at best. There are no agreed-upon human evaluation protocols and it is difficult to develop them. As a …
Page 1 of 2