Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 77 for “"Pretraining"”.
-
Study of Pretraining Bias and Frequencies
… tasks. Recent works have showcased the impact of pretraining data on the in-context performance of language models. In this work, we experiment with numbers having high and low frequencies in the pretraining data to understand the impact of term frequencies on the model's performance. We also …
-
Pretraining Table Embeddings for Knowledge Graph Based Provenance Systems
We aim to build a knowledge graph based provenance system for data objects across institutions and teams. The world of data objects and systems is complex and heterogeneous. For effective collaboration, a shared data model is needed. Specifically, this work examines the problem of provenance …
-
Chart Question Answering with an Universal Vision-Language Pretraining Approach
… existing methods for these tasks often rely on pretraining on language or vision-language tasks, neglecting the explicit modeling of chart structures. To address this, we first build a large corpus of charts covering diverse topics and visual styles. We then present UniChart, a pretrained model …
-
MPrompt: A Pretraining-Prompting Scheme for Enhanced Fewshot Subgraph Classification
… we also present Subgraph Reconstructive Pretraining (SRP) which can provide MPrompt with better structural embeddings during pretraining. Experiments are conducted on both synthetic and real-world datasets, including protein function prediction and social network analysis. Our method …
-
Understanding the mechanism of pretraining stabilization heuristics: A variance-oriented perspective
Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-09-16 without embargo terms
-
Understanding the mechanism of pretraining stabilization heuristics: A variance-oriented perspective
Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-09-16 without embargo terms
-
Meta-Learning and Self-Supervised Pretraining for Few-shot Image Translation
Recent advances in machine learning (ML) and deep learning in particular, enabled by hardware advances and big data, have provided impressive results across a wide range of computational problems such as computer vision, natural language, or reinforcement learning. Many of these improvements are …
-
Effects of Pretraining on the Visual Discrimination Learning Performance of 3-Month-Old Infants
… groups received two different types of visual pretraining prior to a visual discrimination learning task while the control group received no pretraining. One type of pretraining, familiarization training, involved the presentation of the most salient stimulus feature used in the experimental …
-
The Effects of Type of Stimulus Pretraining and Stimulus Complexity on Encoding Processes of Normals and Retardates.
… was to study the effects of type of stimulus pretraining and stimulus complexity on encoding processes of normals and retardates using a serial probe task. A review of the literature indicated that retardates are deficient in what Bower refers to as "coding as elaboration." Thirty normal Ss …
-
The Effects of Pretraining Upon The Training and Transfer of Circuit Board Assembly Skills of Retarded Adults
Made available in DSpace on 2014-12-10T21:07:57Z (GMT). No. of bitstreams: 1 7511821.pdf: 2778641 bytes, checksum: 9643f9a4958613af3e50753aa56dcc23 (MD5) Previous issue date: 1974
-
Effects of Habitual and Contingency Experience on the Visual Discrimination Learning and Decision Time of 4-Month-Old Infants
… This study examined the effects of two types of pretraining experiences aimed at promoting exhaustive visual scanning of stimuli to enhance visual discrimination learning. There were three phases to this study. Phase 1 was an assessment of all infants' natural attending behavior to compare to …
-
BantuBERTa : using language family grouping in multilingual language modeling for Bantu languages
It was researched whether a multilingual Bantu pretraining corpus could be created from freely available data. Here, to create the dataset, Bantu text extracted from datasets that are freely available online (mainly from Huggingface) were used. The resulting multilingual language model (BantuBERTa) …
-
The Effects of Social Reinforcement and Sex of Peer Reinforcing Agent on The Performance of Boys and Girls as a Function of Pretraining Experience
Made available in DSpace on 2015-05-12T22:33:27Z (GMT). No. of bitstreams: 2 license.txt: 4848 bytes, checksum: 96035ab3f5e1c23cc7138a224ce498bd (MD5) 7105144.PDF: 3233813 bytes, checksum: abeadfca7460412072e67b17134bf268 (MD5) Previous issue date: 1970
-
Adapting Transformer Encoder Architecture for Continuous Weather Datasets with Applications in Agriculture, Epidemiology and Climate Science
… and climate science. Leveraging a novel pretraining dataset composed of 39 years of satellite measurements across the Americas, WeatherFormer achieves state-of-the-art performance in crop yield prediction and influenza forecasting. Technical innovations include a unique spatiotemporal …
-
Effects of aerobic exercise and weight reduction on carbohydrate metabolism during submaximal exercise in sedentary, overweight women
… (5.4%), as were exercise RQ (VCO2/VO2) ratios. Pretraining serum glucose and blood lactate significantly increased while nonsignificant decreases were noted in insulin and cortisol as a result of the submaximal exercise bout. The significant increases in glucose and lactate during exercise were …
-
Self-Supervised ECG Learning for Multimodal Clinical Tasks
… time series representations. This unimodal pretraining improves ECG classification, achieving a 23-point AUC gain on the underrepresented Ga dataset. We then align and fuse these ECG embeddings with chest X-rays and EHR text using a vision–language model backbone, enabling end-to-end …
-
Effects of Ventromedial Hypothalamic Lesions on Food-Reinforced Fixed Ratio Responding
… effect was also seen in rats which had extensive pretraining on the fixed ratio task. Nonpretrained rats with lesions made with platinum electrodes showed a smaller, more variable deficit. However, rats with both platinum lesions and extended pretraining pressed reliably more than controls on …
-
Spoken Language Processing and Modeling for Aviation Communications
… This thesis experiments with a process for pretraining transformer-based language models on aviation English corpora and compare the effectiveness and performance of language models transfer learned from pretrained checkpoints and those trained from their base weight initializations (trained …
-
Exploring Loss Functions in Machine Learning
… in large document embeddings. Existing model pretraining methods primarily focus on local information. For instance, in the widely used token masking strategy, words closer to the masked token are given more importance for prediction than words further away. While this approach results in …
Page 1 of 4