Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 11 of 11 for “"instruction-tuning"”.

  1. Instructify: Demystifying Metadata to Visual Instruction Tuning Data Conversion Supplementary Materials

    Visual Instruction Tuning (VisIT) data, commonly available as human-assistant conversations with images interleaved in the human turns, are currently the most widespread vehicle for aligning strong LLMs to understand visual inputs, converting them to strong LMMs. While many such VisIT datasets are …

    mit Repository record for Instructify: Demystifying Metadata to Visual Instruction Tuning Data Conversion Supplementary Materials (opens in a new tab)

  2. Advancing Language Equity and Sample Efficiency in Task-Oriented Dialogue Systems

    … we propose a question-answering-based supervised instruction tuning approach, with questions capturing the semantics of seen and unseen classes. Proposed approaches were empirically validated across diverse (dialogue and non-dialogue) natural language understanding tasks and languages, …

    cambridge Repository record for Advancing Language Equity and Sample Efficiency in Task-Oriented Dialogue Systems (opens in a new tab)

  3. Foundation Models for Protein Phenotype Prediction

    … a dataset of 33 million protein phenotype instructions, representing a comprehensive resource for multiscale protein phenotypes. By co-training a large language model with multimodal molecular encoders, ProCyon integrates phenotypic and protein data. A novel architecture and instruction

    mit Repository record for Foundation Models for Protein Phenotype Prediction (opens in a new tab)

  4. Structural Robustness of Transformer Models for Clinical Text Summarization on MIMIC-III

    … MedAlpaca exhibited the most severe failures. Instruction-tuning on diverse tasks outperforms biomedical pre-training for structural resilience.

    uic

  5. Domain Adaptation of LLMs for Materials Science: Dataset Curation, Fine-Tuning, and Evaluation Benchmark

    … this challenge, the thesis introduces a curated instruction-tuning dataset composed of diverse question-answer (QA) pairs drawn from various materials science sources such as textbooks, property databases, and expert forums. This dataset was used to fine-tune the LLaMA-3-8B-Instruct model, to …

    gatech Repository record for Domain Adaptation of LLMs for Materials Science: Dataset Curation, Fine-Tuning, and Evaluation Benchmark (opens in a new tab)

  6. Towards Large Language Models for Everyone: Instruction Following, Knowledge Retrieval and Multilingualism

    … all three challenges. We begin by studying the Instruction Meta-Learning (IML) approach, enabling LLMs to perform an array of tasks by fine-tuning them over pairs of natural language instructions and responses. Our study highlights the efficacy of scaling IML along three axes: fine-tuning task …

    washington Repository record for Towards Large Language Models for Everyone: Instruction Following, Knowledge Retrieval and Multilingualism (opens in a new tab)

  7. Scalable Data Paradigms for Steering General-Purpose Language Models

    … downstream applications, such as following instructions, chatting with users, using tools, or performing complex reasoning, poses another set of challenges that require diverse, high-quality, and increasingly costly training data. This dissertation explores scalable paradigms for …

    washington Repository record for Scalable Data Paradigms for Steering General-Purpose Language Models (opens in a new tab)

  8. Adversarial Risks and Stereotype Mitigation at Scale in Generative Models

    … learned stereotypes. This approach uses instruction tuning on general-purpose datasets and mitigates stereotypes implicitly without relying on targeted debiasing techniques. Extensive evaluations on state-of-the-art models demonstrate that our methods substantially reduce harmful …

    vt Repository record for Adversarial Risks and Stereotype Mitigation at Scale in Generative Models (opens in a new tab)

  9. Robust foundation model for healthcare

    … and Llemr introduces a general framework for instruction-tuning large language models (LLMs) to process and interpret clinical data with complex structures. Building upon these methodological contributions, I co-led the development of PyHealth, an open-source Python library that provides a …

    uiuc Repository record for Robust foundation model for healthcare (opens in a new tab)

  10. Next-Generation Intelligent Portfolio Management

    … framework for LLMs, finely tuned through instruction tuning to align with human instructions and incorporate market feedback. This approach enables dynamic weight adjustments within the Retrieval-Augmented Generation (RAG) module, showcasing the synergy between extracting more accurate …

    mit Repository record for Next-Generation Intelligent Portfolio Management (opens in a new tab)

  11. Efficient and Composable Adaptation for Cross-Lingual Transfer

    Parameter-efficient fine-tuning (PEFT) has emerged as a important technique for moderating the growing cost of fine-tuning state-of-the-art pre-trained language models. The modular properties of some PEFT techniques, such as reusability, composability and resistance to overfitting, lend them to …

    cambridge Repository record for Efficient and Composable Adaptation for Cross-Lingual Transfer (opens in a new tab)