Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 18 of 18 for “"expert ratings"”.
-
Assessing Reliability of Expert Ratings Among Judges Responding to a Survey Instrument Developed to Study the Long Term Efficacy of the ABET Engineering Criteria, EC2000
… it is necessary to analyze the quality of their ratings. The psychometric issues associated with assessment provide the lens through which researchers interpret results and important decisions are made. Therefore, inter-rater agreement (IRA) and inter-rater reliability (IRR) are pre-requisites …
-
Coach Effectiveness and Personality Assessments: An Exploratory Analysis of Thin Slice Interpersonal Perceptions
… effectiveness and personality attributes. Ratings of coaching effectiveness were correlated with expert ratings of effectiveness to measure accuracy. The ratings of attributes were correlated with expert ratings of the same attributes to measure consensus. Gender, race, and level of sport …
-
Evaluation of the Situational Judgment Test
… was theoretically developed and received expert ratings to assess four general constructs: problem solving, planning, priority setting, and leadership. No support from alpha internal consistency reliability analysis was found for the assembly of these items into the four a priori …
-
Investigating a leadership fix for a suboptimal mix: a transformational leadership intervention for teams with incompatible personalities
… ranking task. Performance was measured against expert ratings on these tasks. Hypotheses were that dyadic teams based on the pairing of highly extraverted individuals in the TL condition would outperform their no leadership intervention condition counterparts. No support for the proposed …
-
An Evaluation of Alternate Forms of Reliability of the Situational Assessment of Leadership: Student Assessment (SALSA©)
… were categorized by p-value and Subject Matter Expert ratings gathered from the previous study. Items were then selected based on a combination of difficulty and item-total correlation (ITC) values. Selected items were paired based on ITC, and randomly assigned to either Form A or Form B. The …
-
Development of the Interview and Interrogation Assessment Instrument
… judicial decision making, and courts may call an expert social scientist to assess the coercive pressures of an interrogation and risk factors for false confession. At present, there exists no standardized methods for performing this task, and each expert uses their own unstructured professional …
-
Deep learning for Alzheimer’s disease: towards the development of an assistive diagnostic tool
… medical domain knowledge which was obtained from experts and tissue examinations was tightly integrated with the interpretable outcomes derived from our machine learning frameworks. I demonstrated that the model, which generalized well on multiple independent cohorts, achieved diagnostic …
-
The Big X of Leadership: A Functional Approach to Understand Different Ways to Lead
… for followers. Through construct mapping, expert ratings, and validation with organizational followers, I establish a quasi-circumplex model that organizes the leadership landscape into a coherent structure. This thesis moves beyond existing descriptive taxonomies, offering theoretically …
-
An evaluation of selected psychometric characteristics of the ethical judgment scale
… content validity of the EJS was supported by expert ratings of the hypothetical incidents; however, an evaluation of the response choices indicated that 20 of the incidents had at least two inappropriate response options. An examination of internal consistency reliability of the EJS, using …
-
Advancing Theory and Developing a Measure of Team Impression Management
… refines the list of items using subject matter expert ratings. Study 3 investigates the initial factor structure of the team IM measure at the individual-level through an online panel sample, refines the list of items further, and investigates convergent validity with other IM-related …
-
Collaboration in Language Testing: Investigating the Validity of a New Rating Procedure for EFL Writing Assessment in Korea
… the psychometric reliability of self- and peer-ratings in a second language (L2) essay-writing test in Korea, (2) to explore students' rating process, and (3) to understand student's perception of rating tasks. The rationale of this research is that the Korean EFL students whose major is English …
-
Automated Care Pathway Modeling Using Agentic and Knowledge-Aware LLMs
… distance; a clinician provides fidelity ratings with qualitative annotations. We then investigate knowledge-aware modeling via a categorization of recurrent errors and curated clinical statements, testing prompt-only injections versus a dedicated Knowledge Advisor agent placed at different …
-
The Use of Global and Specific Items in Evaluating Teaching in a Teaching Assistant Training Program
… in teaching, changes that were validated by experts, would change the overall ratings of instructors. In a previous study thirty-seven graduate teaching assistants participated in a workshop on improving lecturing skills. The teaching assistants were divided into treatment and control groups …
-
Factors Affecting the Efficacy of Rater Training: Information Type and Mode of Presentation
<p>In order to enhance the quality of performance ratings, researchers have directed their efforts towards training raters to evaluate performance more accurately. The purpose of the present study was to examine two factors that may affect the efficacy of rater training for improving the accuracy …
-
The effect of observer involvement on subjective judgments of technical, emotional, and overall quality of photographic prints
… of each print. When the images were rated by experts, it was found that females had higher expert ratings than males. Additionally, when the age by gender interaction was examined, differences were found between young males and young females and older females. It was found that participants …
-
Identification, Evaluation and Control of Physically Demanding Patient-Handling Tasks in an Acute Care Facility
… level of agreement between and within different expert groups. Three groups of participants were involved, with different levels of ergonomics expertise (i.e. researchers, consultants, and graduate students). These groups viewed digitized video clips from the laboratory simulation (Chapter 4) and …
-
Development of an information literacy course for community college students
… survey research to solicit input from a panel of experts on information literacy. The attributes of an information literate person identified by a panel of experts in 1992 were used as the basis for developing content goals for an information literacy course for community college associate degree …
-
Statistical Methods for Performance Evaluation of Machine Learning and Artificial Intelligence Models
… quality of the AI-generated code based on human expert assessment, focusing on code quality, correctness, executability and output. To support this evaluation, the last part of this dissertation introduces a new open-source dataset called StatLLM. This dataset provides examples of statistical …