Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 16 of 16 for “"rater training"”.
-
Rater Training to Improve Student Evaluations of Teaching Effectiveness
The impact of rater training on students performing evaluations of teaching effectiveness was evaluated. Training was administered either via live lecture or video tape. Both trained groups were compared with a no training control group. It was hypothesized that the training would result in more …
-
Factors Affecting the Efficacy of Rater Training: Information Type and Mode of Presentation
… researchers have directed their efforts towards training raters to evaluate performance more accurately. The purpose of the present study was to examine two factors that may affect the efficacy of rater training for improving the accuracy of performance ratings. One factor was the type of …
-
The Effects of Rater Training on the Relationship between Item Observability and Rater Agreement
… They investigated the relationship between rater agreement and the observability of items on a rating form. The current study found similar results in that, as items became less observable, interrater agreement increased. The purpose of this study was to introduce frame of reference training …
-
The Effect Of Instrument-Specific Rater Training On Interrater Reliability And Counseling Skills Performance Differentiation
… was to explore the effect of instrument-specific rater training on interrater reliability (IRR) and counseling skills performance differentiation. Strong IRR is of primary concern to effective program evaluation (McCullough, Kuhn, Andrews, Valen, Hatch, & Osimo, 2003; Schanche, Nielsen, …
-
The Influence of Rater Training, Scale Format, and Rating Justification on the Quality of Performance Ratings by Three Rater Sources
… was to examine systematically the influence of rater training, scale format, and rating justification on the quality (i.e., convergent and discriminant validity, halo, leniency) of ratings exhibited by three rater sources (i.e., self, peer, observer). Ninety-one undergraduate students …
-
Improving the Accuracy of Performance Evaluations: A Comparison of Three Methods of Performance Appraiser Training
<p>Researchers in the area of rater training have relied almost exclusively on rater error measures to assess training effectiveness. A reduction in rater tendency to commit these errors subsequent to training is viewed as evidence that these raters have become more accurate in rating their …
-
The development and evaluation of a systematic training program for increasing both rater reliability and rating accuracy
… to identify the characteristics of modeling a rater training program and to develop an efficient training model at the University of Illinois at Urbana-Champaign. This study focuses substantially on a basic conception of rater reliability including true score measurements of examinees’ language …
-
Differentiating Rater Accuracy Training Programs
Prior investigation of a new rater training paradigm, rater variability training (RVT), found no clear empirical distinction between RVT and the more established frame-of-reference training (FOR), (Hauenstein, Facteau, & Schmidt, 1999). The purpose of the present study was to expand upon this …
-
The Effectiveness of Test -Takers' Participation in Development of an Innovative Web -Based Speaking Test for International Teaching Assistants at American Colleges
… significant rating difference of one rater and rating discrepancy on the tasks in certain situations, no misfit across rater and task, and the need of more rater training. It could be concluded that the test-takers' participation in language test development was supportive results of …
-
Effects of respondent training on self-report personality assessment: an item response theory approach
… theory (IRT) framework and inspired by the rater training literature, this study explored the effects of short online respondent training on personality item interpretation and responding and the number of response categories (i.e. polytomous vs. dichotomous) on item performance, model-data …
-
Do Rater Personality Traits Moderate the Relationship Between Intelligence and Rating Accuracy in Interviews?
… in human resource management shows that various rater characteristics predict accuracy, but emerging findings suggest that these individual differences may interact with one another (rather than being direct effects). The present study aimed to add to this area of research by determining how …
-
Rater Implicit Gender Bias in a Multi-Center Simulation-Based Resident Milestone Assessment
… scoring bias based on gender concordance between rater and resident by comparing global assessments to the checklist score on each case. Hierarchical linear modeling accounted for clustering by residency program, site, and rater. Results: Checklist and global assessments (GA) scores were strongly …
-
The Influence Of Noncognitive Skills In Physician Assistant Education
… collection. These themes were holistic review, rater training consistency, development and reinforcement of noncognitive skills, directors report an overall positive experience, data collected by programs not yet analyzed, and a change in student demographics. Recommendations included PA …
-
The reliability and validity development of an MSK profiling tool and its value in youth athletes and prospective injury risk
… excellent within and between session and intra-rater reliability. Indicating the QASLS tool is a valid and reliable field-based method of analysing movement quality, but recommendations included further refinement of statistical exploration and application into additional populations.The …
-
Rater Drift in Constructed Response Scoring via Latent Class Signal Detection Theory and Item Response Theory
… As such, they require the judgment of multiple raters that are subject to differences in perception and prior knowledge of the material being evaluated. As with any scoring procedure, the scores assigned by raters must be comparable over time and over different test administrations and forms; in …
-
The educational leader portfolio: the reliability of portfolios as documentation of mastery of Isllc standards and functions
… or inconsistency existed among the portfolio raters. Many colleges and universities utilize portfolios as performance-based assessments to measure growth of educational leadership students. The results of this study are provided as evidence of what is working and what is not working in regard …