Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 418 for “"rater"”.
-
The Effects of Rater Training on the Relationship between Item Observability and Rater Agreement
… They investigated the relationship between rater agreement and the observability of items on a rating form. The current study found similar results in that, as items became less observable, interrater agreement increased. The purpose of this study was to introduce frame of reference training …
-
Differentiating Rater Accuracy Training Programs
Prior investigation of a new rater training paradigm, rater variability training (RVT), found no clear empirical distinction between RVT and the more established frame-of-reference training (FOR), (Hauenstein, Facteau, & Schmidt, 1999). The purpose of the present study was to expand upon this …
-
A STUDY TO IDENTIFY FACTORS OF RATER COGNITION FROM DIFFERENT RATER PERSPECTIVES DURING PERFORMANCE-BASED ASSESSMENTS
… complex, and the literature shows high levels of rater variance in rater scores and the ability of a rater to accurately assess and rate a performance. The field of rater cognition studies the variety of cognitive factors influencing a rater’s ability to accurately observe, process, and integrate …
-
Assessing Inter-rater Agreement for Compositional Data
… scores, comparisons involving more than two raters, and studies that involve replicate scores on the same subjects. Numerous simulation studies are used to demonstrate the validity of our model and the advantages of our approach. Both simulated data and a real scoring data set are analyzed to …
-
The Influence of Rater Training, Scale Format, and Rating Justification on the Quality of Performance Ratings by Three Rater Sources
… was to examine systematically the influence of rater training, scale format, and rating justification on the quality (i.e., convergent and discriminant validity, halo, leniency) of ratings exhibited by three rater sources (i.e., self, peer, observer). Ninety-one undergraduate students …
-
Rater Training to Improve Student Evaluations of Teaching Effectiveness
The impact of rater training on students performing evaluations of teaching effectiveness was evaluated. Training was administered either via live lecture or video tape. Both trained groups were compared with a no training control group. It was hypothesized that the training would result in more …
-
Robustness of Inter-Rater Reliability Estimators to Rater Leniency/Severity Effects In An Absolute Decision Setting - A Monte Carlo Study of Performance Ratings
<p>Inter-rater reliability coefficients are often reported in performance assessment as a measure of rating quality. Rater effects, as a systematic error in rating, may change the decision made about an examinee when an absolute interpretation of scores, such as a pass/fail decision, is used. …
-
Inter-rater reliability using a modified Balance Error Scoring System
… aim of this research was to examine the inter-rater reliability of a modified BESS (mBESS) test. Secondary aims included determining if there was a relationship between the BESS and COWA scores, and whether this test was an appropriate level of difficulty for older adults. The mBESS test was …
-
The Relationship Between Rater Agreement, Behavioral Observability and Overall Impressions
… two item characteristics believed to influence rater agreement: observability and difficulty. The first goal of this study was to replicate the findings of Roch, Paquin and Littlejohn (2009), which found that rater agreement was negatively related to item observability (Hypothesis 1) and rating …
-
Prediction of Rater Differences in the Quality of Halo Effect
Made available in DSpace on 2014-12-03T23:50:55Z (GMT). No. of bitstreams: 1 0020853.pdf: 3102915 bytes, checksum: 99d5531ad1a68fd2cbc5411705c7eb8e (MD5) Previous issue date: 1957
-
Effects of Congruence of Rater and Ratee Goals on Performance Appraisal
… either performance or motivation oriented goals. Raters and leaders were considered congruent, as opposed to incongruent, in conditions where both shared the same goal. It was predicted that conditions of goal congruence would produce higher ratings of leader effectiveness and would result in …
-
Inter-rater Reliability of Lumbar Segmental Instability Tests and the Subclassification
Objectives: This study investigated the inter-rater reliability of three structural end-range lumbar segmental instability tests with the highest positive Likelihood Ratio against flexion-extension radiographs, and three functional mid-range clinical tests that predict the success of lumbar …
-
Detecting Rater Centrality Effect Using Simulation Methods and Rasch Measurement Analysis
This dissertation illustrates how to detect the rater centrality effect in a simulation study that approximates data collected in large scale performance assessment settings. It addresses three research questions that: (1) which of several centrality-detection indices are most sensitive to the …
-
The examination of inter-rater reliability and the reliability of attachment measures
… subjective measures, as well as the inter-rater reliability of those using the subjective measures. Participants were volunteers who had worked with the Division of Youth and Family Services (DYFS). They included social workers, lawyers, psychologists, etc. Participants were asked to answer …
-
Use and Design of Multi -Rater Assessment in Three Fortune 500 Organizations
The purpose of this study was to gain a deeper understanding of MRA process and training issues within Illinois-based corporations. Data were collected from three distinct perspectives within each organization. Three data collection techniques were employed: face-to-face interviews, telephone …
-
Rater Implicit Gender Bias in a Multi-Center Simulation-Based Resident Milestone Assessment
… scoring bias based on gender concordance between rater and resident by comparing global assessments to the checklist score on each case. Hierarchical linear modeling accounted for clustering by residency program, site, and rater. Results: Checklist and global assessments (GA) scores were strongly …
-
Factors Affecting the Efficacy of Rater Training: Information Type and Mode of Presentation
… have directed their efforts towards training raters to evaluate performance more accurately. The purpose of the present study was to examine two factors that may affect the efficacy of rater training for improving the accuracy of performance ratings. One factor was the type of information that …
-
Temporal stability of rating behaviors: effects of differences in rater and ratee samples
… and secondly, for utilizing the same sample of raters when evaluating the stability of their scale reliabilities. Kane and Bernardin hypothesized that rater-specific illusory halo contributed to producing the stably high reliabilities that Latham et al. reported. This study was a test of that …
Page 1 of 21