Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 32 for “"Interrater agreement"”.
-
Model-Based Measures of Interrater Agreement
… used for the assessment of the strength of agreement among raters, each classifying subjects as e.g. diseased or not. Nelson and Edwards (2008) propose a generalized linear mixed model for the agreement process, showing that Cohen's κ can seriously underestimate agreement and proposing …
-
Model-Based Measures Of Interrater Agreement
<p>Alzheimer's disease (AD) is the most common type of dementia in the elderly. Currently, there is no preventive or curative treatment available for this disease and it has become the sixth leading cause of death for people of all ages and the fifth leading cause of death in people age 65 and …
-
Does Item Exposure Impact the Relationship Between Specificity and Interrater Agreement
… became more vague), there was an increase in interrater agreement, a positive correlation between item difficulty and interater agreement, and a positive correlation between performance and interrater agreement. The present study also examined the impact of item exposure as it related to these …
-
Interrater Agreement of Incumbent Job Specification Importance Ratings: Rater, Occupation, and Item Effects
… based on input from subject matter experts, interrater agreement is a necessary condition for their validity. The purpose of the present research is to examine the validity of job specifications by assessing the level of agreement in ratings and the effects of occupational tenure, …
-
Multiple-respondent anecdotal assessments for behavior disorders; An analysis of interrater agreement and correspondence with treatment outcomes.
… goal of this study was to evaluate the overall agreement between multiple respondents on the primary function of aberrant behavior using the Motivation Assessment Scale (MAS) and the Functional Analysis Screening Tool (FAST) and, if agreement was obtained, to assess the effectiveness of …
-
Multiple-Respondent Anecdotal Assessments for Behavior Disorders: An Analysis of Interrater Agreement and Correspondence With Functional Analysis Outcomes
An analysis of interrater agreement across multiple respondents on anecdotal assessments and correspondence between functional analysis outcomes was completed. Experiment I evaluated overall agreement among multiple respondents (direct-care staff) on the hypothesized function of each residents (28 …
-
Multiple-respondent anecdotal assessments for behavior disorders: An analysis of interrater agreement and correspondence with a functional analysis and treatment outcomes.
An analysis of interrater agreement across multiple respondents on two anecdotal assessments, the Motivation Assessment Scale (MAS) and the Functional Analysis Screening Tool (FAST), was completed for an individual who displayed aggressive behavior. The results of the assessments indicated high …
-
Holistic versus Decomposed Rating Scales: Which causes higher levels of cognitive load?
… Stability of ratings across conditions and interrater agreement were used as dependent measures. Results indicated that the holistic items (r=.74) had higher levels of stability across cognitive load conditions than did the decomposed items (r=.66). The levels of interrater agreement were …
-
O*NET or NOT? Adequacy of the O*NET system's rater and format choices
… to show significant leniency, elevation error or interrater agreement improvement over laypeople ratings; only the overall-error measure showed a significant improvement for incumbent raters. Hypothesis 2 was not supported, failing to show that the GRS format had any improvement on leniency, …
-
The Effects of Rater Training on the Relationship between Item Observability and Rater Agreement
… They investigated the relationship between rater agreement and the observability of items on a rating form. The current study found similar results in that, as items became less observable, interrater agreement increased. The purpose of this study was to introduce frame of reference training as an …
-
Acute cognitive dysfunction, short and long-term outcomes and the impact of medical follow-up following hospitalisation for general medical illness in Cape Town, South Africa
… of factors influencing RACY performance, and interrater agreement were obtained. Reference delirium testing was performed by neuropsychologists, using the Confusion Assessment Method. Results. A total of 609 medical in-patients were included. The prevalence of delirium was 16.9% (95% CI: …
-
An Evaulation of the Criterion Measures in a Leadership Assessment Center
… Rating Scales (BARS). The second study examined interrater agreement for criterion ratings in a leadership assessment center. Results from Study 1 demonstrated that the shortcut method for developing BARS resulted in scales with different properties from those developed with the traditional …
-
The Content Validation of an Employment Selection Process for Vehicle Mechanics
… that the SME ratings exhibited acceptable interrater agreement and that all competencies were important. Therefore, the interview based on these ratings has acceptable content validity. Recommendations were provided to the organization regarding possible alternatives and the impact that the …
-
Electroencephalography for neurological prognostication after cardiac arrest
… been limited by varying classification systems, interrater variability and influence of sedation. Methods: In the “coma project” (2004-2008) consecutive patients at the general ICU in Lund were monitored with simplified cEEG from arrival until 120 hours after CA. Pre-defined cEEG patterns at …
-
Improvements on Manual Pavement Distress Data Collection to Conform to State and Federal Requirements
… tested. The three levels of testing include interrater agreement and interrater reliability across the 'old' protocol, the 'new' protocol, and actual field measurements to judge the accuracy of both old and new methods. By doing this, the accuracy and validity of the pavement distress surveys …
-
A study of the influence of ecological factors and personal teacher characteristics on the implementation of an innovation
… of .79 and better were established for interrater agreement and implementation scores (student and teacher report). A stepwise regression analysis was conducted using the implementation scores and percentage scores for specific tasks as the dependent variables. The broad categories of …
-
A Taxonomy of Effective Leader Behaviors in the Construction Industry
… a deductive content analysis and intercoder agreement was found to be acceptable, and (2) 39 construction managers rated the importance and relevance of each of the 36 taxonomy categories along with 3 categories of construction manager behaviors. Overall interrater agreement was acceptable, …
-
The Effects of Cognitive General Imagery Use on Tactical Decision-Making in Curling
… survey. Twenty-one scenarios showed acceptable interrater agreement for a correct shot option. Pilot testing of the original version of the CSAT indicated that modifications were needed to incorporate strategy style. Thus, Phase 2 was conducted to have 93 updated scenarios assessed by three …
-
The Development of a Model for Behavioral Observation Performance of Instructional Personnel
… and bias and yield high reliability and agreement among raters. Procedure. There were two urban and one rural school districts that participated in field testing the model for evaluating instructional personnel. After the instruments were developed, each district field tested the model by …
Page 1 of 2