Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 46 for “"rater agreement"”.
-
Assessing Inter-rater Agreement for Compositional Data
… novel methodology for assessing inter-rate agreement based on compositional data. This is needed because existing agreement measures either involve converting the vector to a univariate value, thereby losing information, or they fail to account for the sum-to-one restriction. We propose a …
-
The Relationship Between Rater Agreement, Behavioral Observability and Overall Impressions
… two item characteristics believed to influence rater agreement: observability and difficulty. The first goal of this study was to replicate the findings of Roch, Paquin and Littlejohn (2009), which found that rater agreement was negatively related to item observability (Hypothesis 1) and rating …
-
The Effects of Rater Training on the Relationship between Item Observability and Rater Agreement
… They investigated the relationship between rater agreement and the observability of items on a rating form. The current study found similar results in that, as items became less observable, interrater agreement increased. The purpose of this study was to introduce frame of reference training …
-
Further Evaluating the Effect of Behavioral Observability and Overall Impressions on Rater Agreement: A Replication Study
… observability and overall impressions on rater agreement, as recently examined by Roch, Paquin, & Littlejohn (2009) and Scott (2012). Results from the study performed by Roch et al. indicated that raters are more likely to agree when items are either more difficult to rate or less …
-
Interdisciplinary Comparative Evaluation of Pediatric Oral Airway Assessment Using Mallampati and Brodsky
Purpose: To evaluate agreement in pediatric airway assessments using Brodsky classification and Mallampati scales among pediatric dental residents, dental faculty, and anesthesiologists. Methods: This cross-sectional study included 10 first-year and 12 second-year pediatric dental residents, 15 …
-
THE RACIAL SOCIALIZATION OF BELIEFS AND ATTITUDES REGARDING SKIN TONE IN A COHORT OF OLDER AFRICAN AMERICAN WOMEN: A PHENOMENOLOGICAL STUDY
… An additional verification method (i.e., inter-rater reliability Kappa coefficient) was employed to assist in cross-validation of the study's findings (Landis & Koch, 1977). Kappa coefficients demonstrated that of the twenty-three subthemes, which emerged from the analysis, 7 had slight …
-
An online system for entering and annotating non-native Mandarin Chinese speech for language teaching
… utterances and observe fair to moderate inter-rater agreement scores. In addition to giving us a benchmark for inter-rater agreement, this also demonstrates the feasibility of having remote graders annotate sets of utterances. Finally, we extend our work to Chinese language instruction by …
-
Alternative Assessment in Tennis
… collected, coded, and then scored by trained raters. Raters were trained extensively in order to retain reliability. Three types of reliability methods (intra-rater, inter-rater, and subject) were used to determine the reliability of the assessment tasks, and they were analyzed by calculating …
-
Consistency of judgments of a professional panel and wearers regarding characteristics of selected sleepwear fabrics
… gowns were also evaluated by four professional raters on the above factors. An overall rating was also determined for these judges. Weighted kappa and z scores were used to measure agreement between judge pairs and between each judge and the wearers for the eight factors. The researcher accepted …
-
The identification and function of English prosodic features
… using prosodic annotation. We compared inter-rater agreement for two current prosodic annotation schemes, ToBI (Silverman, et al., 1992) and RaP (Dilley & Brown, 2005) which provide guidelines for the identification of English prosodic features. The studies described here survey inter-rater …
-
The agreement, reliability and accuracy of a subjective-rating for technique measurement in rugby union after video-based training
… undergoing videobased training would improve the agreement, reliability, and accuracy of raters using a subjective-rating measure to assess contact technique in rugby union, and 2) to establish if a self-selected viewing pace resulted in improved agreement, reliability, and criterion-validity over …
-
An Exploration of Online Consumer Ratings Systems
… 2, we show that consumers prefer products with rater disagreement (e.g., one rater gives 1 star and one rater gives 5 stars) over products with rater agreement (e.g., both raters give 3 stars) when there are only a few ratings. We show that this effect flips when there are many ratings and …
-
Preliminary Validation of a Native American Food Safety Knowledge Survey
… expert data was analyzed using inter-rater agreement, content validity index, and factorial validity index. A culturally appropriate, content valid, and reliable survey for Native American primary food handlers with children under the age of ten was created to collect national data on …
-
Disentangling fluency, comprehensibility and coherence: Toward a better understanding of oral proficiency profiles
… in WAVEPAD SOUND EDITOR. Five trained OEPT raters rated the original and edited speeches. Statistical analyses addressed three research questions: 1) do fluency, comprehensibility and coherence ratings significantly change after the disfluency manipulation; 2) do correlations between …
-
Affective computing and crowdsourcing : subjective labels and sequential effects
… an interactive platform. Comparing annotator agreement reveals that inter-rater agreement is lower for female faces and faces displaying negative emotion. Shuffling examples such that all annotators see a different randomized order further decreases annotator agreement, yet our experiments …
-
Utility of EEG in the diagnosis of Efavirenz neurotoxity in HIV positive patients at a South African tertiary hospital
… analyses including measurement of inter rater agreement, reliability, and correlation. A p-value of less than 0.05 was considered for statistical significance. Results: Patients with EFV neurotoxicity had characteristic sEEG findings of diffuse, monomorphic, bisynchronous, high voltage, …
-
Diagnostischer Wert der 64-Zeilen-Mehrschichtspiral-Computertomographie des Herzens bei symptomatischen Patienten
… and negative predictive values and inter-rater agreement were calculated.RESULTS: 94.3% of all coronary segments were assessable by MDCT angiography. Patient-based (segment-based) analysis revealed a sensitivity of 97.7% (86.6%), specificity of 50.0% (95.7%) positive predictive value of …
-
DYSPHAGIA TREATMENT PLANNING: ASSESSING CLINICIANS’ TREATMENT RECOMMENDATIONS BASED ON MODIFIED BARIUM SWALLOW STUDY REPORTS
… of participant demographics and 2) inter-rater agreement for treatment target and strategy recommendations made following review of MBS reports in low and high pathophysiology conditions, 3) chi-square analyses comparing target and strategy recommendations according to report stimulus, and …
-
DYSPHAGIA TREATMENT PLANNING: ASSESSING CLINICIANS’ TREATMENT RECOMMENDATIONS BASED ON MODIFIED BARIUM SWALLOW STUDY REPORTS
… of participant demographics and 2) inter-rater agreement for treatment target and strategy recommendations made following review of MBS reports in low and high pathophysiology conditions, 3) chi-square analyses comparing target and strategy recommendations according to report stimulus, and …
Page 1 of 3