{"id":{"repo_id":"brock","oai_identifier":"oai:brocku.scholaris.ca:10464/15160"},"canonical_url":"https://search.dev.ndltd.org/etd/brock/oai:brocku.scholaris.ca:10464/15160","repository":{"repo_id":"brock","name":"Brock University","base_url":"https://brocku.scholaris.ca/server/oai/request"},"display":{"title":"Exploring the Reliability of an Objective Severity Tool to Classify Severe Problem Behaviour","abstract":"The term ‘severe’ is a common descriptor for problem behaviour in research and practice. However, it is often applied inconsistently, and at times based on ill-defined or arbitrary criteria. Existing problem behaviour measurement tools often rely solely on caregiver recall (e.g., interviewing primary caregivers). This study explores the reliability of the first iteration of a severity tool employing direct measurement strategies (e.g., response rate, injury severity as evidenced by permanent product) to classify an individual’s problem behaviour severity. Nine Board Certified Behavior Analyst (BCBA) raters were recruited, five novice raters and four expert raters. They each experienced two conditions. In the first condition, raters classified the severity of 20 case scenarios without access to the tool. In the second condition, raters classified the severity of 20 novel scenarios after completing the tool for each case. All items of the tool (n=26) had good internal consistency (∝=.831). Intraclass correlations showed a meaningful increase in reliability for both groups when they had access to the tool (novice r=0.860, expert r=0.912) compared to when they did not have access to the tool to rate case severity (novice r=0.781, expert r=0.803). Most raters either strongly agreed or agreed that the severity tool had good applicability across research and clinical settings. This suggests that inconsistencies that may exist in the classification of severe problem behaviour could be mitigated with the proposed tool.","abstract_html":"The term ‘severe’ is a common descriptor for problem behaviour in research and practice. However, it is often applied inconsistently, and at times based on ill-defined or arbitrary criteria. Existing problem behaviour measurement tools often rely solely on caregiver recall (e.g., interviewing primary caregivers). This study explores the reliability of the first iteration of a severity tool employing direct measurement strategies (e.g., response rate, injury severity as evidenced by permanent product) to classify an individual’s problem behaviour severity. Nine Board Certified Behavior Analyst (BCBA) raters were recruited, five novice raters and four expert raters. They each experienced two conditions. In the first condition, raters classified the severity of 20 case scenarios without access to the tool. In the second condition, raters classified the severity of 20 novel scenarios after completing the tool for each case. All items of the tool (n=26) had good internal consistency (∝=.831). Intraclass correlations showed a meaningful increase in reliability for both groups when they had access to the tool (novice r=0.860, expert r=0.912) compared to when they did not have access to the tool to rate case severity (novice r=0.781, expert r=0.803). Most raters either strongly agreed or agreed that the severity tool had good applicability across research and clinical settings. This suggests that inconsistencies that may exist in the classification of severe problem behaviour could be mitigated with the proposed tool.","abstract_has_math":false,"creators":["Morgan, Marie-Chanel"],"institution":"Brock University","degree_name":"M.A. Applied Disability Studies","degree_level":"Masters","degree_discipline":"Faculty of Applied Health Sciences","degree_department":"Applied Health Sciences Program","school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-09-16T15:45:18Z","date_published":"2021-09-16T15:45:18Z","updated_at":"2026-07-24T01:23:16Z","subjects":["severe problem behaviour","intellectual and developmental disability","reliability","severity scale","research tool"],"languages":["eng"],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/10464/15160","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.department","label":"Department","values":["Applied Health Sciences Program"]},{"key":"dc:creator","label":"Author","values":["Morgan, Marie-Chanel"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2021-09-16T15:45:18Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2021-09-16T15:45:18Z"]},{"key":"dc:date.issued","label":"Date","values":["2021-09-16T15:45:18Z"]},{"key":"dc:type","label":"Dc Type","values":["Electronic Thesis or Dissertation"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Faculty of Applied Health Sciences"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.A. Applied Disability Studies"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Brock University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["severe problem behaviour","intellectual and developmental disability","reliability","severity scale","research tool"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["eng"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/10464/15160"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["The term ‘severe’ is a common descriptor for problem behaviour in research and practice. However, it is often applied inconsistently, and at times based on ill-defined or arbitrary criteria. Existing problem behaviour measurement tools often rely solely on caregiver recall (e.g., interviewing primary caregivers). This study explores the reliability of the first iteration of a severity tool employing direct measurement strategies (e.g., response rate, injury severity as evidenced by permanent product) to classify an individual’s problem behaviour severity. Nine Board Certified Behavior Analyst (BCBA) raters were recruited, five novice raters and four expert raters. They each experienced two conditions. In the first condition, raters classified the severity of 20 case scenarios without access to the tool. In the second condition, raters classified the severity of 20 novel scenarios after completing the tool for each case. All items of the tool (n=26) had good internal consistency (∝=.831). Intraclass correlations showed a meaningful increase in reliability for both groups when they had access to the tool (novice r=0.860, expert r=0.912) compared to when they did not have access to the tool to rate case severity (novice r=0.781, expert r=0.803). Most raters either strongly agreed or agreed that the severity tool had good applicability across research and clinical settings. This suggests that inconsistencies that may exist in the classification of severe problem behaviour could be mitigated with the proposed tool."]},{"key":"dc:title","label":"Title","values":["Exploring the Reliability of an Objective Severity Tool to Classify Severe Problem Behaviour"]}]}],"canonical_facts":{"dc:contributor.department":["Applied Health Sciences Program"],"dc:creator":["Morgan, Marie-Chanel"],"dc:date.accessioned":["2021-09-16T15:45:18Z"],"dc:date.available":["2021-09-16T15:45:18Z"],"dc:date.issued":["2021-09-16T15:45:18Z"],"dc:description.abstract":["The term ‘severe’ is a common descriptor for problem behaviour in research and practice. However, it is often applied inconsistently, and at times based on ill-defined or arbitrary criteria. Existing problem behaviour measurement tools often rely solely on caregiver recall (e.g., interviewing primary caregivers). This study explores the reliability of the first iteration of a severity tool employing direct measurement strategies (e.g., response rate, injury severity as evidenced by permanent product) to classify an individual’s problem behaviour severity. Nine Board Certified Behavior Analyst (BCBA) raters were recruited, five novice raters and four expert raters. They each experienced two conditions. In the first condition, raters classified the severity of 20 case scenarios without access to the tool. In the second condition, raters classified the severity of 20 novel scenarios after completing the tool for each case. All items of the tool (n=26) had good internal consistency (∝=.831). Intraclass correlations showed a meaningful increase in reliability for both groups when they had access to the tool (novice r=0.860, expert r=0.912) compared to when they did not have access to the tool to rate case severity (novice r=0.781, expert r=0.803). Most raters either strongly agreed or agreed that the severity tool had good applicability across research and clinical settings. This suggests that inconsistencies that may exist in the classification of severe problem behaviour could be mitigated with the proposed tool."],"dc:identifier.uri":["http://hdl.handle.net/10464/15160"],"dc:language.iso":["eng"],"dc:subject":["severe problem behaviour","intellectual and developmental disability","reliability","severity scale","research tool"],"dc:title":["Exploring the Reliability of an Objective Severity Tool to Classify Severe Problem Behaviour"],"dc:type":["Electronic Thesis or Dissertation"],"thesis:degree_discipline":["Faculty of Applied Health Sciences"],"thesis:degree_level":["Masters"],"thesis:degree_name":["M.A. Applied Disability Studies"],"thesis:institution_name":["Brock University"]},"updated_at":"2026-07-24T01:23:16Z"}