Single-case designs (SCDs) are often used to examine the impact of an intervention over brief periods of time (Kratochwill & Stoiber, 2002; Segool, Brinkman, & Carlson, 2007). The majority of SCDs are inspected using visual analysis (Kromrey & Foster-Johnson, 1996; Morgan & Morgan, 2009). Although the single-case literature suggests that visual analyses have merit (Brossart, Parker, Olson, & Mahadevan, 2006; Kratochwill & Brody, 1978) there are concerns regarding the reliability of the procedure (Shadish et al., 2009). Recent advances in hierarchical linear models (HLM) allow for statistical analyses of treatment effects (Nagler, Rindskopf, & Shadish, 2008), thus making it possible to compare and contrast results from HLM and visual analyses to ascertain if the different methods yield consistent conclusions. This work performed a series of sensitivity analyses while also exploring ways in which HLM can be used to examine new and different questions when dealing with published single-case data.
The work applied analyses to ABAB designs only. In addition to reporting the results of visual analysis performed by the original authors, it also utilized recently published guidelines by the What Works Clearinghouse (WWC) that standardize visual analysis processes (Kratochwill, Hitchcock, Horner, Levin, Odom, Rindskopf, & Shadish, 2010). The comparisons presented here are based on nine, single-case studies that meet WWC design standards. All studies examined intervention impacts on behavioral outcomes. UnGraph digitizing software was used to quantify results from ABAB graphs and HLM and STATA software were used to perform statistical analyses. In addition to applying a statistical procedure to check conclusions about treatment effects based on visual analyses, HLM was used to examine between-subject variation of performance on outcome measures. In order to statistically describe treatment impacts, effect size estimates were calculated using four methods: (a) the percentage of nonoverlapping data (Morgan & Morgan, 2009), (b) the Standardized Mean Difference (Busk & Serlin, 1992), (c) the improvement rate difference and (d) R2, in order to assess the proportion variance in the dependent variable that can be explained by treatment exposure.
","abstract_html":"<p>Single-case designs (SCDs) are often used to examine the impact of an intervention over brief periods of time (Kratochwill & Stoiber, 2002; Segool, Brinkman, & Carlson, 2007). The majority of SCDs are inspected using visual analysis (Kromrey & Foster-Johnson, 1996; Morgan & Morgan, 2009). Although the single-case literature suggests that visual analyses have merit (Brossart, Parker, Olson, & Mahadevan, 2006; Kratochwill & Brody, 1978) there are concerns regarding the reliability of the procedure (Shadish et al., 2009). Recent advances in hierarchical linear models (HLM) allow for statistical analyses of treatment effects (Nagler, Rindskopf, & Shadish, 2008), thus making it possible to compare and contrast results from HLM and visual analyses to ascertain if the different methods yield consistent conclusions. This work performed a series of sensitivity analyses while also exploring ways in which HLM can be used to examine new and different questions when dealing with published single-case data.</p><p>The work applied analyses to ABAB designs only. In addition to reporting the results of visual analysis performed by the original authors, it also utilized recently published guidelines by the What Works Clearinghouse (WWC) that standardize visual analysis processes (Kratochwill, Hitchcock, Horner, Levin, Odom, Rindskopf, & Shadish, 2010). The comparisons presented here are based on nine, single-case studies that meet WWC design standards. All studies examined intervention impacts on behavioral outcomes. UnGraph digitizing software was used to quantify results from ABAB graphs and HLM and STATA software were used to perform statistical analyses. In addition to applying a statistical procedure to check conclusions about treatment effects based on visual analyses, HLM was used to examine between-subject variation of performance on outcome measures. In order to statistically describe treatment impacts, effect size estimates were calculated using four methods: (a) the percentage of nonoverlapping data (Morgan & Morgan, 2009), (b) the Standardized Mean Difference (Busk & Serlin, 1992), (c) the improvement rate difference and (d) R2, in order to assess the proportion variance in the dependent variable that can be explained by treatment exposure.</p>","abstract_has_math":false,"creators":["Crumbacher, Christine A."],"institution":"Ohio University","degree_name":"Doctor of Philosophy (PhD)","degree_level":"doctoral","degree_discipline":"Educational Research and Evaluation (Education)","degree_department":null,"school":null,"contributors":["Hitchcock, John"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2013,"date_issued":"2013-06-10","date_published":"2013-06-10","updated_at":"2026-07-24T03:36:08Z","subjects":["Educational Evaluation","Educational Tests and Measurements","HLM","single-case design","effect sizes"],"languages":["English"],"rights":["unrestricted","This thesis or dissertation is protected by copyright: all rights reserved. It may not be copied or redistributed beyond the terms of applicable copyright laws."],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://rave.ohiolink.edu/etdc/view?acc_num=ohiou1357670024","outbound_label":"Repository record","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Hitchcock, John"]},{"key":"dc:creator","label":"Author","values":["Crumbacher, Christine A."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2013-06-10"]},{"key":"dc:publisher","label":"Institution","values":["Ohio University / OhioLINK"]},{"key":"dc:type","label":"Dc Type","values":["Electronic Thesis or Dissertation"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Educational Research and Evaluation (Education)"]},{"key":"thesis:degree_level","label":"Degree Level","values":["doctoral"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy (PhD)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Ohio University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Educational Evaluation","Educational Tests and Measurements","HLM","single-case design","effect sizes"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["English"]},{"key":"dc:rights","label":"Dc Rights","values":["unrestricted","This thesis or dissertation is protected by copyright: all rights reserved. It may not be copied or redistributed beyond the terms of applicable copyright laws."]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://rave.ohiolink.edu/etdc/view?acc_num=ohiou1357670024"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Single-case designs (SCDs) are often used to examine the impact of an intervention over brief periods of time (Kratochwill & Stoiber, 2002; Segool, Brinkman, & Carlson, 2007). The majority of SCDs are inspected using visual analysis (Kromrey & Foster-Johnson, 1996; Morgan & Morgan, 2009). Although the single-case literature suggests that visual analyses have merit (Brossart, Parker, Olson, & Mahadevan, 2006; Kratochwill & Brody, 1978) there are concerns regarding the reliability of the procedure (Shadish et al., 2009). Recent advances in hierarchical linear models (HLM) allow for statistical analyses of treatment effects (Nagler, Rindskopf, & Shadish, 2008), thus making it possible to compare and contrast results from HLM and visual analyses to ascertain if the different methods yield consistent conclusions. This work performed a series of sensitivity analyses while also exploring ways in which HLM can be used to examine new and different questions when dealing with published single-case data.
The work applied analyses to ABAB designs only. In addition to reporting the results of visual analysis performed by the original authors, it also utilized recently published guidelines by the What Works Clearinghouse (WWC) that standardize visual analysis processes (Kratochwill, Hitchcock, Horner, Levin, Odom, Rindskopf, & Shadish, 2010). The comparisons presented here are based on nine, single-case studies that meet WWC design standards. All studies examined intervention impacts on behavioral outcomes. UnGraph digitizing software was used to quantify results from ABAB graphs and HLM and STATA software were used to perform statistical analyses. In addition to applying a statistical procedure to check conclusions about treatment effects based on visual analyses, HLM was used to examine between-subject variation of performance on outcome measures. In order to statistically describe treatment impacts, effect size estimates were calculated using four methods: (a) the percentage of nonoverlapping data (Morgan & Morgan, 2009), (b) the Standardized Mean Difference (Busk & Serlin, 1992), (c) the improvement rate difference and (d) R2, in order to assess the proportion variance in the dependent variable that can be explained by treatment exposure.
"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf","p.331","2.68 MB"]},{"key":"dc:title","label":"Title","values":["Examining Treatment Effects for Single-Case ABAB Designs through Sensitivity Analyses"]}]}],"canonical_facts":{"dc:contributor":["Hitchcock, John"],"dc:creator":["Crumbacher, Christine A."],"dc:date":["2013-06-10"],"dc:description":["Single-case designs (SCDs) are often used to examine the impact of an intervention over brief periods of time (Kratochwill & Stoiber, 2002; Segool, Brinkman, & Carlson, 2007). The majority of SCDs are inspected using visual analysis (Kromrey & Foster-Johnson, 1996; Morgan & Morgan, 2009). Although the single-case literature suggests that visual analyses have merit (Brossart, Parker, Olson, & Mahadevan, 2006; Kratochwill & Brody, 1978) there are concerns regarding the reliability of the procedure (Shadish et al., 2009). Recent advances in hierarchical linear models (HLM) allow for statistical analyses of treatment effects (Nagler, Rindskopf, & Shadish, 2008), thus making it possible to compare and contrast results from HLM and visual analyses to ascertain if the different methods yield consistent conclusions. This work performed a series of sensitivity analyses while also exploring ways in which HLM can be used to examine new and different questions when dealing with published single-case data.
The work applied analyses to ABAB designs only. In addition to reporting the results of visual analysis performed by the original authors, it also utilized recently published guidelines by the What Works Clearinghouse (WWC) that standardize visual analysis processes (Kratochwill, Hitchcock, Horner, Levin, Odom, Rindskopf, & Shadish, 2010). The comparisons presented here are based on nine, single-case studies that meet WWC design standards. All studies examined intervention impacts on behavioral outcomes. UnGraph digitizing software was used to quantify results from ABAB graphs and HLM and STATA software were used to perform statistical analyses. In addition to applying a statistical procedure to check conclusions about treatment effects based on visual analyses, HLM was used to examine between-subject variation of performance on outcome measures. In order to statistically describe treatment impacts, effect size estimates were calculated using four methods: (a) the percentage of nonoverlapping data (Morgan & Morgan, 2009), (b) the Standardized Mean Difference (Busk & Serlin, 1992), (c) the improvement rate difference and (d) R2, in order to assess the proportion variance in the dependent variable that can be explained by treatment exposure.
"],"dc:format":["application/pdf","p.331","2.68 MB"],"dc:identifier":["http://rave.ohiolink.edu/etdc/view?acc_num=ohiou1357670024"],"dc:language":["English"],"dc:publisher":["Ohio University / OhioLINK"],"dc:rights":["unrestricted","This thesis or dissertation is protected by copyright: all rights reserved. It may not be copied or redistributed beyond the terms of applicable copyright laws."],"dc:subject":["Educational Evaluation","Educational Tests and Measurements","HLM","single-case design","effect sizes"],"dc:title":["Examining Treatment Effects for Single-Case ABAB Designs through Sensitivity Analyses"],"dc:type":["Electronic Thesis or Dissertation"],"thesis:degree_discipline":["Educational Research and Evaluation (Education)"],"thesis:degree_level":["doctoral"],"thesis:degree_name":["Doctor of Philosophy (PhD)"],"thesis:institution_name":["Ohio University"]},"updated_at":"2026-07-24T03:36:08Z"}