{"id":{"repo_id":"ku","oai_identifier":"oai:kuscholarworks.ku.edu:1808/39148"},"canonical_url":"https://search.dev.ndltd.org/etd/ku/oai:kuscholarworks.ku.edu:1808/39148","repository":{"repo_id":"ku","name":"University of Kansas","base_url":"https://kuscholarworks.ku.edu/server/oai/request"},"display":{"title":"Validating and Refining a Locally Developed Universal Screening System in High School Mathematics","abstract":"Early identification of at-risk students is a critical element of Response to Intervention (RTI) but there are few validated universal screeners for high school mathematics. This study evaluated the effectiveness of the screening system currently in use at one urban Texas public high school and compared its effectiveness to alternate screening systems that used the same resources but with different cut scores. The goal for the screener was to accurately identify students who would Meet grade level proficiency on the state of Texas’ Algebra 1 End of Course exam. The current screening system used a multi-gating procedure that included the performance levels on the past state achievement test and on a beginning of year computer adaptive screening exam. Alternate systems were investigated using the assessments individually by exploring three different cut scores to determine if any were more effective. The study used the publisher’s cut score, the optimal cut score, and the cut score with a sensitivity of .94 (the same as the current system). The evaluation compared the overall accuracy, sensitivity, specificity, positive post-test probabilities, and negative post-test probabilities. No alternate system improved the effectiveness of the current system; however, none of the evaluated screening systems were able to adequately distinguish between at-risk and non-at-risk students. The threshold model is an identification model that excludes students with a low probability of failure from intervention, includes students with a high probability of failure in intervention, and requires additional information for those with no clear risk category. The use of a threshold model might result in a large number of unclassified students but could help identify those with the highest and lowest risk of failure. This study determined that a threshold model might support the development of a screening system in a school using an assessment with poor classification ability.","abstract_html":"Early identification of at-risk students is a critical element of Response to Intervention (RTI) but there are few validated universal screeners for high school mathematics. This study evaluated the effectiveness of the screening system currently in use at one urban Texas public high school and compared its effectiveness to alternate screening systems that used the same resources but with different cut scores. The goal for the screener was to accurately identify students who would Meet grade level proficiency on the state of Texas’ Algebra 1 End of Course exam. The current screening system used a multi-gating procedure that included the performance levels on the past state achievement test and on a beginning of year computer adaptive screening exam. Alternate systems were investigated using the assessments individually by exploring three different cut scores to determine if any were more effective. The study used the publisher’s cut score, the optimal cut score, and the cut score with a sensitivity of .94 (the same as the current system). The evaluation compared the overall accuracy, sensitivity, specificity, positive post-test probabilities, and negative post-test probabilities. No alternate system improved the effectiveness of the current system; however, none of the evaluated screening systems were able to adequately distinguish between at-risk and non-at-risk students. The threshold model is an identification model that excludes students with a low probability of failure from intervention, includes students with a high probability of failure in intervention, and requires additional information for those with no clear risk category. The use of a threshold model might result in a large number of unclassified students but could help identify those with the highest and lowest risk of failure. This study determined that a threshold model might support the development of a screening system in a school using an assessment with poor classification ability.","abstract_has_math":false,"creators":["Stevens, Sarah E"],"institution":"University of Kansas","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":["Gay, A. Susan"],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-01-01","date_published":"2021-01-01","updated_at":"2026-07-24T02:46:29Z","subjects":["Educational evaluation","Mathematics education","Secondary education","cut score","evaluation","RTI","secondary mathematics","threshold model","universal screener"],"languages":["en"],"rights":["Copyright held by the author."],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["http://dissertations.umi.com/ku:17719"],"render_values":[{"text":"http://dissertations.umi.com/ku:17719","href":"http://dissertations.umi.com/ku:17719","code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/1808/39148","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Gay, A. Susan"]},{"key":"dc:creator","label":"Author","values":["Stevens, Sarah E"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2026-04-25T04:19:02Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2026-04-25T04:19:02Z"]},{"key":"dc:date.issued","label":"Date","values":["2021-01-01"]},{"key":"dc:publisher","label":"Institution","values":["University of Kansas"]},{"key":"dc:type","label":"Dc Type","values":["Dissertation"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Educational evaluation","Mathematics education","Secondary education","cut score","evaluation","RTI","secondary mathematics","threshold model","universal screener"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright held by the author."]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["http://dissertations.umi.com/ku:17719"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1808/39148"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Early identification of at-risk students is a critical element of Response to Intervention (RTI) but there are few validated universal screeners for high school mathematics. This study evaluated the effectiveness of the screening system currently in use at one urban Texas public high school and compared its effectiveness to alternate screening systems that used the same resources but with different cut scores. The goal for the screener was to accurately identify students who would Meet grade level proficiency on the state of Texas’ Algebra 1 End of Course exam. The current screening system used a multi-gating procedure that included the performance levels on the past state achievement test and on a beginning of year computer adaptive screening exam. Alternate systems were investigated using the assessments individually by exploring three different cut scores to determine if any were more effective. The study used the publisher’s cut score, the optimal cut score, and the cut score with a sensitivity of .94 (the same as the current system). The evaluation compared the overall accuracy, sensitivity, specificity, positive post-test probabilities, and negative post-test probabilities. No alternate system improved the effectiveness of the current system; however, none of the evaluated screening systems were able to adequately distinguish between at-risk and non-at-risk students. The threshold model is an identification model that excludes students with a low probability of failure from intervention, includes students with a high probability of failure in intervention, and requires additional information for those with no clear risk category. The use of a threshold model might result in a large number of unclassified students but could help identify those with the highest and lowest risk of failure. This study determined that a threshold model might support the development of a screening system in a school using an assessment with poor classification ability."]},{"key":"dc:title","label":"Title","values":["Validating and Refining a Locally Developed Universal Screening System in High School Mathematics"]}]}],"canonical_facts":{"dc:contributor.advisor":["Gay, A. Susan"],"dc:creator":["Stevens, Sarah E"],"dc:date.accessioned":["2026-04-25T04:19:02Z"],"dc:date.available":["2026-04-25T04:19:02Z"],"dc:date.issued":["2021-01-01"],"dc:description.abstract":["Early identification of at-risk students is a critical element of Response to Intervention (RTI) but there are few validated universal screeners for high school mathematics. This study evaluated the effectiveness of the screening system currently in use at one urban Texas public high school and compared its effectiveness to alternate screening systems that used the same resources but with different cut scores. The goal for the screener was to accurately identify students who would Meet grade level proficiency on the state of Texas’ Algebra 1 End of Course exam. The current screening system used a multi-gating procedure that included the performance levels on the past state achievement test and on a beginning of year computer adaptive screening exam. Alternate systems were investigated using the assessments individually by exploring three different cut scores to determine if any were more effective. The study used the publisher’s cut score, the optimal cut score, and the cut score with a sensitivity of .94 (the same as the current system). The evaluation compared the overall accuracy, sensitivity, specificity, positive post-test probabilities, and negative post-test probabilities. No alternate system improved the effectiveness of the current system; however, none of the evaluated screening systems were able to adequately distinguish between at-risk and non-at-risk students. The threshold model is an identification model that excludes students with a low probability of failure from intervention, includes students with a high probability of failure in intervention, and requires additional information for those with no clear risk category. The use of a threshold model might result in a large number of unclassified students but could help identify those with the highest and lowest risk of failure. This study determined that a threshold model might support the development of a screening system in a school using an assessment with poor classification ability."],"dc:identifier.other":["http://dissertations.umi.com/ku:17719"],"dc:identifier.uri":["https://hdl.handle.net/1808/39148"],"dc:language.iso":["en"],"dc:publisher":["University of Kansas"],"dc:rights":["Copyright held by the author."],"dc:subject":["Educational evaluation","Mathematics education","Secondary education","cut score","evaluation","RTI","secondary mathematics","threshold model","universal screener"],"dc:title":["Validating and Refining a Locally Developed Universal Screening System in High School Mathematics"],"dc:type":["Dissertation"]},"updated_at":"2026-07-24T02:46:29Z"}