{"id":{"repo_id":"toronto-retro","oai_identifier":"oai:utoronto.scholaris.ca:1807/19168"},"canonical_url":"https://search.dev.ndltd.org/etd/toronto-retro/oai:utoronto.scholaris.ca:1807/19168","repository":{"repo_id":"toronto-retro","name":"University of Toronto","base_url":"https://utoronto.scholaris.ca/server/oai/request"},"display":{"title":"Measuring Change in Jurisdiction Achievement over Time: Equating Issues in Current International Assessment Programs","abstract":"Policymakers expect international educational assessments to report credible national and international changes in student achievement over time. However, international assessment projects face great methodological challenges to creating comparable scores across jurisdictions and time points, fundamentally because jurisdictions vary in many aspects of curriculum and curriculum change as well as in the patterns of students’ test-taking behaviour. Using data from the Second IEA Mathematics Study (SIMS), the study reported in this dissertation addresses the potential impact of the different equating methodologies used in current international assessments on the accurate estimates of change in jurisdiction achievement over time. The results of the study demonstrate that the different equating methodologies implemented through the Item Response Theory (IRT) models currently used in international assessments may be of limited use in estimating change in jurisdiction achievement over time. This is because the international assessment data violate the IRT model assumptions, in particular the unidimensionality assumption. In addition, the estimation of jurisdiction results based on a common international scale may potentially distort the results of those jurisdictions that have levels of student achievement that are much lower or higher than most other participating jurisdictions. The findings of this study have important implications for researchers as well as policy makers.","abstract_html":"Policymakers expect international educational assessments to report credible national and international changes in student achievement over time. However, international assessment projects face great methodological challenges to creating comparable scores across jurisdictions and time points, fundamentally because jurisdictions vary in many aspects of curriculum and curriculum change as well as in the patterns of students’ test-taking behaviour. Using data from the Second IEA Mathematics Study (SIMS), the study reported in this dissertation addresses the potential impact of the different equating methodologies used in current international assessments on the accurate estimates of change in jurisdiction achievement over time. The results of the study demonstrate that the different equating methodologies implemented through the Item Response Theory (IRT) models currently used in international assessments may be of limited use in estimating change in jurisdiction achievement over time. This is because the international assessment data violate the IRT model assumptions, in particular the unidimensionality assumption. In addition, the estimation of jurisdiction results based on a common international scale may potentially distort the results of those jurisdictions that have levels of student achievement that are much lower or higher than most other participating jurisdictions. The findings of this study have important implications for researchers as well as policy makers.","abstract_has_math":false,"creators":["Xu, Yunmei"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Human Development and Applied Psychology","school":null,"contributors":[],"advisors":["Wolfe, Richard"],"committee_chairs":[],"committee_members":[],"year":2010,"date_issued":"2010-02-25T21:48:35Z","date_published":"2010-02-25T21:48:35Z","updated_at":"2026-07-27T21:28:20Z","subjects":["0632","0515"],"languages":["en_ca"],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/1807/19168","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Wolfe, Richard"]},{"key":"dc:contributor.department","label":"Department","values":["Human Development and Applied Psychology"]},{"key":"dc:creator","label":"Author","values":["Xu, Yunmei"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2009-11"]},{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2010-02-25T21:48:35Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["NO_RESTRICTION","2010-02-25T21:48:35Z"]},{"key":"dc:date.issued","label":"Date","values":["2010-02-25T21:48:35Z"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["0632","0515"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_ca"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/1807/19168"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Policymakers expect international educational assessments to report credible national and international changes in student achievement over time. However, international assessment projects face great methodological challenges to creating comparable scores across jurisdictions and time points, fundamentally because jurisdictions vary in many aspects of curriculum and curriculum change as well as in the patterns of students’ test-taking behaviour. Using data from the Second IEA Mathematics Study (SIMS), the study reported in this dissertation addresses the potential impact of the different equating methodologies used in current international assessments on the accurate estimates of change in jurisdiction achievement over time. The results of the study demonstrate that the different equating methodologies implemented through the Item Response Theory (IRT) models currently used in international assessments may be of limited use in estimating change in jurisdiction achievement over time. This is because the international assessment data violate the IRT model assumptions, in particular the unidimensionality assumption. In addition, the estimation of jurisdiction results based on a common international scale may potentially distort the results of those jurisdictions that have levels of student achievement that are much lower or higher than most other participating jurisdictions. The findings of this study have important implications for researchers as well as policy makers."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["PhD"]},{"key":"dc:title","label":"Title","values":["Measuring Change in Jurisdiction Achievement over Time: Equating Issues in Current International Assessment Programs"]}]}],"canonical_facts":{"dc:contributor.advisor":["Wolfe, Richard"],"dc:contributor.department":["Human Development and Applied Psychology"],"dc:creator":["Xu, Yunmei"],"dc:date":["2009-11"],"dc:date.accessioned":["2010-02-25T21:48:35Z"],"dc:date.available":["NO_RESTRICTION","2010-02-25T21:48:35Z"],"dc:date.issued":["2010-02-25T21:48:35Z"],"dc:description.abstract":["Policymakers expect international educational assessments to report credible national and international changes in student achievement over time. However, international assessment projects face great methodological challenges to creating comparable scores across jurisdictions and time points, fundamentally because jurisdictions vary in many aspects of curriculum and curriculum change as well as in the patterns of students’ test-taking behaviour. Using data from the Second IEA Mathematics Study (SIMS), the study reported in this dissertation addresses the potential impact of the different equating methodologies used in current international assessments on the accurate estimates of change in jurisdiction achievement over time. The results of the study demonstrate that the different equating methodologies implemented through the Item Response Theory (IRT) models currently used in international assessments may be of limited use in estimating change in jurisdiction achievement over time. This is because the international assessment data violate the IRT model assumptions, in particular the unidimensionality assumption. In addition, the estimation of jurisdiction results based on a common international scale may potentially distort the results of those jurisdictions that have levels of student achievement that are much lower or higher than most other participating jurisdictions. The findings of this study have important implications for researchers as well as policy makers."],"dc:description.degree":["PhD"],"dc:identifier.uri":["http://hdl.handle.net/1807/19168"],"dc:language.iso":["en_ca"],"dc:subject":["0632","0515"],"dc:title":["Measuring Change in Jurisdiction Achievement over Time: Equating Issues in Current International Assessment Programs"],"dc:type":["Thesis"]},"updated_at":"2026-07-27T21:28:20Z"}