{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/21428"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/21428","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Station time requirements for performance-based examinations: Their influence on reliability and validity","abstract":"Within the past fifteen years there has been increasing interest in using performance-based examinations to supplement or replace written examinations designed to assess clinical competence in medical education. Despite the widespread interest in this type of assessment method, obtaining reliable performance estimates remains a major obstacle in their use. For acceptable estimates usually 12 to 25 medical cases must be included in the examination. With each case taking between 20 and 30 minutes to complete, the administration of a performance-based test is unfeasible for many medical schools.","abstract_html":"Within the past fifteen years there has been increasing interest in using performance-based examinations to supplement or replace written examinations designed to assess clinical competence in medical education. Despite the widespread interest in this type of assessment method, obtaining reliable performance estimates remains a major obstacle in their use. For acceptable estimates usually 12 to 25 medical cases must be included in the examination. With each case taking between 20 and 30 minutes to complete, the administration of a performance-based test is unfeasible for many medical schools.","abstract_has_math":false,"creators":["Shatzer, John Howard, Jr"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Education","degree_department":null,"school":null,"contributors":["West, Charles K."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2011,"date_issued":"2011-05-07T13:08:22Z","date_published":"2011-05-07T13:08:22Z","updated_at":"2026-07-22T22:25:17Z","subjects":["Education, Tests and Measurements","Health Sciences, Education","Education, Educational Psychology"],"languages":["eng"],"rights":["Copyright 1991 Shatzer, John Howard, Jr"],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["AAI9210987","(UMI)AAI9210987"],"render_values":[{"text":"AAI9210987","href":null,"code":true},{"text":"(UMI)AAI9210987","href":null,"code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/2142/21428","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["West, Charles K."]},{"key":"dc:creator","label":"Author","values":["Shatzer, John Howard, Jr"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2011-05-07T13:08:22Z","10000-01-01","1991"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Education"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Education, Tests and Measurements","Health Sciences, Education","Education, Educational Psychology"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 1991 Shatzer, John Howard, Jr"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["AAI9210987","(UMI)AAI9210987","http://hdl.handle.net/2142/21428"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Within the past fifteen years there has been increasing interest in using performance-based examinations to supplement or replace written examinations designed to assess clinical competence in medical education. Despite the widespread interest in this type of assessment method, obtaining reliable performance estimates remains a major obstacle in their use. For acceptable estimates usually 12 to 25 medical cases must be included in the examination. With each case taking between 20 and 30 minutes to complete, the administration of a performance-based test is unfeasible for many medical schools.","The purpose of this research was to determine whether an exam with shorter time allocations provides as reliable score estimates as an exam with longer stations. A second purpose was to explore the relationship between station times and the characteristics of the scoring information collected. Fifteen second-year medical students were administered 11 standardized patient cases in a multiple-station format. The length of each station (case) was set at 20 minutes. Scores were analyzed over 5-, 10-, and 20-minute intervals as an indication of performance at different station lengths. Performance at each station was scored by means of a checklist of medical history questions deemed important to ask by the examinee. Checklist elements were organized into one of three categories: elaboration of the chief complaint, associated symptoms, and associated medical history. These categories were used to determine examinee response patterns over the time interval studied. The highest generalizability estimate was obtained during the first 10 minutes of the eleven stations. A second study was conducted with 23 second-year students taking an 8-station examination comprised of cases from the previous test. Station time was set at 10 minutes with scoring at 5- and 10-minute intervals. The highest generalizability was again obtained at 10 minutes. An analysis of response patterns showed that examinees did not change their approach to asking history questions when faced with shorter station time allocations. Results are discussed in terms of their implications for making these examinations more feasible yet retaining their reliability and validity.","Made available in DSpace on 2011-05-07T13:08:22Z (GMT). No. of bitstreams: 2 license.txt: 4922 bytes, checksum: 910b249b4beec47e7ab768910c8f966f (MD5) 9210987.pdf: 3913009 bytes, checksum: 0c34349663cc858d1415305f3a3dbe5b (MD5) Previous issue date: 1991","Item marked as restricted to the 'UIUC Users [automated]' Group (id=2) by Howard Ding (hding2@illinois.edu) on 2011-05-07T14:50:42Z Item is restricted indefinitely.","Restriction data tranferred 2014-07-01T11:23:12-05:00 Original Data Group with Access UIUC Users [automated] Release Date: none Reason: ETDs are only available to UIUC Users without author permission","ETDs are only available to UIUC Users without author permission","U of I Only"]},{"key":"dc:title","label":"Title","values":["Station time requirements for performance-based examinations: Their influence on reliability and validity"]}]}],"canonical_facts":{"dc:contributor":["West, Charles K."],"dc:creator":["Shatzer, John Howard, Jr"],"dc:date":["2011-05-07T13:08:22Z","10000-01-01","1991"],"dc:description":["Within the past fifteen years there has been increasing interest in using performance-based examinations to supplement or replace written examinations designed to assess clinical competence in medical education. Despite the widespread interest in this type of assessment method, obtaining reliable performance estimates remains a major obstacle in their use. For acceptable estimates usually 12 to 25 medical cases must be included in the examination. With each case taking between 20 and 30 minutes to complete, the administration of a performance-based test is unfeasible for many medical schools.","The purpose of this research was to determine whether an exam with shorter time allocations provides as reliable score estimates as an exam with longer stations. A second purpose was to explore the relationship between station times and the characteristics of the scoring information collected. Fifteen second-year medical students were administered 11 standardized patient cases in a multiple-station format. The length of each station (case) was set at 20 minutes. Scores were analyzed over 5-, 10-, and 20-minute intervals as an indication of performance at different station lengths. Performance at each station was scored by means of a checklist of medical history questions deemed important to ask by the examinee. Checklist elements were organized into one of three categories: elaboration of the chief complaint, associated symptoms, and associated medical history. These categories were used to determine examinee response patterns over the time interval studied. The highest generalizability estimate was obtained during the first 10 minutes of the eleven stations. A second study was conducted with 23 second-year students taking an 8-station examination comprised of cases from the previous test. Station time was set at 10 minutes with scoring at 5- and 10-minute intervals. The highest generalizability was again obtained at 10 minutes. An analysis of response patterns showed that examinees did not change their approach to asking history questions when faced with shorter station time allocations. Results are discussed in terms of their implications for making these examinations more feasible yet retaining their reliability and validity.","Made available in DSpace on 2011-05-07T13:08:22Z (GMT). No. of bitstreams: 2 license.txt: 4922 bytes, checksum: 910b249b4beec47e7ab768910c8f966f (MD5) 9210987.pdf: 3913009 bytes, checksum: 0c34349663cc858d1415305f3a3dbe5b (MD5) Previous issue date: 1991","Item marked as restricted to the 'UIUC Users [automated]' Group (id=2) by Howard Ding (hding2@illinois.edu) on 2011-05-07T14:50:42Z Item is restricted indefinitely.","Restriction data tranferred 2014-07-01T11:23:12-05:00 Original Data Group with Access UIUC Users [automated] Release Date: none Reason: ETDs are only available to UIUC Users without author permission","ETDs are only available to UIUC Users without author permission","U of I Only"],"dc:identifier":["AAI9210987","(UMI)AAI9210987","http://hdl.handle.net/2142/21428"],"dc:language":["eng"],"dc:rights":["Copyright 1991 Shatzer, John Howard, Jr"],"dc:subject":["Education, Tests and Measurements","Health Sciences, Education","Education, Educational Psychology"],"dc:title":["Station time requirements for performance-based examinations: Their influence on reliability and validity"],"dc:type":["text"],"thesis:degree_discipline":["Education"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:17Z"}