{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/23247"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/23247","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"An approach to the evaluation of expert systems for the selection of reference sources","abstract":"Sixty students at the University of Illinois voluntarily participated in the research to select reference sources for ten test questions with or without the aid of the expert systems to be evaluated. The students were first divided into little-experienced and no-experienced groups; the students in each group were further randomly divided into RE, SF, and NO groups. The RE group students consulted Reference Expert to select reference sources, the SF group students consulted SourceFinder, and the NO group students consulted the online catalog (IO$\\sp+$/IBIS), browsed shelves in the Undergraduate Library, or retrieved from personal knowledge.","abstract_html":"Sixty students at the University of Illinois voluntarily participated in the research to select reference sources for ten test questions with or without the aid of the expert systems to be evaluated. The students were first divided into little-experienced and no-experienced groups; the students in each group were further randomly divided into RE, SF, and NO groups. The RE group students consulted Reference Expert to select reference sources, the SF group students consulted SourceFinder, and the NO group students consulted the online catalog (IO$\\sp+$/IBIS), browsed shelves in the Undergraduate Library, or retrieved from personal knowledge.","abstract_has_math":true,"creators":["Su, Shiao-Feng"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Library and Information Science","degree_department":null,"school":null,"contributors":["Lancaster, F.W.","Smith, Linda C.","Allen, Bryce L."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2011,"date_issued":"2011-05-07T14:07:23Z","date_published":"2011-05-07T14:07:23Z","updated_at":"2026-07-22T22:25:21Z","subjects":["Library Science","Information Science","Artificial Intelligence"],"languages":["eng"],"rights":["Copyright 1994 Su, Shiao-Feng"],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["AAI9512565","(UMI)AAI9512565"],"render_values":[{"text":"AAI9512565","href":null,"code":true},{"text":"(UMI)AAI9512565","href":null,"code":true}]}]},"links":{"outbound_url":"http://hdl.handle.net/2142/23247","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Lancaster, F.W.","Smith, Linda C.","Allen, Bryce L."]},{"key":"dc:creator","label":"Author","values":["Su, Shiao-Feng"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2011-05-07T14:07:23Z","10000-01-01","1994"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Library and Information Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Library Science","Information Science","Artificial Intelligence"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 1994 Su, Shiao-Feng"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["AAI9512565","(UMI)AAI9512565","http://hdl.handle.net/2142/23247"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Sixty students at the University of Illinois voluntarily participated in the research to select reference sources for ten test questions with or without the aid of the expert systems to be evaluated. The students were first divided into little-experienced and no-experienced groups; the students in each group were further randomly divided into RE, SF, and NO groups. The RE group students consulted Reference Expert to select reference sources, the SF group students consulted SourceFinder, and the NO group students consulted the online catalog (IO$\\sp+$/IBIS), browsed shelves in the Undergraduate Library, or retrieved from personal knowledge.","\"The results of the study suggest that the current expert systems for the selection of reference sources cannot perform as well as experienced subject-oriented reference librarians. The better system, Reference Expert, could only achieve 80 percent accuracy in aiding users to select appropriate sources. SourceFinder achieved 40 percent accuracy. A failure analysis is provided. The results indicate that the students without \"\"expert system\"\" aid can perform as well as comparable students aided by SourceFinder in the selection of sources. SourceFinder can lead its users to select reference sources at a 25% consistency level, while Reference Expert achieves a 57.5% consistency level. Students not aided by any expert system achieve only 10% consistency in source selection.\"","\"The results of this research generally do not offer strong support for the belief that \"\"expert systems\"\" for selection of reference sources can provide much help to increase the accuracy of question answering in reference services. In fact, in the case of SourceFinder, students of little experience aided by the system performed significantly worse than did the comparable students using the online catalog or personal knowledge. It is not just a matter of \"\"why bother\"\" to build an expert system of this type; there also exists the possibility that exclusive use of such a system to select reference sources may worsen the existing \"\"half-right\"\" performance of reference librarians.\"","Made available in DSpace on 2011-05-07T14:07:23Z (GMT). No. of bitstreams: 2 license.txt: 4922 bytes, checksum: 910b249b4beec47e7ab768910c8f966f (MD5) 9512565.pdf: 6038394 bytes, checksum: 6f30472afe984c175882730aeef1bea0 (MD5) Previous issue date: 1994","Item marked as restricted to the 'UIUC Users [automated]' Group (id=2) by Howard Ding (hding2@illinois.edu) on 2011-05-07T15:03:11Z Item is restricted indefinitely.","Restriction data tranferred 2014-07-01T11:30:06-05:00 Original Data Group with Access UIUC Users [automated] Release Date: none Reason: ETDs are only available to UIUC Users without author permission","ETDs are only available to UIUC Users without author permission","U of I Only"]},{"key":"dc:title","label":"Title","values":["An approach to the evaluation of expert systems for the selection of reference sources"]}]}],"canonical_facts":{"dc:contributor":["Lancaster, F.W.","Smith, Linda C.","Allen, Bryce L."],"dc:creator":["Su, Shiao-Feng"],"dc:date":["2011-05-07T14:07:23Z","10000-01-01","1994"],"dc:description":["Sixty students at the University of Illinois voluntarily participated in the research to select reference sources for ten test questions with or without the aid of the expert systems to be evaluated. The students were first divided into little-experienced and no-experienced groups; the students in each group were further randomly divided into RE, SF, and NO groups. The RE group students consulted Reference Expert to select reference sources, the SF group students consulted SourceFinder, and the NO group students consulted the online catalog (IO$\\sp+$/IBIS), browsed shelves in the Undergraduate Library, or retrieved from personal knowledge.","\"The results of the study suggest that the current expert systems for the selection of reference sources cannot perform as well as experienced subject-oriented reference librarians. The better system, Reference Expert, could only achieve 80 percent accuracy in aiding users to select appropriate sources. SourceFinder achieved 40 percent accuracy. A failure analysis is provided. The results indicate that the students without \"\"expert system\"\" aid can perform as well as comparable students aided by SourceFinder in the selection of sources. SourceFinder can lead its users to select reference sources at a 25% consistency level, while Reference Expert achieves a 57.5% consistency level. Students not aided by any expert system achieve only 10% consistency in source selection.\"","\"The results of this research generally do not offer strong support for the belief that \"\"expert systems\"\" for selection of reference sources can provide much help to increase the accuracy of question answering in reference services. In fact, in the case of SourceFinder, students of little experience aided by the system performed significantly worse than did the comparable students using the online catalog or personal knowledge. It is not just a matter of \"\"why bother\"\" to build an expert system of this type; there also exists the possibility that exclusive use of such a system to select reference sources may worsen the existing \"\"half-right\"\" performance of reference librarians.\"","Made available in DSpace on 2011-05-07T14:07:23Z (GMT). No. of bitstreams: 2 license.txt: 4922 bytes, checksum: 910b249b4beec47e7ab768910c8f966f (MD5) 9512565.pdf: 6038394 bytes, checksum: 6f30472afe984c175882730aeef1bea0 (MD5) Previous issue date: 1994","Item marked as restricted to the 'UIUC Users [automated]' Group (id=2) by Howard Ding (hding2@illinois.edu) on 2011-05-07T15:03:11Z Item is restricted indefinitely.","Restriction data tranferred 2014-07-01T11:30:06-05:00 Original Data Group with Access UIUC Users [automated] Release Date: none Reason: ETDs are only available to UIUC Users without author permission","ETDs are only available to UIUC Users without author permission","U of I Only"],"dc:identifier":["AAI9512565","(UMI)AAI9512565","http://hdl.handle.net/2142/23247"],"dc:language":["eng"],"dc:rights":["Copyright 1994 Su, Shiao-Feng"],"dc:subject":["Library Science","Information Science","Artificial Intelligence"],"dc:title":["An approach to the evaluation of expert systems for the selection of reference sources"],"dc:type":["text"],"thesis:degree_discipline":["Library and Information Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:21Z"}