{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/53066"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/53066","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis","abstract":"Uncertainty and risk are obstacles that nearly all policy-makers encounter during their careers. However, evaluating uncertainty and risk can be difficult since these concepts may be broadly defined. This may result in inaccurate estimates of risk and uncertainty. Expert elicitation is a formal, structured method of obtaining subjective expert judgment in scenarios where objective data is unobtainable. It is designed to reduce the influence of ambiguity on expert judgment, meaning that analysts may use such subjective data as if it were objectively generated. Expert elicitation methods tend to aggregate expert judgment in order to create a unified response, but determining how to combine expert opinions remains a difficult problem. In this thesis, a review of the literature and background behind defining expertise and expert elicitation will be provided. Additionally, this thesis introduces the Bayesian Truth Serum as a potential weighting algorithm for combining expert judgments. As opposed to other weighting algorithms, the Bayesian Truth Serum uses the metaknowledge of experts to create weights for aggregation. Using such information may prove superior to assuming a normal distribution of expertise or relying upon experts to provide estimates of their own expertise.","abstract_html":"Uncertainty and risk are obstacles that nearly all policy-makers encounter during their careers. However, evaluating uncertainty and risk can be difficult since these concepts may be broadly defined. This may result in inaccurate estimates of risk and uncertainty. Expert elicitation is a formal, structured method of obtaining subjective expert judgment in scenarios where objective data is unobtainable. It is designed to reduce the influence of ambiguity on expert judgment, meaning that analysts may use such subjective data as if it were objectively generated. Expert elicitation methods tend to aggregate expert judgment in order to create a unified response, but determining how to combine expert opinions remains a difficult problem. In this thesis, a review of the literature and background behind defining expertise and expert elicitation will be provided. Additionally, this thesis introduces the Bayesian Truth Serum as a potential weighting algorithm for combining expert judgments. As opposed to other weighting algorithms, the Bayesian Truth Serum uses the metaknowledge of experts to create weights for aggregation. Using such information may prove superior to assuming a normal distribution of expertise or relying upon experts to provide estimates of their own expertise.","abstract_has_math":false,"creators":["Weiss, Rebecca (Rebecca Jennifer)"],"institution":"Massachusetts Institute of Technology","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Massachusetts Institute of Technology. Engineering Systems Division","school":null,"contributors":[],"advisors":["Drazen Prelec."],"committee_chairs":[],"committee_members":[],"year":2009,"date_issued":"2009","date_published":"2009","updated_at":"2026-07-22T22:22:15Z","subjects":["Engineering Systems Division.","Technology and Policy Program."],"languages":["eng"],"rights":["M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission."],"rights_urls":["http://dspace.mit.edu/handle/1721.1/7582"],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/1721.1/53066","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Drazen Prelec."]},{"key":"dc:contributor.department","label":"Department","values":["Massachusetts Institute of Technology. Engineering Systems Division","Technology and Policy Program"]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["Massachusetts Institute of Technology. Technology and Policy Program."]},{"key":"dc:creator","label":"Author","values":["Weiss, Rebecca (Rebecca Jennifer)"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2010-03-25T14:55:51Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2010-03-25T14:55:51Z"]},{"key":"dc:date.issued","label":"Date","values":["2009"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Engineering Systems Division.","Technology and Policy Program."]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission."]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://dspace.mit.edu/handle/1721.1/7582"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/1721.1/53066"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Thesis (S.M. in Technology and Policy)--Massachusetts Institute of Technology, Engineering Systems Division, Technology and Policy Program, 2009.","Includes bibliographical references (p. 59-63)."]},{"key":"dc:description.abstract","label":"Abstract","values":["Uncertainty and risk are obstacles that nearly all policy-makers encounter during their careers. However, evaluating uncertainty and risk can be difficult since these concepts may be broadly defined. This may result in inaccurate estimates of risk and uncertainty. Expert elicitation is a formal, structured method of obtaining subjective expert judgment in scenarios where objective data is unobtainable. It is designed to reduce the influence of ambiguity on expert judgment, meaning that analysts may use such subjective data as if it were objectively generated. Expert elicitation methods tend to aggregate expert judgment in order to create a unified response, but determining how to combine expert opinions remains a difficult problem. In this thesis, a review of the literature and background behind defining expertise and expert elicitation will be provided. Additionally, this thesis introduces the Bayesian Truth Serum as a potential weighting algorithm for combining expert judgments. As opposed to other weighting algorithms, the Bayesian Truth Serum uses the metaknowledge of experts to create weights for aggregation. Using such information may prove superior to assuming a normal distribution of expertise or relying upon experts to provide estimates of their own expertise."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["S.M.in Technology and Policy"]},{"key":"dc:title","label":"Title","values":["Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis"]}]}],"canonical_facts":{"dc:contributor.advisor":["Drazen Prelec."],"dc:contributor.department":["Massachusetts Institute of Technology. Engineering Systems Division","Technology and Policy Program"],"dc:contributor.other":["Massachusetts Institute of Technology. Technology and Policy Program."],"dc:creator":["Weiss, Rebecca (Rebecca Jennifer)"],"dc:date.accessioned":["2010-03-25T14:55:51Z"],"dc:date.available":["2010-03-25T14:55:51Z"],"dc:date.issued":["2009"],"dc:description":["Thesis (S.M. in Technology and Policy)--Massachusetts Institute of Technology, Engineering Systems Division, Technology and Policy Program, 2009.","Includes bibliographical references (p. 59-63)."],"dc:description.abstract":["Uncertainty and risk are obstacles that nearly all policy-makers encounter during their careers. However, evaluating uncertainty and risk can be difficult since these concepts may be broadly defined. This may result in inaccurate estimates of risk and uncertainty. Expert elicitation is a formal, structured method of obtaining subjective expert judgment in scenarios where objective data is unobtainable. It is designed to reduce the influence of ambiguity on expert judgment, meaning that analysts may use such subjective data as if it were objectively generated. Expert elicitation methods tend to aggregate expert judgment in order to create a unified response, but determining how to combine expert opinions remains a difficult problem. In this thesis, a review of the literature and background behind defining expertise and expert elicitation will be provided. Additionally, this thesis introduces the Bayesian Truth Serum as a potential weighting algorithm for combining expert judgments. As opposed to other weighting algorithms, the Bayesian Truth Serum uses the metaknowledge of experts to create weights for aggregation. Using such information may prove superior to assuming a normal distribution of expertise or relying upon experts to provide estimates of their own expertise."],"dc:description.degree":["S.M.in Technology and Policy"],"dc:identifier.uri":["http://hdl.handle.net/1721.1/53066"],"dc:language.iso":["eng"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission."],"dc:rights.uri":["http://dspace.mit.edu/handle/1721.1/7582"],"dc:subject":["Engineering Systems Division.","Technology and Policy Program."],"dc:title":["Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis"],"dc:type":["Thesis"]},"updated_at":"2026-07-22T22:22:15Z"}