{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/117710"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/117710","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"How interface design affects the composition, interpretation, and utilization of feedback","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled &#x27;Open Access&#x27;. The submission was exported from vireo on 2023-04-12 without embargo terms","abstract_has_math":false,"creators":["Crain, Patrick"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Bailey, Brian","Huang, Yun","Kirlik, Alex","Kim, Joy"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-12","date_published":"2022-12","updated_at":"2026-07-22T22:24:56Z","subjects":["human computer interaction","interface design","iterative design","online feedback exchange","mixed-methods"],"languages":["en","eng"],"rights":["Copyright 2022 Patrick Crain"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/117710","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Bailey, Brian","Huang, Yun","Kirlik, Alex","Kim, Joy"]},{"key":"dc:creator","label":"Author","values":["Crain, Patrick"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-12","2022-08-17"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["human computer interaction","interface design","iterative design","online feedback exchange","mixed-methods"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2022 Patrick Crain"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/117710"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","The student, Patrick Crain, accepted the attached license on 2022-08-16 at 11:42.","The student, Patrick Crain, submitted this Dissertation for approval on 2022-08-16 at 11:48.","This Dissertation was approved for publication on 2022-08-17 at 15:46.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18460 on 2023-04-12 at 07:23:08","Interfaces for composing and reviewing feedback vary widely in terms of the information they include and how they present it. These interfaces can have a strong impact on how content creators and their feedback providers engage with the feedback, ranging from task performance and perceptions of fairness and helpfulness to strategies used for composing and navigating the feedback. In my thesis, I report the results from three experiments exploring how user interfaces present throughout the feedback exchange process influence feedback composition, interpretation, and utilization. In the first experiment, we examine how various combinations of constructive and summative feedback influence a creator’s perceptions of the feedback and the revisions they subsequently perform. Participants (N=441) wrote and revised short stories when presented with quality scores, pre-authored constructive comments, both scores and comments, or no feedback. We found that while showing scores can have marginal benefits compared to showing no feedback, constructive comments without scores led to the most favorable feedback perceptions and revisions. In the second experiment, we investigate how feedback’s level of detail influences perceptions of the feedback by both the provider and recipient, and how these perceptions translate to revisions and creative outcomes. Writers (N=285) received feedback from expert providers (N=4) in the form of a writing rubric, open comments, a rubric with open comments, or a rubric with per-criterion comments. We found that writers’ revision quality and feedback perceptions increased with the feedback’s level of detail, but providers felt the interface that required the most detail diminished their ability to effectively articulate their thoughts. In the third experiment, we explore how students integrate an interactive visualization of feedback’s topic and opinion structure into their proceses for navigating and interpreting feedback. Teams (N=18) of 3-5 students each used the tool to review feedback on three different project deliverables and revise these deliverables for a grade in an authentic UI design course. We found that students used the visualization to assess their work quality, prioritize revisions, and justify design decisions to their teammates. Some students additionally developed emergent techniques for reviewing and annotating feedback that they adapted to their other projects outside the course. My dissertation represents a large step towards a future where the interfaces with which feedback is composed and presented are given as much consideration as the feedback’s content when designing tools for supporting feedback exchange between content creators and feedback providers."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["How interface design affects the composition, interpretation, and utilization of feedback"]}]}],"canonical_facts":{"dc:contributor":["Bailey, Brian","Huang, Yun","Kirlik, Alex","Kim, Joy"],"dc:creator":["Crain, Patrick"],"dc:date":["2022-12","2022-08-17"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-04-12 without embargo terms","The student, Patrick Crain, accepted the attached license on 2022-08-16 at 11:42.","The student, Patrick Crain, submitted this Dissertation for approval on 2022-08-16 at 11:48.","This Dissertation was approved for publication on 2022-08-17 at 15:46.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18460 on 2023-04-12 at 07:23:08","Interfaces for composing and reviewing feedback vary widely in terms of the information they include and how they present it. These interfaces can have a strong impact on how content creators and their feedback providers engage with the feedback, ranging from task performance and perceptions of fairness and helpfulness to strategies used for composing and navigating the feedback. In my thesis, I report the results from three experiments exploring how user interfaces present throughout the feedback exchange process influence feedback composition, interpretation, and utilization. In the first experiment, we examine how various combinations of constructive and summative feedback influence a creator’s perceptions of the feedback and the revisions they subsequently perform. Participants (N=441) wrote and revised short stories when presented with quality scores, pre-authored constructive comments, both scores and comments, or no feedback. We found that while showing scores can have marginal benefits compared to showing no feedback, constructive comments without scores led to the most favorable feedback perceptions and revisions. In the second experiment, we investigate how feedback’s level of detail influences perceptions of the feedback by both the provider and recipient, and how these perceptions translate to revisions and creative outcomes. Writers (N=285) received feedback from expert providers (N=4) in the form of a writing rubric, open comments, a rubric with open comments, or a rubric with per-criterion comments. We found that writers’ revision quality and feedback perceptions increased with the feedback’s level of detail, but providers felt the interface that required the most detail diminished their ability to effectively articulate their thoughts. In the third experiment, we explore how students integrate an interactive visualization of feedback’s topic and opinion structure into their proceses for navigating and interpreting feedback. Teams (N=18) of 3-5 students each used the tool to review feedback on three different project deliverables and revise these deliverables for a grade in an authentic UI design course. We found that students used the visualization to assess their work quality, prioritize revisions, and justify design decisions to their teammates. Some students additionally developed emergent techniques for reviewing and annotating feedback that they adapted to their other projects outside the course. My dissertation represents a large step towards a future where the interfaces with which feedback is composed and presented are given as much consideration as the feedback’s content when designing tools for supporting feedback exchange between content creators and feedback providers."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/117710"],"dc:language":["en","eng"],"dc:rights":["Copyright 2022 Patrick Crain"],"dc:subject":["human computer interaction","interface design","iterative design","online feedback exchange","mixed-methods"],"dc:title":["How interface design affects the composition, interpretation, and utilization of feedback"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:56Z"}