{"id":{"repo_id":"uoit","oai_identifier":"oai:ontariotechu.scholaris.ca:10155/1406"},"canonical_url":"https://search.dev.ndltd.org/etd/uoit/oai:ontariotechu.scholaris.ca:10155/1406","repository":{"repo_id":"uoit","name":"Ontario Institute of Technology","base_url":"https://ontariotechu.scholaris.ca/server/oai/request"},"display":{"title":"Peer evaluation with graph neural networks","abstract":"Peer assessment systems are rising in various social contexts, such as peer grading in large (online) classrooms, peer review in conferences, peer art evaluation, etc. However, peer assessments might not be as accurate as expert assessments, thus rendering these systems unreliable. Peer assessment systems’ reliability is influenced by factors such as peers’ assessment ability, manipulation and strategic assessment behaviors, and the peer assessment setup (e.g., peer assessing group work or individual work of others). In this work, we first model peer assessment as multi-relational weighted networks that can represent a variety of peer assessment setups, and capture conflicts of interest and strategic behaviors. Leveraging our peer assessment network model, we introduce a graph convolutional network which can learn assessment patterns and user behaviors to more accurately predict expert evaluations. Our extensive experiments on real and synthetic datasets demonstrate the efficacy of our proposed approach, which outperforms existing peer assessment methods.","abstract_html":"Peer assessment systems are rising in various social contexts, such as peer grading in large (online) classrooms, peer review in conferences, peer art evaluation, etc. However, peer assessments might not be as accurate as expert assessments, thus rendering these systems unreliable. Peer assessment systems’ reliability is influenced by factors such as peers’ assessment ability, manipulation and strategic assessment behaviors, and the peer assessment setup (e.g., peer assessing group work or individual work of others). In this work, we first model peer assessment as multi-relational weighted networks that can represent a variety of peer assessment setups, and capture conflicts of interest and strategic behaviors. Leveraging our peer assessment network model, we introduce a graph convolutional network which can learn assessment patterns and user behaviors to more accurately predict expert evaluations. Our extensive experiments on real and synthetic datasets demonstrate the efficacy of our proposed approach, which outperforms existing peer assessment methods.","abstract_has_math":false,"creators":["Namanloo, Alireza A."],"institution":"University of Ontario Institute of Technology","degree_name":"Master of Science (MSc)","degree_level":null,"degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":[],"advisors":["Salehi-Abari, Amirali","Thorpe, Julie"],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-12-01","date_published":"2021-12-01","updated_at":"2026-07-24T05:35:39Z","subjects":["Peer assessment","Graph neural network"],"languages":["en"],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/10155/1406","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Salehi-Abari, Amirali","Thorpe, Julie"]},{"key":"dc:creator","label":"Author","values":["Namanloo, Alireza A."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2022-01-21T16:16:11Z","2022-03-29T17:27:20Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2022-01-21T16:16:11Z","2022-03-29T17:27:20Z"]},{"key":"dc:date.issued","label":"Date","values":["2021-12-01"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science (MSc)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Ontario Institute of Technology"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Peer assessment","Graph neural network"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/10155/1406"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Peer assessment systems are rising in various social contexts, such as peer grading in large (online) classrooms, peer review in conferences, peer art evaluation, etc. However, peer assessments might not be as accurate as expert assessments, thus rendering these systems unreliable. Peer assessment systems’ reliability is influenced by factors such as peers’ assessment ability, manipulation and strategic assessment behaviors, and the peer assessment setup (e.g., peer assessing group work or individual work of others). In this work, we first model peer assessment as multi-relational weighted networks that can represent a variety of peer assessment setups, and capture conflicts of interest and strategic behaviors. Leveraging our peer assessment network model, we introduce a graph convolutional network which can learn assessment patterns and user behaviors to more accurately predict expert evaluations. Our extensive experiments on real and synthetic datasets demonstrate the efficacy of our proposed approach, which outperforms existing peer assessment methods."]},{"key":"dc:title","label":"Title","values":["Peer evaluation with graph neural networks"]}]}],"canonical_facts":{"dc:contributor.advisor":["Salehi-Abari, Amirali","Thorpe, Julie"],"dc:creator":["Namanloo, Alireza A."],"dc:date.accessioned":["2022-01-21T16:16:11Z","2022-03-29T17:27:20Z"],"dc:date.available":["2022-01-21T16:16:11Z","2022-03-29T17:27:20Z"],"dc:date.issued":["2021-12-01"],"dc:description.abstract":["Peer assessment systems are rising in various social contexts, such as peer grading in large (online) classrooms, peer review in conferences, peer art evaluation, etc. However, peer assessments might not be as accurate as expert assessments, thus rendering these systems unreliable. Peer assessment systems’ reliability is influenced by factors such as peers’ assessment ability, manipulation and strategic assessment behaviors, and the peer assessment setup (e.g., peer assessing group work or individual work of others). In this work, we first model peer assessment as multi-relational weighted networks that can represent a variety of peer assessment setups, and capture conflicts of interest and strategic behaviors. Leveraging our peer assessment network model, we introduce a graph convolutional network which can learn assessment patterns and user behaviors to more accurately predict expert evaluations. Our extensive experiments on real and synthetic datasets demonstrate the efficacy of our proposed approach, which outperforms existing peer assessment methods."],"dc:identifier.uri":["https://hdl.handle.net/10155/1406"],"dc:language.iso":["en"],"dc:subject":["Peer assessment","Graph neural network"],"dc:title":["Peer evaluation with graph neural networks"],"dc:type":["Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_name":["Master of Science (MSc)"],"thesis:institution_name":["University of Ontario Institute of Technology"]},"updated_at":"2026-07-24T05:35:39Z"}