{"id":{"repo_id":"kings","oai_identifier":"oai:kclpure.kcl.ac.uk:studenttheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0"},"canonical_url":"https://search.dev.ndltd.org/etd/kings/oai:kclpure.kcl.ac.uk:studenttheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0","repository":{"repo_id":"kings","name":"King's College London","base_url":"https://kclpure.kcl.ac.uk/ws/oai"},"display":{"title":"Evaluating computational creativity: a standardised procedure for evaluating creative systems and its application","abstract":"This thesis proposes SPECS: a Standardised Procedure for Evaluating Creative Systems.
No methodology has been accepted as standard for evaluating the creativity of a system in the field of computational creativity and the multi-faceted and subjective nature of creativity generates substantial definitional issues. Evaluative practice has developed a general lack of rigour and systematicity, hindering research progress.
SPECS is a standardised and systematic methodology for evaluating computational creativity. It is flexible enough to be applied to a variety of different types of creative system and adaptable to specific demands in different types of creativity. In the three-stage process of evaluation, researchers are required to be specific about what creativity entails in the domain they work in and what standards they test a system’s creativity by. To assist researchers, definitional issues are investigated and a set of components representing aspects of creativity is presented, which was empirically derived using computational linguistics analysis. These components are recommended for use within SPECS, being offered as a general definition of creativity that can be customised to account for any specific priorities for creativity in a given domain.
SPECS is applied in a case study for detailed comparisons of the creativity of three musical improvisation systems, identifying which systems are more creative than others and why. In a second case study, SPECS is used to capture initial impressions on the creativity of systems presented at a 2011 computational creativity research event. Five systems performing different creative tasks are compared and contrasted.
These case studies exemplify the valuable information that can be obtained on a system’s strengths and weaknesses. SPECS gives researchers vital feedback for improving their systems’ creativity, informing further progress in computational creativity research.","abstract_html":"This thesis proposes SPECS: a Standardised Procedure for Evaluating Creative Systems.<br/><br/>No methodology has been accepted as standard for evaluating the creativity of a system in the field of computational creativity and the multi-faceted and subjective nature of creativity generates substantial definitional issues. Evaluative practice has developed a general lack of rigour and systematicity, hindering research progress.<br/><br/>SPECS is a standardised and systematic methodology for evaluating computational creativity. It is flexible enough to be applied to a variety of different types of creative system and adaptable to specific demands in different types of creativity. In the three-stage process of evaluation, researchers are required to be specific about what creativity entails in the domain they work in and what standards they test a system’s creativity by. To assist researchers, definitional issues are investigated and a set of components representing aspects of creativity is presented, which was empirically derived using computational linguistics analysis. These components are recommended for use within SPECS, being offered as a general definition of creativity that can be customised to account for any specific priorities for creativity in a given domain.<br/><br/>SPECS is applied in a case study for detailed comparisons of the creativity of three musical improvisation systems, identifying which systems are more creative than others and why. In a second case study, SPECS is used to capture initial impressions on the creativity of systems presented at a 2011 computational creativity research event. Five systems performing different creative tasks are compared and contrasted.<br/><br/>These case studies exemplify the valuable information that can be obtained on a system’s strengths and weaknesses. SPECS gives researchers vital feedback for improving their systems’ creativity, informing further progress in computational creativity research.","abstract_has_math":false,"creators":["Jordanous, Anna"],"institution":"University of Sussex","degree_name":"Doctor of Philosophy","degree_level":"Doctoral Thesis","degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2013,"date_issued":"2013-7-1","date_published":"2013-7-1","updated_at":"2026-07-24T02:44:31Z","subjects":["Computational creativity","creativity evaluation","research methodology","evaluation of research","music improvisation","improvisation creativity","creativity","improvisation","evaluation"],"languages":["eng"],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["oai:kclpure.kcl.ac.uk:studenttheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0"],"render_values":[{"text":"oai:kclpure.kcl.ac.uk:studenttheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0","href":null,"code":true}]}]},"links":{"outbound_url":"https://kclpure.kcl.ac.uk/portal/en/studentTheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0","outbound_label":"Repository record","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Jordanous, Anna"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2013-7-1"]},{"key":"dc:date.issued","label":"Date","values":["2013-7-1"]},{"key":"dc:publisher.department","label":"Dc Publisher Department","values":["Centre for e-Research","Digital Humanities"]},{"key":"dc:publisher.institution","label":"Dc Publisher Institution","values":["University of Sussex"]},{"key":"dc:relation.isreferencedby","label":"Dc Relation Isreferencedby","values":["https://kclpure.kcl.ac.uk/portal/en/studentTheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"dc:type.qualificationlevel","label":"Dc Type Qualificationlevel","values":["Doctoral Thesis"]},{"key":"dc:type.qualificationname","label":"Dc Type Qualificationname","values":["Doctor of Philosophy"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Computational creativity","creativity evaluation","research methodology","evaluation of research","music improvisation","improvisation creativity","creativity","improvisation","evaluation"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["oai:kclpure.kcl.ac.uk:studenttheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0","https://kclpure.kcl.ac.uk/portal/en/studentTheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["This thesis proposes SPECS: a Standardised Procedure for Evaluating Creative Systems.
No methodology has been accepted as standard for evaluating the creativity of a system in the field of computational creativity and the multi-faceted and subjective nature of creativity generates substantial definitional issues. Evaluative practice has developed a general lack of rigour and systematicity, hindering research progress.
SPECS is a standardised and systematic methodology for evaluating computational creativity. It is flexible enough to be applied to a variety of different types of creative system and adaptable to specific demands in different types of creativity. In the three-stage process of evaluation, researchers are required to be specific about what creativity entails in the domain they work in and what standards they test a system’s creativity by. To assist researchers, definitional issues are investigated and a set of components representing aspects of creativity is presented, which was empirically derived using computational linguistics analysis. These components are recommended for use within SPECS, being offered as a general definition of creativity that can be customised to account for any specific priorities for creativity in a given domain.
SPECS is applied in a case study for detailed comparisons of the creativity of three musical improvisation systems, identifying which systems are more creative than others and why. In a second case study, SPECS is used to capture initial impressions on the creativity of systems presented at a 2011 computational creativity research event. Five systems performing different creative tasks are compared and contrasted.
These case studies exemplify the valuable information that can be obtained on a system’s strengths and weaknesses. SPECS gives researchers vital feedback for improving their systems’ creativity, informing further progress in computational creativity research."]},{"key":"dc:title","label":"Title","values":["Evaluating computational creativity: a standardised procedure for evaluating creative systems and its application"]}]}],"canonical_facts":{"dc:creator":["Jordanous, Anna"],"dc:date":["2013-7-1"],"dc:date.issued":["2013-7-1"],"dc:description.abstract":["This thesis proposes SPECS: a Standardised Procedure for Evaluating Creative Systems.
No methodology has been accepted as standard for evaluating the creativity of a system in the field of computational creativity and the multi-faceted and subjective nature of creativity generates substantial definitional issues. Evaluative practice has developed a general lack of rigour and systematicity, hindering research progress.
SPECS is a standardised and systematic methodology for evaluating computational creativity. It is flexible enough to be applied to a variety of different types of creative system and adaptable to specific demands in different types of creativity. In the three-stage process of evaluation, researchers are required to be specific about what creativity entails in the domain they work in and what standards they test a system’s creativity by. To assist researchers, definitional issues are investigated and a set of components representing aspects of creativity is presented, which was empirically derived using computational linguistics analysis. These components are recommended for use within SPECS, being offered as a general definition of creativity that can be customised to account for any specific priorities for creativity in a given domain.
SPECS is applied in a case study for detailed comparisons of the creativity of three musical improvisation systems, identifying which systems are more creative than others and why. In a second case study, SPECS is used to capture initial impressions on the creativity of systems presented at a 2011 computational creativity research event. Five systems performing different creative tasks are compared and contrasted.
These case studies exemplify the valuable information that can be obtained on a system’s strengths and weaknesses. SPECS gives researchers vital feedback for improving their systems’ creativity, informing further progress in computational creativity research."],"dc:identifier":["oai:kclpure.kcl.ac.uk:studenttheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0","https://kclpure.kcl.ac.uk/portal/en/studentTheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0"],"dc:language":["eng"],"dc:publisher.department":["Centre for e-Research","Digital Humanities"],"dc:publisher.institution":["University of Sussex"],"dc:relation.isreferencedby":["https://kclpure.kcl.ac.uk/portal/en/studentTheses/44ab20e0-067b-46ca-8fb6-e1e2976babd0"],"dc:subject":["Computational creativity","creativity evaluation","research methodology","evaluation of research","music improvisation","improvisation creativity","creativity","improvisation","evaluation"],"dc:title":["Evaluating computational creativity: a standardised procedure for evaluating creative systems and its application"],"dc:type":["Thesis"],"dc:type.qualificationlevel":["Doctoral Thesis"],"dc:type.qualificationname":["Doctor of Philosophy"]},"updated_at":"2026-07-24T02:44:31Z"}