{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/104793"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/104793","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Validating a concept inventory for cybersecurity","abstract":"The validity of a concept inventory is imperative to its adoption by the education community. In this thesis, we evaluate the validity of the Cybersecurity Concept Inventory for assessing student knowledge of core cybersecurity concepts after a first course on the topic. Our evaluation involved expert review and student performance data. A panel of 12 experts in cybersecurity reviewed each item of the Cybersecurity Concept Inventory (CCI), and the majority agreed that every item measured appropriate cybersecurity knowledge. We gave the CCI to 142 students from six different institutions taking a first cybersecurity course either online or proctored by the professor of the course. We used Classical Test Theory to evaluate the quality of the CCI. This evaluation showed that the CCI is sufficiently reliable for measuring students' knowledge of cybersecurity and that the CCI may be too difficult as a whole. We describe the results of both the expert review and the pilot test in further detail and provide recommendations for the continued improvement of the CCI.","abstract_html":"The validity of a concept inventory is imperative to its adoption by the education community. In this thesis, we evaluate the validity of the Cybersecurity Concept Inventory for assessing student knowledge of core cybersecurity concepts after a first course on the topic. Our evaluation involved expert review and student performance data. A panel of 12 experts in cybersecurity reviewed each item of the Cybersecurity Concept Inventory (CCI), and the majority agreed that every item measured appropriate cybersecurity knowledge. We gave the CCI to 142 students from six different institutions taking a first cybersecurity course either online or proctored by the professor of the course. We used Classical Test Theory to evaluate the quality of the CCI. This evaluation showed that the CCI is sufficiently reliable for measuring students&#x27; knowledge of cybersecurity and that the CCI may be too difficult as a whole. We describe the results of both the expert review and the pilot test in further detail and provide recommendations for the continued improvement of the CCI.","abstract_has_math":false,"creators":["Offenberger, Spencer"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Loui, Michael"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2019,"date_issued":"2019-08-23T19:51:44Z","date_published":"2019-08-23T19:51:44Z","updated_at":"2026-07-22T22:24:42Z","subjects":["Cybersecurity Education, Cybersecurity Assessment Tools (CATS) Project, Cybersecurity Concept Inventory (CCI), Assessment Validation"],"languages":["en"],"rights":["Copyright 2019 Spencer Offenberger"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/104793","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Loui, Michael"]},{"key":"dc:creator","label":"Author","values":["Offenberger, Spencer"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2019-08-23T19:51:44Z","2019-04-10","2019-05"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Cybersecurity Education, Cybersecurity Assessment Tools (CATS) Project, Cybersecurity Concept Inventory (CCI), Assessment Validation"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2019 Spencer Offenberger"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/104793"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["The validity of a concept inventory is imperative to its adoption by the education community. In this thesis, we evaluate the validity of the Cybersecurity Concept Inventory for assessing student knowledge of core cybersecurity concepts after a first course on the topic. Our evaluation involved expert review and student performance data. A panel of 12 experts in cybersecurity reviewed each item of the Cybersecurity Concept Inventory (CCI), and the majority agreed that every item measured appropriate cybersecurity knowledge. We gave the CCI to 142 students from six different institutions taking a first cybersecurity course either online or proctored by the professor of the course. We used Classical Test Theory to evaluate the quality of the CCI. This evaluation showed that the CCI is sufficiently reliable for measuring students' knowledge of cybersecurity and that the CCI may be too difficult as a whole. We describe the results of both the expert review and the pilot test in further detail and provide recommendations for the continued improvement of the CCI.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2019-08-22 without embargo terms","The student, Spencer Offenberger, accepted the attached license on 2019-04-08 at 17:59.","The student, Spencer Offenberger, submitted this Thesis for approval on 2019-04-08 at 18:15.","This Thesis was approved for publication on 2019-04-10 at 09:43.","DSpace SAF Submission Ingestion Package generated from Vireo submission #13525 on 2019-08-22 at 14:42:13","Made available in DSpace on 2019-08-23T19:51:44Z (GMT). No. of bitstreams: 3 OFFENBERGER-THESIS-2019.pdf: 3192347 bytes, checksum: 6ab1fae3ac253f4b0775873a34cc0967 (MD5) Spencer Thesis (5).zip: 3250798 bytes, checksum: 7984fd0553c98d92b56e14effa00e804 (MD5) LICENSE.txt: 4216 bytes, checksum: 53e6613ae27c86b9688cf00fe6d1744f (MD5) Previous issue date: 2019-04-10"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Validating a concept inventory for cybersecurity"]}]}],"canonical_facts":{"dc:contributor":["Loui, Michael"],"dc:creator":["Offenberger, Spencer"],"dc:date":["2019-08-23T19:51:44Z","2019-04-10","2019-05"],"dc:description":["The validity of a concept inventory is imperative to its adoption by the education community. In this thesis, we evaluate the validity of the Cybersecurity Concept Inventory for assessing student knowledge of core cybersecurity concepts after a first course on the topic. Our evaluation involved expert review and student performance data. A panel of 12 experts in cybersecurity reviewed each item of the Cybersecurity Concept Inventory (CCI), and the majority agreed that every item measured appropriate cybersecurity knowledge. We gave the CCI to 142 students from six different institutions taking a first cybersecurity course either online or proctored by the professor of the course. We used Classical Test Theory to evaluate the quality of the CCI. This evaluation showed that the CCI is sufficiently reliable for measuring students' knowledge of cybersecurity and that the CCI may be too difficult as a whole. We describe the results of both the expert review and the pilot test in further detail and provide recommendations for the continued improvement of the CCI.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2019-08-22 without embargo terms","The student, Spencer Offenberger, accepted the attached license on 2019-04-08 at 17:59.","The student, Spencer Offenberger, submitted this Thesis for approval on 2019-04-08 at 18:15.","This Thesis was approved for publication on 2019-04-10 at 09:43.","DSpace SAF Submission Ingestion Package generated from Vireo submission #13525 on 2019-08-22 at 14:42:13","Made available in DSpace on 2019-08-23T19:51:44Z (GMT). No. of bitstreams: 3 OFFENBERGER-THESIS-2019.pdf: 3192347 bytes, checksum: 6ab1fae3ac253f4b0775873a34cc0967 (MD5) Spencer Thesis (5).zip: 3250798 bytes, checksum: 7984fd0553c98d92b56e14effa00e804 (MD5) LICENSE.txt: 4216 bytes, checksum: 53e6613ae27c86b9688cf00fe6d1744f (MD5) Previous issue date: 2019-04-10"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/104793"],"dc:language":["en"],"dc:rights":["Copyright 2019 Spencer Offenberger"],"dc:subject":["Cybersecurity Education, Cybersecurity Assessment Tools (CATS) Project, Cybersecurity Concept Inventory (CCI), Assessment Validation"],"dc:title":["Validating a concept inventory for cybersecurity"],"dc:type":["text"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:42Z"}