Evaluator: Cloud-Based Software for Collaborative Evaluation

Evaluation is a process of investigating a project's implementation and results methodically and objectively. The evaluation problems in industry are extremely complicated and call for the examination of numerous qualitative and quantitative variables. Evaluators from different disciplines examine these variables. In order for the evaluators to collaborate during a broad evaluation process, there is a requirement for a collaborative evaluation methodology. In this research, a methodology for evaluation of any general application was implemented which is initially developed as part of a research effort supported by the Office of Naval Research. This technique is based on identifying the indicators to be applied in the evaluation of complex projects. In order to decrease complexity, these indicators are organized hierarchically which is modeled after the Analytic Hierarchy Process method. While at the top layer of this hierarchy is the subject we want to evaluate, towards the lower layers it is divided into more and more simple indicators. Therefore, the evaluators are responsible for assessing the project in terms of only the most simplified indicators. As a result, a precise evaluation which is not subject to human bias is accomplished. We have created a web-based application called Evaluator which allows the users to execute this methodology step by step. It simplifies the process by providing a user-friendly and easily accessible cloud-based platform in accordance with today's user experience principles. Although we have used this method and the software to evaluate projects, it is a tool that provides general usage for the assessment of a broad range of systems from various contexts.

Name thesis:degree_name

Master of Science

Level thesis:degree_level

masters

Discipline thesis:degree_discipline

Computer Science and Applications

Department dc:contributor.department

Computer Science and Applications

Grantor dc:publisher

Virginia Tech

Year dc:date.issued

2023

Author dc:creator

• Onen, Gokce

Chair dc:contributor.committeechair

• Balci, Osman

Committee members dc:contributor.committeemember

• Tilevich, Eli
• Barkhi, Reza

• Cloud software engineering
• collaborative evaluation
• evaluation methodology
• qualitative assessment

Statement dc:rights

• In Copyright

Licence dc:rights.uri

• http://rightsstatements.org/vocab/InC/1.0/

Language dc:language.iso

en

Dc Identifier Other

vt_gsexam:36207

OAI identifier oai:identifier

oai:vtechworks.lib.vt.edu:10919/113577