Navigating the Complexities of Algorithmic Auditing: Challenges and Considerations

The field of algorithmic auditing is witnessing remarkable growth in response to concerns around discrimination-related harms exhibited by AI systems. However, this expansion has brought ambiguity regarding the definition of "audit" and the scope of evaluations. Although algorithmic audits involve various activities, defining an effective audit can be complicated due to normative, technical, and resource limitations. Challenges abound, from the lack of standardized language to diverse auditor characteristics. Nevertheless, the need for holistic evaluation is imperative as the societal impacts of algorithms become more apparent. Bridging theory and practice, this dissertation seeks to provide insights into and considerations for the algorithmic auditing community. By drawing on the history of audit studies in the social sciences, confronting the challenges of performing an audit in practice, and investigating the broader auditing ecosystem, it explores questions around the purpose of an audit, methodologies and best practices, available resources, community growth, and accountability. By doing so, it aims to improve the efficacy of AI audits and accountability for AI systems.

Name thesis:degree_name

Ph. D., Information Science

Level thesis:degree_level

Doctor of Philosophy

Discipline thesis:degree_discipline

Information Science

Grantor

Cornell University

Year dc:date.issued

2023

Author dc:creator

• Vecchione, Briana

Committee members dc:contributor.committeemember

• Barocas, Solon
• Kleinberg, Jon

• AI auditing
• algorithmic auditing

Statement dc:rights

• Attribution 4.0 International

Licence dc:rights.uri

• https://creativecommons.org/licenses/by/4.0/

Language dc:language.iso

en

DOI

http://doi.org/10.7298/9826-gh79

Dc Identifier Other

ProQuest Submission ID: 14034
ProQuest Publication ID: 30689365

OAI identifier oai:identifier

oai:ecommons.cornell.edu:1813/115757