On Performance and Trustworthiness of AI: from inverse problems to Artificial General Intelligence
type: CreativeWork
description: Artificial Intelligence (AI) has emerged as a powerful problem-solving tool, both in the mathematical field of inverse problems and, more recently, in broader applications with the advent of modern chatbots. However, AI systems have repeatedly been shown to be prone to producing hallucinations, plausible yet false solutions that could be mistaken for correct answers. This vulnerability undermines trust in AI systems, and thus an examination of the trustworthiness of AI is urgently needed. This thesis investigates the concept of trust in AI, examining its performance, stability, verifiability, and explainability. Starting with an in-depth assessment of the best performance achievable by an AI for inverse problems, the analysis of trustworthy AI culminates in the Consistent Reasoning Paradox. This paradox shows the intricacy involved in creating an artificial general intelligence capable of human-like behaviour - the goal modern chatbots aim to achieve. The resolution to the paradox lies in providing AI with the ability to confess `I don't know' when relevant, and thus the concept of an `I don't know' function is introduced as a necessary tool to develop reliable and trustworthy AI systems.
abstract: Artificial Intelligence (AI) has emerged as a powerful problem-solving tool, both in the mathematical field of inverse problems and, more recently, in broader applications with the advent of modern chatbots. However, AI systems have repeatedly been shown to be prone to producing hallucinations, plausible yet false solutions that could be mistaken for correct answers. This vulnerability undermines trust in AI systems, and thus an examination of the trustworthiness of AI is urgently needed. This thesis investigates the concept of trust in AI, examining its performance, stability, verifiability, and explainability. Starting with an in-depth assessment of the best performance achievable by an AI for inverse problems, the analysis of trustworthy AI culminates in the Consistent Reasoning Paradox. This paradox shows the intricacy involved in creating an artificial general intelligence capable of human-like behaviour - the goal modern chatbots aim to achieve. The resolution to the paradox lies in providing AI with the ability to confess `I don't know' when relevant, and thus the concept of an `I don't know' function is introduced as a necessary tool to develop reliable and trustworthy AI systems.
author: Campodonico, Paolo
language: eng
keywords: Consistent Reasoning Paradox, Kernel size, Trustworthy AI, Artificial General Intelligence (AGI), AI Trust, AI Hallucinations, Inverse Problems, AI Performance Bounds
license: https://apollo8-f-pro.lib.cam.ac.uk/bitstreams/b207dff8-80a9-4902-8d44-4105c1a170fa/download
license: http://purl.org/NET/rdflicense/allrightsreserved
date published: 2024-09-30
date modified: 2026-07-22T22:24:31Z
provider: Cambridge University
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: University of Cambridge

PropertyValue
property ID: DOI
value: 10.17863/CAM.116963