{"id":{"repo_id":"uwtsd","oai_identifier":"oai:repository.uwtsd.ac.uk:4222"},"canonical_url":"https://search.dev.ndltd.org/etd/uwtsd/oai:repository.uwtsd.ac.uk:4222","repository":{"repo_id":"uwtsd","name":"University of Wales Trinity Saint David","base_url":"https://repository.uwtsd.ac.uk/cgi/oai2"},"display":{"title":"Can an Agentic AI System Increase Willingness to Engage with Support Services in Wales?","abstract":"Accessing support in Wales is often hampered by a lengthy, confusing application process. Many are unsure of their eligibility or are nervous about how to start. This study aims to develop an agentic AI system capable of eligibility assessment, population of application form fields, and complete annotated PDF form generation. The system presents an easy-to-use conversational interface that employs a non-linear workflow for information gathering and follow-up questions. The system uses Lang Graph’s state graph framework, paired with custom tools and structured input and output via Pydantic models. A novel approach to agentic PDF manipulation is proposed, leveraging deterministic tooling and the large language model’s core strength in information extraction. System testing demonstrated high performance with fields consistently populated successfully and documents annotated precisely. Usability testing through a pre-post intervention study demonstrated a large effect size (Cohen’s d = 1.02), suggesting that the system meaningfully increased participants’ willingness to engage. Unfortunately, while the system was effective in eligibility assessment and form generation, critical challenges were identified, such as hallucinations, user interface blindness, and systemic risks. The findings suggest that while the system shows promise in improving accessibility, there are fundamental risks to address before safe and trustworthy deployment is feasible.","abstract_html":"Accessing support in Wales is often hampered by a lengthy, confusing application process. Many are unsure of their eligibility or are nervous about how to start. This study aims to develop an agentic AI system capable of eligibility assessment, population of application form fields, and complete annotated PDF form generation. The system presents an easy-to-use conversational interface that employs a non-linear workflow for information gathering and follow-up questions. The system uses Lang Graph’s state graph framework, paired with custom tools and structured input and output via Pydantic models. A novel approach to agentic PDF manipulation is proposed, leveraging deterministic tooling and the large language model’s core strength in information extraction. System testing demonstrated high performance with fields consistently populated successfully and documents annotated precisely. Usability testing through a pre-post intervention study demonstrated a large effect size (Cohen’s d = 1.02), suggesting that the system meaningfully increased participants’ willingness to engage. Unfortunately, while the system was effective in eligibility assessment and form generation, critical challenges were identified, such as hallucinations, user interface blindness, and systemic risks. The findings suggest that while the system shows promise in improving accessibility, there are fundamental risks to address before safe and trustworthy deployment is feasible.","abstract_has_math":false,"creators":["Watkins, Bradley"],"institution":"University of Wales Trinity Saint David","degree_name":"msc","degree_level":"masters","degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2026,"date_issued":"2026-02","date_published":"2026-02","updated_at":"2026-07-24T05:53:11Z","subjects":["QA76 Meddalwedd Cyfrifiadurol"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier.grantnumber","label":"Dc Identifier Grantnumber","values":["UWTSD"],"render_values":[{"text":"UWTSD","href":null,"code":true}]}]},"links":{"outbound_url":"https://doi.org/10.82227/repository.uwtsd.ac.uk.00004222","outbound_label":"DOI","outbound_source":"dc:identifier.doi"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.sponsor","label":"Sponsor","values":["University of Wales Trinity Saint David"]},{"key":"dc:creator","label":"Author","values":["Watkins, Bradley"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2026-02-19"]},{"key":"dc:date.issued","label":"Date","values":["2026-02"]},{"key":"dc:publisher.commercial","label":"Dc Publisher Commercial","values":["University of Wales Trinity Saint David"]},{"key":"dc:publisher.department","label":"Dc Publisher Department","values":["Traethodau Meistr","Wales Institute for Science and Art: Applied Computing"]},{"key":"dc:publisher.institution","label":"Dc Publisher Institution","values":["University of Wales Trinity Saint David"]},{"key":"dc:relation.isreferencedby","label":"Dc Relation Isreferencedby","values":["https://repository.uwtsd.ac.uk/id/eprint/4222/"]},{"key":"dc:type","label":"Dc Type","values":["Gosodiad"]},{"key":"dc:type.qualificationlevel","label":"Dc Type Qualificationlevel","values":["masters"]},{"key":"dc:type.qualificationname","label":"Dc Type Qualificationname","values":["msc"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["QA76 Meddalwedd Cyfrifiadurol"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.doi","label":"DOI","values":["10.82227/repository.uwtsd.ac.uk.00004222"]},{"key":"dc:identifier.grantnumber","label":"Dc Identifier Grantnumber","values":["UWTSD"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://repository.uwtsd.ac.uk/id/eprint/4222/1/Watkins_B_MSc_Thesis.pdf"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Accessing support in Wales is often hampered by a lengthy, confusing application process. Many are unsure of their eligibility or are nervous about how to start. This study aims to develop an agentic AI system capable of eligibility assessment, population of application form fields, and complete annotated PDF form generation. The system presents an easy-to-use conversational interface that employs a non-linear workflow for information gathering and follow-up questions. The system uses Lang Graph’s state graph framework, paired with custom tools and structured input and output via Pydantic models. A novel approach to agentic PDF manipulation is proposed, leveraging deterministic tooling and the large language model’s core strength in information extraction. System testing demonstrated high performance with fields consistently populated successfully and documents annotated precisely. Usability testing through a pre-post intervention study demonstrated a large effect size (Cohen’s d = 1.02), suggesting that the system meaningfully increased participants’ willingness to engage. Unfortunately, while the system was effective in eligibility assessment and form generation, critical challenges were identified, such as hallucinations, user interface blindness, and systemic risks. The findings suggest that while the system shows promise in improving accessibility, there are fundamental risks to address before safe and trustworthy deployment is feasible."]},{"key":"dc:format","label":"Dc Format","values":["text"]},{"key":"dc:title","label":"Title","values":["Can an Agentic AI System Increase Willingness to Engage with Support Services in Wales?"]}]}],"canonical_facts":{"dc:contributor.sponsor":["University of Wales Trinity Saint David"],"dc:creator":["Watkins, Bradley"],"dc:date":["2026-02-19"],"dc:date.issued":["2026-02"],"dc:description.abstract":["Accessing support in Wales is often hampered by a lengthy, confusing application process. Many are unsure of their eligibility or are nervous about how to start. This study aims to develop an agentic AI system capable of eligibility assessment, population of application form fields, and complete annotated PDF form generation. The system presents an easy-to-use conversational interface that employs a non-linear workflow for information gathering and follow-up questions. The system uses Lang Graph’s state graph framework, paired with custom tools and structured input and output via Pydantic models. A novel approach to agentic PDF manipulation is proposed, leveraging deterministic tooling and the large language model’s core strength in information extraction. System testing demonstrated high performance with fields consistently populated successfully and documents annotated precisely. Usability testing through a pre-post intervention study demonstrated a large effect size (Cohen’s d = 1.02), suggesting that the system meaningfully increased participants’ willingness to engage. Unfortunately, while the system was effective in eligibility assessment and form generation, critical challenges were identified, such as hallucinations, user interface blindness, and systemic risks. The findings suggest that while the system shows promise in improving accessibility, there are fundamental risks to address before safe and trustworthy deployment is feasible."],"dc:format":["text"],"dc:identifier.doi":["10.82227/repository.uwtsd.ac.uk.00004222"],"dc:identifier.grantnumber":["UWTSD"],"dc:identifier.uri":["https://repository.uwtsd.ac.uk/id/eprint/4222/1/Watkins_B_MSc_Thesis.pdf"],"dc:publisher.commercial":["University of Wales Trinity Saint David"],"dc:publisher.department":["Traethodau Meistr","Wales Institute for Science and Art: Applied Computing"],"dc:publisher.institution":["University of Wales Trinity Saint David"],"dc:relation.isreferencedby":["https://repository.uwtsd.ac.uk/id/eprint/4222/"],"dc:subject":["QA76 Meddalwedd Cyfrifiadurol"],"dc:title":["Can an Agentic AI System Increase Willingness to Engage with Support Services in Wales?"],"dc:type":["Gosodiad"],"dc:type.qualificationlevel":["masters"],"dc:type.qualificationname":["msc"]},"updated_at":"2026-07-24T05:53:11Z"}