Integrating Open-Source Retrieval-Augmented Generation with Large Language Models for Business, Market and Responsibility Insights

This thesis investigates the integration of open-source retrieval-augmented generation (RAG) with large language models (LLMs) on the Databricks platform. The aim is to provide advanced insights in the fields of business, market, and responsibility intelligence. The research explores combining RAG and LLMs to improve business intelligence by leveraging internal and external data sources. The integrated system uses unstructured data such as market reports and customer feedback to offer deeper insights into market trends, consumer behavior, and corporate responsibilities and aid in company employees everyday work. Methodologically, the thesis focuses on system architecture, data source selection, and technical implementation within the Databricks environment. Use-cases such as expert assistance, market analysis, and customer feedback answering, demonstrating the practical benefits of these models for business operations are outlined. The research discusses technical challenges, evaluation strategies, and ethical considerations. The results emphasize how this integration aim to enhance data analysis and decision-making and to improve the ability to generate insights. The system’s applications at Metsä Tissue highlight the strategic and operational advantages of implementing RAG with LLMs. The thesis provides a roadmap for using advanced AI techniques to improve business intelligence in various domains while considering ethical implications and future research pathways. In the development of this master’s thesis, the advanced capabilities of ChatGPT-4 and ChatGPT 4o have been utilized to assist in various stages of the writing process. These language models aided in planning the structure contents of the thesis, rephrasing text to enhance clarity and coherence, and checking the grammar to ensure the quality of academic writing.

Grantor dc:publisher

Helsingin yliopisto

Year dc:date.issued

2024

Author dc:creator

• Roinisto, Henna

Contributors dc:contributor

• Helsingin yliopisto, Matemaattis-luonnontieteellinen tiedekunta
• University of Helsinki, Faculty of Science
• Helsingfors universitet, Matematisk-naturvetenskapliga fakulteten

• large language models
• retrieval-augmented generation
• Databricks
• business intelligence

Language dc:language.iso

eng

Identifier URI

URN:NBN:fi:hulib-202507013357

OAI identifier oai:identifier

oai:helda.helsinki.fi:10138/598631