{"id":{"repo_id":"stellenbosch","oai_identifier":"oai:scholar.sun.ac.za:10019.1/136172"},"canonical_url":"https://search.dev.ndltd.org/etd/stellenbosch/oai:scholar.sun.ac.za:10019.1/136172","repository":{"repo_id":"stellenbosch","name":"Stellenbosch University","base_url":"https://scholar.sun.ac.za/server/oai/request"},"display":{"title":"Comparative evaluation of conventional search architectures and large language model-based approaches","abstract":"Search technologies are fundamental to how individuals and organisations access, interpret, and synthesise information. Conventional search engines such as Google and Bing rely on keyword-based indexing and symbolic ranking algorithms that provide transparency, verifiability, and computational efficiency. However, these systems often struggle to capture semantics, intent, and contextual nuance in more complex queries. In contrast, large language model (LLM)-based systems, including Gemini and chat generative pre-trained transformer (ChatGPT) with browsing, employ neural embeddings and generative reasoning to deliver contextualised and conversational outputs. While these advances enhance informational synthesis, they also introduce challenges such as hallucinations, opaque reasoning processes, and reduced efficiency. Hybrid models, exemplified by Google artificial intelligence overviews, attempt to bridge these paradigms by combining symbolic precision with generative flexibility. The purpose of this thesis is to conduct a quantitative comparative evaluation of conventional, hybrid, and LLM-based search systems. A dataset of user-centred queries was used to assess retrieval effectiveness, latency, and stability across factual, ambiguous, and informational categories. The findings highlight distinct trade-offs across systems. LLM-based search demonstrated the strongest performance in contextual reasoning and informational synthesis, but was limited by higher latency and variability. Conventional systems, while less accurate in complex queries, proved to be efficient and stable. Hybrid approaches offered the most balanced performance, integrating the efficiency of conventional search with the contextual depth of LLMs. This study concludes that hybrid systems, particularly Google AI Overviews, represent a promising pathway for advancing search technologies. By combining the reliability of conventional methods with the contextual intelligence of LLMs, they provide a more comprehensive foundation for addressing the diverse spectrum of modern search needs.","abstract_html":"Search technologies are fundamental to how individuals and organisations access, interpret, and synthesise information. Conventional search engines such as Google and Bing rely on keyword-based indexing and symbolic ranking algorithms that provide transparency, verifiability, and computational efficiency. However, these systems often struggle to capture semantics, intent, and contextual nuance in more complex queries. In contrast, large language model (LLM)-based systems, including Gemini and chat generative pre-trained transformer (ChatGPT) with browsing, employ neural embeddings and generative reasoning to deliver contextualised and conversational outputs. While these advances enhance informational synthesis, they also introduce challenges such as hallucinations, opaque reasoning processes, and reduced efficiency. Hybrid models, exemplified by Google artificial intelligence overviews, attempt to bridge these paradigms by combining symbolic precision with generative flexibility. The purpose of this thesis is to conduct a quantitative comparative evaluation of conventional, hybrid, and LLM-based search systems. A dataset of user-centred queries was used to assess retrieval effectiveness, latency, and stability across factual, ambiguous, and informational categories. The findings highlight distinct trade-offs across systems. LLM-based search demonstrated the strongest performance in contextual reasoning and informational synthesis, but was limited by higher latency and variability. Conventional systems, while less accurate in complex queries, proved to be efficient and stable. Hybrid approaches offered the most balanced performance, integrating the efficiency of conventional search with the contextual depth of LLMs. This study concludes that hybrid systems, particularly Google AI Overviews, represent a promising pathway for advancing search technologies. By combining the reliability of conventional methods with the contextual intelligence of LLMs, they provide a more comprehensive foundation for addressing the diverse spectrum of modern search needs.","abstract_has_math":false,"creators":["Molefe, Kgothatso Ishmael"],"institution":"Stellenbosch : Stellenbosch University","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":["Engelbrecht, Andries P."],"committee_chairs":[],"committee_members":[],"year":2026,"date_issued":"2026-03","date_published":"2026-03","updated_at":"2026-07-24T04:40:12Z","subjects":[],"languages":["en"],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://scholar.sun.ac.za/handle/10019.1/136172","outbound_label":"Repository record","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Engelbrecht, Andries P."]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["Stellenbosch University. Faculty of Science. Dept. of Computer Science."]},{"key":"dc:creator","label":"Author","values":["Molefe, Kgothatso Ishmael"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2026-04-24T08:14:16Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2026-04-24T08:14:16Z"]},{"key":"dc:date.issued","label":"Date","values":["2026-03"]},{"key":"dc:publisher","label":"Institution","values":["Stellenbosch : Stellenbosch University"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://scholar.sun.ac.za/handle/10019.1/136172"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Thesis (MSc)--Stellenbosch University, 2026.","Molefe, K. I. 2026. Comparative evaluation of conventional search architectures and large language model-based approaches. Unpublished masters thesis. Stellenbosch: Stellenbosch University [online]. Available: https://scholar.sun.ac.za/items/c69404a0-06e2-43a4-bf13-b928cd2e44ed"]},{"key":"dc:description.abstract","label":"Abstract","values":["Search technologies are fundamental to how individuals and organisations access, interpret, and synthesise information. Conventional search engines such as Google and Bing rely on keyword-based indexing and symbolic ranking algorithms that provide transparency, verifiability, and computational efficiency. However, these systems often struggle to capture semantics, intent, and contextual nuance in more complex queries. In contrast, large language model (LLM)-based systems, including Gemini and chat generative pre-trained transformer (ChatGPT) with browsing, employ neural embeddings and generative reasoning to deliver contextualised and conversational outputs. While these advances enhance informational synthesis, they also introduce challenges such as hallucinations, opaque reasoning processes, and reduced efficiency. Hybrid models, exemplified by Google artificial intelligence overviews, attempt to bridge these paradigms by combining symbolic precision with generative flexibility. The purpose of this thesis is to conduct a quantitative comparative evaluation of conventional, hybrid, and LLM-based search systems. A dataset of user-centred queries was used to assess retrieval effectiveness, latency, and stability across factual, ambiguous, and informational categories. The findings highlight distinct trade-offs across systems. LLM-based search demonstrated the strongest performance in contextual reasoning and informational synthesis, but was limited by higher latency and variability. Conventional systems, while less accurate in complex queries, proved to be efficient and stable. Hybrid approaches offered the most balanced performance, integrating the efficiency of conventional search with the contextual depth of LLMs. This study concludes that hybrid systems, particularly Google AI Overviews, represent a promising pathway for advancing search technologies. By combining the reliability of conventional methods with the contextual intelligence of LLMs, they provide a more comprehensive foundation for addressing the diverse spectrum of modern search needs."]},{"key":"dc:title","label":"Title","values":["Comparative evaluation of conventional search architectures and large language model-based approaches"]}]}],"canonical_facts":{"dc:contributor.advisor":["Engelbrecht, Andries P."],"dc:contributor.other":["Stellenbosch University. Faculty of Science. Dept. of Computer Science."],"dc:creator":["Molefe, Kgothatso Ishmael"],"dc:date.accessioned":["2026-04-24T08:14:16Z"],"dc:date.available":["2026-04-24T08:14:16Z"],"dc:date.issued":["2026-03"],"dc:description":["Thesis (MSc)--Stellenbosch University, 2026.","Molefe, K. I. 2026. Comparative evaluation of conventional search architectures and large language model-based approaches. Unpublished masters thesis. Stellenbosch: Stellenbosch University [online]. Available: https://scholar.sun.ac.za/items/c69404a0-06e2-43a4-bf13-b928cd2e44ed"],"dc:description.abstract":["Search technologies are fundamental to how individuals and organisations access, interpret, and synthesise information. Conventional search engines such as Google and Bing rely on keyword-based indexing and symbolic ranking algorithms that provide transparency, verifiability, and computational efficiency. However, these systems often struggle to capture semantics, intent, and contextual nuance in more complex queries. In contrast, large language model (LLM)-based systems, including Gemini and chat generative pre-trained transformer (ChatGPT) with browsing, employ neural embeddings and generative reasoning to deliver contextualised and conversational outputs. While these advances enhance informational synthesis, they also introduce challenges such as hallucinations, opaque reasoning processes, and reduced efficiency. Hybrid models, exemplified by Google artificial intelligence overviews, attempt to bridge these paradigms by combining symbolic precision with generative flexibility. The purpose of this thesis is to conduct a quantitative comparative evaluation of conventional, hybrid, and LLM-based search systems. A dataset of user-centred queries was used to assess retrieval effectiveness, latency, and stability across factual, ambiguous, and informational categories. The findings highlight distinct trade-offs across systems. LLM-based search demonstrated the strongest performance in contextual reasoning and informational synthesis, but was limited by higher latency and variability. Conventional systems, while less accurate in complex queries, proved to be efficient and stable. Hybrid approaches offered the most balanced performance, integrating the efficiency of conventional search with the contextual depth of LLMs. This study concludes that hybrid systems, particularly Google AI Overviews, represent a promising pathway for advancing search technologies. By combining the reliability of conventional methods with the contextual intelligence of LLMs, they provide a more comprehensive foundation for addressing the diverse spectrum of modern search needs."],"dc:identifier.uri":["https://scholar.sun.ac.za/handle/10019.1/136172"],"dc:language.iso":["en"],"dc:publisher":["Stellenbosch : Stellenbosch University"],"dc:title":["Comparative evaluation of conventional search architectures and large language model-based approaches"],"dc:type":["Thesis"]},"updated_at":"2026-07-24T04:40:12Z"}