Deep Learning-Based Visual Localisation and Navigation for the Voyager Mobile Robotic Platform
type: CreativeWork
description: Autonomous ground vehicles (AGVs) are becoming increasingly popular in industrial and research environments and are employed to perform repetitive or hazardous tasks without direct human intervention. One major challenge in autonomous navigation lies in reliably estimating a robot’s position and orientation, known as localisation. This challenge is particularly notable in indoor environments where satellite-based positioning systems, such as Global Positioning System (GPS), are unavailable. This thesis presents a deep learning-based visual localisation method and navigation stack implementation for the Voyager mobile robotic platform, which aims to solve a variation of the kidnapped robot problem. A convolutional neural network (CNN), specifically a fine-tuned ResNet-50 model, is trained for visual place recognition using images captured from the robot’s environment. The model extracts discriminative feature embeddings which are stored in a FAISS index alongside corresponding position and orientation data obtained during a LiDAR-based (Light Detection and Ranging) mapping phase. During localisation, the robot captures a live image, from which an embedding is extracted using the fine-tuned ResNet-50 model and queried with stored index to estimate the most likely pose of the mobile robot. This pose serves as an initial pose estimate for the popular Real-Time Appearance-Based Mapping (RTAB-Map) Simultaneous Localisation and Mapping (SLAM) system, which then refines the localisation estimate using LiDAR measurements and provides continuous, accurate pose estimates for navigation. The localisation system is integrated with Robot Operating System 2 (ROS2) and its native navigation stack, Navigation 2 (Nav2), enabling the robot to plan and execute collision-free paths within the known environment. Development and verification was performed both in the Gazebo simulation environment and on the physical Voyager platform. Experimental results show that the proposed system succ…
abstract: Autonomous ground vehicles (AGVs) are becoming increasingly popular in industrial and research environments and are employed to perform repetitive or hazardous tasks without direct human intervention. One major challenge in autonomous navigation lies in reliably estimating a robot’s position and orientation, known as localisation. This challenge is particularly notable in indoor environments where satellite-based positioning systems, such as Global Positioning System (GPS), are unavailable. This thesis presents a deep learning-based visual localisation method and navigation stack implementation for the Voyager mobile robotic platform, which aims to solve a variation of the kidnapped robot problem. A convolutional neural network (CNN), specifically a fine-tuned ResNet-50 model, is trained for visual place recognition using images captured from the robot’s environment. The model extracts discriminative feature embeddings which are stored in a FAISS index alongside corresponding position and orientation data obtained during a LiDAR-based (Light Detection and Ranging) mapping phase. During localisation, the robot captures a live image, from which an embedding is extracted using the fine-tuned ResNet-50 model and queried with stored index to estimate the most likely pose of the mobile robot. This pose serves as an initial pose estimate for the popular Real-Time Appearance-Based Mapping (RTAB-Map) Simultaneous Localisation and Mapping (SLAM) system, which then refines the localisation estimate using LiDAR measurements and provides continuous, accurate pose estimates for navigation. The localisation system is integrated with Robot Operating System 2 (ROS2) and its native navigation stack, Navigation 2 (Nav2), enabling the robot to plan and execute collision-free paths within the known environment. Development and verification was performed both in the Gazebo simulation environment and on the physical Voyager platform. Experimental results show that the proposed system succ…
author: Daneels, Alexander Luke
language: en
date published: 2026-03
date modified: 2026-07-24T04:40:06Z
provider: Stellenbosch University
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: Stellenbosch : Stellenbosch University