2026-04-05T10:53:16Zhttps://recercat.cat/oai/request

oai:recercat.cat:10256/283692026-03-07T19:50:53Zcom_2072_452966com_2072_2054col_2072_452969

Enhancing indoor mapping and localization in specular rich environments using deep learning and sensor fusion Hernández, Renatto Tommasi Detectors òptics Optical detectors Digital mapping Cartografia digital Robots -- Sistemes de navegació Robots -- Navigation systems LiDAR odometry Indoor localization SLAM Specular reflections Sensors òptics tridimensionals Sensors Aprenentatge profund (Aprenentatge automàtic) Deep learning (Machine learning) Algorismes Algorithms Robotic indoor mapping and localization are significantly challenged in environ ments with highly reflective or specular surfaces, which are common in hospitals and industrial settings. Specular reflections introduce severe artifacts in depth data from RGB-D sensors and degrade the performance of visual Simultaneous Localization and Mapping (SLAM) systems by creating unreliable features. This thesis presents a com prehensive solution to enhance robotic navigation in such specular-rich environments through a combination of deep learning and multi-sensor fusion. We propose a real-time filtering algorithm, RT-SpecFilter, which uses a Support Vector Machine (SVM) to detect and mitigate specular artifacts in point clouds from an Intel RealSense D435 camera. Furthermore, we conduct a comparative analysis of feature detectors, identifying Super Point as the most robust for environments with specular highlights. Finally, we develop the Multicam SP-VO system that leverages four wide FoV cameras and fuses their motion estimates with wheel odometry data using a pose-graph optimization framework. Exper imental results demonstrate that the proposed system significantly reduces orientation drift improves localization accuracy compared to reliance on wheel odometry alone and mitigates the specular artifacts during mapping, thereby enabling more robust and reli able autonomous navigation in challenging indoor spaces. 9 2026-03-07T19:50:53Z 2026-03-07T19:50:53Z 2025-06 info:eu-repo/semantics/masterThesis https://hdl.handle.net/10256/28369 Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ info:eu-repo/semantics/openAccess Universitat de Girona. Institut de Recerca en Visió per Computador i Robòtica Erasmus Mundus Joint Master in Intelligent Field Robotic Systems (IFROS)