COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE AND SYSTEMS ANALYSIS

UAV Inertial Navigation Correction System Based on Deep Learning for Matching Camera Images and Satellite Imagery

Authors

Ya. M. Matviychuk ORCID 0009-0001-9727-5080
Lviv Polytechnic National University ROR
V. P. Iatsyshyn ORCID 0009-0001-9727-5080
Lviv Polytechnic National University ROR
V. M. Taraban ORCID 0009-0006-8925-8113
Lviv Polytechnic National University ROR
DOI https://doi.org/10.31649/1997-9266-2026-186-3-43-51

Keywords

autonomous navigation UAV GPS-denied INS correction deep learning convolutional neural network image matching satellite imagery Triplet Loss Raspberry Pi

Abstract

Reliable navigation of unmanned aerial vehicles (UAVs) is a critical function that relies heavily on GNSS signals. In electronic warfare (EW) environments, these signals are suppressed, leading to the loss of vehicles due to the uncontrolled accumulation of errors in onboard inertial navigation systems (INS). Existing visual localization methods are often computationally expensive and suboptimal for rural landscapes.

The aim of this work is the development and experimental validation of a computationally efficient hybrid autonomous geolocation system capable of correcting INS errors by matching images from an onboard camera with reference satellite imagery, with a focus on viability for low-resource onboard platforms.

A hybrid method combining INS data with discrete correction from a deep learning module is proposed. A custom dataset of flights in rural areas was collected and labeled. A comparative analysis of CNN architectures (VGG11, MobileNetV2, ResNet18) and loss functions for the cross-modal matching task was performed. The accuracy and performance of the final model were validated on a Raspberry Pi single-board computer.

It was experimentally demonstrated that Triplet Loss, thanks to its mechanism of selecting "negative" examples, forces the model to learn discriminative features, enabling it to distinguish visually similar areas of the landscape. In comparative testing of architectures, the VGG11 model trained with Triplet Loss showed the best accuracy, outperforming MobileNetV2 and ResNet18. When testing the correction mechanism with a simulated initial 10-meter INS drift, the VGG11-based system achieved an average error of 5.4 meters, successfully calculating the correction vector. On a real test route of 200 m, where the maximum error of the unmanaged INS reached 15.2 m, the proposed system reduced the maximum deviation to 8.5 m. Performance validation on a Raspberry Pi 4 confirmed computational suitability: a full correction cycle for a 224x224 image takes 2.5 seconds, and 10 seconds for 448x448, which is acceptable for periodic (non-continuous) coordinate refinement.

99 39

How to Cite

[1]
“UAV Inertial Navigation Correction System Based on Deep Learning for Matching Camera Images and Satellite Imagery”, Вісник ВПІ, no. 3, pp. 43–51, Jul. 2026, doi: 10.31649/1997-9266-2026-186-3-43-51.

Author Biographies

Ya. M. Matviychuk, Lviv Polytechnic National University

Dr Sc. (Eng.), Professor, Professor of the Chair of AIS

V. P. Iatsyshyn, Lviv Polytechnic National University

Post-Graduate Student, Assistant of the Chair of AIS

V. M. Taraban, Lviv Polytechnic National University

Student of the Institute of Computer Science and Information Technology

References

Conference on Robotics and Automation (ICRA), 2019, pp. 2974-2980. https://doi.org/10.1109/ICRA.2019.8793558 .
X. Qiu, D. Yang, S. Liao, S. Wang, and Y. Li, “Image moment extraction based aerial photo selection for UAV high-precision geolocation without GPS,” Measurement, no. 226, pp. 114141, 2024, https://doi.org/10.1016/j.measurement.2024.114141 .
J. Fan, et al., “A Cross-View Geo-Localization Algorithm Using UAV Image and Satellite Image,” Sensors, no. 24, issue 12, Чер 2024, https://doi.org/10.3390/s24123719 .
Z. Cui, et al., “A Novel Geo-Localization Method for UAV and Satellite Images Using Cross-View Consistent Attention,” Remote Sens., no.15, issue 19, Вер 2023, https://doi.org/10.3390/rs15194667 .
M. Bianchi, and T. D. Barfoot, “UAV Localization Using Autoencoded Satellite Images,” IEEE Robot. Autom. Lett., no. 6, issue 2, pp. 1761-1768, 2021, https://doi.org/10.1109/LRA.2021.3060397 .
N. Xue, L. Niu, X. Hong, Z. Li, L. Hoffaeller, and C. Pöpper, “DeepSIM: GPS Spoofing Detection on UAVs using Satellite Imagery Matching,” in Proceedings of the 36th Annual Computer Security Applications Conference, в ACSAC ’20. New York, NY, USA: Association for Computing Machinery, 2020, pp. 304-319. https://doi.org/10.1145/3427228.3427254 .
Z. Zheng, Y. Wei, and Y. Yang, “University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localization,” in Proceedings of the 28th ACM International Conference on Multimedia, в MM ’20. New York, NY, USA: Association for Computing Machinery, 2020, pp. 1395-1403. https://doi.org/10.1145/3394171.3413896 .
ArduPilot/pymavlink. (17, 01.2026). Python. ArduPilot. Дата звернення: 18, 2026. [Electronic resource]. Available: https://github.com/ArduPilot/pymavlink .
K. Simonyan, and A. Zisserman, “Very Deep Convolutional Networks for Large-Scale Image Recognition,” 10.04, 2015, arXiv: arXiv:1409.1556. https://doi.org/10.48550/arXiv.1409.1556 .
K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 770-778. Accessed:18, 01. 2026. [Electronic resource]. Available: https://openaccess.thecvf.com/content_cvpr_2016/html/He_Deep_Residual_Learning_CVPR_2016_paper.html .
M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, “MobileNetV2: Inverted Residuals and Linear Bottlenecks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 4510-4520. [Electronic resource]. Available: https://openaccess.thecvf.com/content_cvpr_2018/html/Sandler_MobileNetV2_Inverted_Residuals_CVPR_2018_paper.html Accessed: 18. 01 2026.
Triplet loss, Wikipedia. 07, 09, 2025. [Electronic resource]. Available: https://en.wikipedia.org/w/index.php?title=Triplet_loss&oldid=1310086175 . Accessed: 18. 01 2026.