Multi-object visual-inertial odometry system for an unmanned vehicle

Abstract

Multi-object visual-inertial odometry system for an unmanned vehicle

Cai R., Jin J.,Bobkov A.V.

Incoming article date: 15.07.2025

This paper is devoted to the construction of a visual-inertial odometry system for an unmanned vehicle using both binocular cameras and inertial sensors as an information source, which would be able to simultaneously determine the vehicle's own position and the relative position of other road users. To ensure accurate and continuous localization, it is proposed to use an inertial navigation system and two types of image keypoints. Deep learning models are used to accurately and reliably track keypoints. To achieve efficient and reliable matching of objects between two frames, a multi-level data association mechanism is proposed that takes into account possible errors of various system components. The experimental results demonstrate the feasibility and application potential of the proposed system.

Keywords: multi-object visual-inertial odometry, localization, data association, tracking of 3D dynamic objects