Radar-Lidar Fusion for Object Detection by Designing Effective Convolution Networks

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu

Abstrakti

Object detection is a core component of perception systems, providing the ego vehicle with information about its surroundings to ensure safe route planning. While cameras and Lidar have significantly advanced perception systems, their performance can be limited in adverse weather conditions. In contrast, millimeter-wave technology enables radars to function effectively in such conditions. However, relying solely on radar for building a perception system doesn't fully capture the environment due to the data's sparse nature. To address this, sensor fusion strategies have been introduced. We propose a dual-branch framework to integrate radar and Lidar data for enhanced object detection. The primary branch focuses on extracting radar features, while the auxiliary branch extracts Lidar features. These are then combined using additive attention. Subsequently, the integrated features are processed through a novel Parallel Forked Structure (PFS) to manage scale variations. A region proposal head is then utilized for object detection. We evaluated the effectiveness of our proposed method on the Radiate dataset using COCO metrics. The results show that it surpasses state-of-the-art methods by 1.89% and 2.61% in favorable and adverse weather conditions, respectively. This underscores the value of radar-Lidar fusion in achieving precise object detection and localization, especially in challenging weather conditions.

AlkuperäiskieliEnglanti
Otsikko2023 IEEE 26th International Conference on Intelligent Transportation Systems, ITSC 2023
KustantajaIEEE
Sivut3575-3582
Sivumäärä8
ISBN (elektroninen)979-8-3503-9946-2
DOI - pysyväislinkit
TilaJulkaistu - 2024
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaIEEE International Conference on Intelligent Transportation Systems - Bilbao, Espanja
Kesto: 24 syysk. 202328 syysk. 2023
Konferenssinumero: 26

Julkaisusarja

NimiIEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC
ISSN (painettu)2153-0009
ISSN (elektroninen)2153-0017

Conference

ConferenceIEEE International Conference on Intelligent Transportation Systems
LyhennettäITSC
Maa/AlueEspanja
KaupunkiBilbao
Ajanjakso24/09/202328/09/2023

Sormenjälki

Sukella tutkimusaiheisiin 'Radar-Lidar Fusion for Object Detection by Designing Effective Convolution Networks'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä