ARTSeg: Employing Attention for Thermal Images Semantic Segmentation

Farzeen Munir, Shoaib Azam, Unse Fatima, Moongu Jeon

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review


The research advancements have made the neural network algorithms deployed in the autonomous vehicle to perceive the surrounding. The standard exteroceptive sensors that are utilized for the perception of the environment are cameras and Lidar. Therefore, the neural network algorithms developed using these exteroceptive sensors have provided the necessary solution for the autonomous vehicle’s perception. One major drawback of these exteroceptive sensors is their operability in adverse weather conditions, for instance, low illumination and night conditions. The useability and affordability of thermal cameras in the sensor suite of the autonomous vehicle provide the necessary improvement in the autonomous vehicle’s perception in adverse weather conditions. The semantics of the environment benefits the robust perception, which can be achieved by segmenting different objects in the scene. In this work, we have employed the thermal camera for semantic segmentation. We have designed an attention-based Recurrent Convolution Network (RCNN) encoder-decoder architecture named ARTSeg for thermal semantic segmentation. The main contribution of this work is the design of encoder-decoder architecture, which employ units of RCNN for each encoder and decoder block. Furthermore, additive attention is employed in the decoder module to retain high-resolution features and improve the localization of features. The efficacy of the proposed method is evaluated on the available public dataset, showing better performance with other state-of-the-art methods in mean intersection over union (IoU).
Original languageEnglish
Title of host publicationAsian Conference on Pattern Recognition
Publication statusPublished - 2022
MoE publication typeA4 Conference publication
EventAsian Conference on Pattern Recognition - Jeju Island, Korea, Republic of
Duration: 9 Nov 202112 Nov 2021


ConferenceAsian Conference on Pattern Recognition
Country/TerritoryKorea, Republic of
CityJeju Island


  • thermal images
  • semantic segmentation
  • Recurrent convolution neural network
  • Attention


Dive into the research topics of 'ARTSeg: Employing Attention for Thermal Images Semantic Segmentation'. Together they form a unique fingerprint.

Cite this