Hybrid SOM based cross-modal retrieval exploiting Hebbian learning

Parminder Kaur*, Avleen Kaur Malhi, Husanbir Singh Pannu

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

5 Citations (Scopus)


Lately, cross-modal retrieval has attained plenty of attention due to enormous multi-modal data generation every day in the form of audio, video, image, and text. One vital requirement of cross-modal retrieval is to reduce the heterogeneity gap among various modalities so that one modality's results can be efficiently retrieved from the other. So, a novel unsupervised cross-modal retrieval framework based on associative learning has been proposed in this paper where two traditional SOMs are trained separately for images and collateral text and then they are associated together using the Hebbian learning network to facilitate the cross-modal retrieval process. Experimental outcomes on a popular Wikipedia dataset demonstrate that the presented technique outshines various existing state-of-the-art approaches.

Original languageEnglish
Article number108014
Pages (from-to)1-18
Number of pages18
Publication statusPublished - 5 Mar 2022
MoE publication typeA1 Journal article-refereed


  • Cross-modal retrieval
  • Hebbian learning
  • Machine learning
  • Self organizing maps
  • Zernike moments


Dive into the research topics of 'Hybrid SOM based cross-modal retrieval exploiting Hebbian learning'. Together they form a unique fingerprint.

Cite this