Multi-sensory face biometric fusion (for personal identification)

Oggie Arandelovic*, Riad Hammoud, Roberto Cipolla

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

22 Citations (Scopus)


The objective of this work is to recognize faces using sets of images in visual and thermal spectra. This is challenging because the former is greatly affected by illumination changes, while the latter frequently contains occlusions due to eye-wear and is inherently less discriminative. Our method is based on a fusion of the two modalities. Specifically: we examine (i) the effects of preprocessing of data in each domain, (ii) the fusion of holistic and local facial appearance, and (iii) propose an algorithm for combining the similarity scores in visual and thermal spectra in the presence of prescription glasses and significant pose variations, using a small number of training images (5-7). Our system achieved a high correct identification rate of 97% on a freely available test set of 29 individuals and extreme illumination changes.

Original languageEnglish
Title of host publicationProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Publication statusPublished - 2006
Event2006 Conference on Computer Vision and Pattern Recognition Workshops - New York, NY, United States
Duration: 17 Jun 200622 Jun 2006


Conference2006 Conference on Computer Vision and Pattern Recognition Workshops
Country/TerritoryUnited States
CityNew York, NY


Dive into the research topics of 'Multi-sensory face biometric fusion (for personal identification)'. Together they form a unique fingerprint.

Cite this