Visual Attention and Applications in Multimedia Technologies

Patrick Le Callet (1) , Ernest Niebur (2)

1 irccyn-ivc
2 Mind/Brain institute and Department of Neurosciences

Making technological advances in the field of human-machine interactions requires that the capabilities and limitations of the human perceptual system be taken into account. The focus of this report is an important mechanism of perception, visually selective attention, which is becoming more and more important for multimedia applications. We introduce the concept of visual attention and describe its underlying mechanisms. In particular, we introduce the concepts of overt and covert visual attention, and of bottom-up and top-down processing. Challenges related to modeling visual attention and their validation using ad hoc ground truth are also discussed. Examples of the usage of visual attention models in image and video processing are presented. We emphasize multimedia delivery, retargeting and quality assessment of image and video, medical imaging, and the field of stereoscopic 3-D image applications.

Mots clés: bottom-up processing; human computer interaction; human factors; human perceptual system; human visual attention; Image analysis; Image coding; image communication; image processing; medical imaging; Multimedia communication; multimedia computing; multimedia delivery; multimedia systems; multimedia technologies; quality assessment; stereo vision; stereoscopic 3D image applications; top-down processing; video processing; Video signal processing; visual system; VIsualization; visually selective attention

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Patrick Le Callet, Ernest Niebur. Visual Attention and Applications in Multimedia Technologies. Proceedings of the IEEE, 2013, 101 (9), pp.2058--2067. ⟨10.1109/JPROC.2013.2265801⟩. ⟨hal-00951728⟩