Predicting emotional states of images using Bayesian multiple kernel learning

He Zhang, Mehmet Gönen, Zhirong Yang, Erkki Oja

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Images usually convey information that can influence people's emotional states. Such affective information can be used by search engines and social networks for better understanding the user's preferences. We propose here a novel Bayesian multiple kernel learning method for predicting the emotions evoked by images. The proposed method can make use of different image features simultaneously to obtain a better prediction performance, with the advantage of automatically selecting important features. Specifically, our method has been implemented within a multilabel setup in order to capture the correlations between emotions. Due to its probabilistic nature, our method is also able to produce probabilistic outputs for measuring a distribution of emotional intensities. The experimental results on the International Affective Picture System (IAPS) dataset show that the proposed approach achieves a bette classification performance and provides a more interpretable feature selection capability than the state-of-the-art methods.

Original languageEnglish (US)
Title of host publicationNeural Information Processing - 20th International Conference, ICONIP 2013, Proceedings
Pages274-282
Number of pages9
EditionPART 3
DOIs
StatePublished - Dec 1 2013
Event20th International Conference on Neural Information Processing, ICONIP 2013 - Daegu, Korea, Republic of
Duration: Nov 3 2013Nov 7 2013

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 3
Volume8228 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other20th International Conference on Neural Information Processing, ICONIP 2013
CountryKorea, Republic of
CityDaegu
Period11/3/1311/7/13

Keywords

  • Image emotion
  • Low-level image features
  • Multiple kernel learning
  • Multiview learning
  • Variational approximation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Predicting emotional states of images using Bayesian multiple kernel learning'. Together they form a unique fingerprint.

  • Cite this

    Zhang, H., Gönen, M., Yang, Z., & Oja, E. (2013). Predicting emotional states of images using Bayesian multiple kernel learning. In Neural Information Processing - 20th International Conference, ICONIP 2013, Proceedings (PART 3 ed., pp. 274-282). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8228 LNCS, No. PART 3). https://doi.org/10.1007/978-3-642-42051-1_35