TY - GEN
T1 - Affective abstract image classification and retrieval using multiple kernel learning
AU - Zhang, He
AU - Yang, Zhirong
AU - Gon̈en, Mehmet
AU - Koskela, Markus
AU - Laaksonen, Jorma
AU - Honkela, Timo
AU - Oja, Erkki
PY - 2013/12/1
Y1 - 2013/12/1
N2 - Emotional semantic image retrieval systems aim at incorporating the user's affective states for responding adequately to the user's interests. One challenge is to select features specific to image affect detection. Another challenge is to build effective learning models or classifiers to bridge the so-called "affective gap". In this work, we study the affective classification and retrieval of abstract images by applying multiple kernel learning framework. An image can be represented by different feature spaces and multiple kernel learning can utilize all these feature representations simultaneously (i.e., multiview learning), such that it jointly learns the feature representation weights and corresponding classifier in an intelligent manner. Our experimental results on two abstract image datasets demonstrate the advantage of the multiple kernel learning framework for image affect detection in terms of feature selection, classification performance, and interpretation.
AB - Emotional semantic image retrieval systems aim at incorporating the user's affective states for responding adequately to the user's interests. One challenge is to select features specific to image affect detection. Another challenge is to build effective learning models or classifiers to bridge the so-called "affective gap". In this work, we study the affective classification and retrieval of abstract images by applying multiple kernel learning framework. An image can be represented by different feature spaces and multiple kernel learning can utilize all these feature representations simultaneously (i.e., multiview learning), such that it jointly learns the feature representation weights and corresponding classifier in an intelligent manner. Our experimental results on two abstract image datasets demonstrate the advantage of the multiple kernel learning framework for image affect detection in terms of feature selection, classification performance, and interpretation.
KW - Group lasso
KW - Image affect
KW - Image classification and retrieval
KW - Low-level image features
KW - Multiple kernel learning
UR - http://www.scopus.com/inward/record.url?scp=84893413775&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84893413775&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-42051-1_22
DO - 10.1007/978-3-642-42051-1_22
M3 - Conference contribution
AN - SCOPUS:84893413775
SN - 9783642420504
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 166
EP - 175
BT - Neural Information Processing - 20th International Conference, ICONIP 2013, Proceedings
T2 - 20th International Conference on Neural Information Processing, ICONIP 2013
Y2 - 3 November 2013 through 7 November 2013
ER -