Regularizing multiple kernel learning using response surface methodology

Mehmet Gönen, Ethem Alpaydn

Research output: Contribution to journalArticle

13 Scopus citations

Abstract

In recent years, several methods have been proposed to combine multiple kernels using a weighted linear sum of kernels. These different kernels may be using information coming from multiple sources or may correspond to using different notions of similarity on the same source. We note that such methods, in addition to the usual ones of the canonical support vector machine formulation, introduce new regularization parameters that affect the solution quality and, in this work, we propose to optimize them using response surface methodology on cross-validation data. On several bioinformatics and digit recognition benchmark data sets, we compare multiple kernel learning and our proposed regularized variant in terms of accuracy, support vector count, and the number of kernels selected. We see that our proposed variant achieves statistically similar or higher accuracy results by using fewer kernel functions and/or support vectors through suitable regularization; it also allows better knowledge extraction because unnecessary kernels are pruned and the favored kernels reflect the properties of the problem at hand.

Original languageEnglish (US)
Pages (from-to)159-171
Number of pages13
JournalPattern Recognition
Volume44
Issue number1
DOIs
StatePublished - Jan 1 2011

Keywords

  • Multiple kernel learning
  • Regularization
  • Response surface methodology
  • Support vector machine

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Regularizing multiple kernel learning using response surface methodology'. Together they form a unique fingerprint.

  • Cite this