Regularizing multiple kernel learning using response surface methodology

Mehmet Gönen, Ethem Alpaydn

Research output: Contribution to journalArticlepeer-review

14 Scopus citations


In recent years, several methods have been proposed to combine multiple kernels using a weighted linear sum of kernels. These different kernels may be using information coming from multiple sources or may correspond to using different notions of similarity on the same source. We note that such methods, in addition to the usual ones of the canonical support vector machine formulation, introduce new regularization parameters that affect the solution quality and, in this work, we propose to optimize them using response surface methodology on cross-validation data. On several bioinformatics and digit recognition benchmark data sets, we compare multiple kernel learning and our proposed regularized variant in terms of accuracy, support vector count, and the number of kernels selected. We see that our proposed variant achieves statistically similar or higher accuracy results by using fewer kernel functions and/or support vectors through suitable regularization; it also allows better knowledge extraction because unnecessary kernels are pruned and the favored kernels reflect the properties of the problem at hand.

Original languageEnglish (US)
Pages (from-to)159-171
Number of pages13
JournalPattern Recognition
Issue number1
StatePublished - Jan 2011
Externally publishedYes


  • Multiple kernel learning
  • Regularization
  • Response surface methodology
  • Support vector machine

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence


Dive into the research topics of 'Regularizing multiple kernel learning using response surface methodology'. Together they form a unique fingerprint.

Cite this