Please wait a minute...
Front. Inform. Technol. Electron. Eng.  2011, Vol. 12 Issue (4): 297-306    DOI: 10.1631/jzus.C1000110
    
Extremal optimization for optimizing kernel function and its parameters in support vector regression
Peng Chen*,1, Yong-zai Lu2
1 Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China 2 Department of Automation, Zhejiang University, Hangzhou 310027, China
Download:   PDF(407KB)
Export: BibTeX | EndNote (RIS)      

Abstract  The performance of the support vector regression (SVR) model is sensitive to the kernel type and its parameters. The determination of an appropriate kernel type and the associated parameters for SVR is a challenging research topic in the field of support vector learning. In this study, we present a novel method for simultaneous optimization of the SVR kernel function and its parameters, formulated as a mixed integer optimization problem and solved using the recently proposed heuristic ‘extremal optimization (EO)’. We present the problem formulation for the optimization of the SVR kernel and parameters, the EO-SVR algorithm, and experimental tests with five benchmark regression problems. The results of comparison with other traditional approaches show that the proposed EO-SVR method provides better generalization performance by successfully identifying the optimal SVR kernel function and its parameters.

Key wordsSupport vector regression (SVR)      Extremal optimization (EO)      Parameter optimization      Kernel function optimization     
Received: 20 April 2010      Published: 11 April 2011
CLC:  TP181  
Cite this article:

Peng Chen, Yong-zai Lu. Extremal optimization for optimizing kernel function and its parameters in support vector regression. Front. Inform. Technol. Electron. Eng., 2011, 12(4): 297-306.

URL:

http://www.zjujournals.com/xueshu/fitee/10.1631/jzus.C1000110     OR     http://www.zjujournals.com/xueshu/fitee/Y2011/V12/I4/297


Extremal optimization for optimizing kernel function and its parameters in support vector regression

The performance of the support vector regression (SVR) model is sensitive to the kernel type and its parameters. The determination of an appropriate kernel type and the associated parameters for SVR is a challenging research topic in the field of support vector learning. In this study, we present a novel method for simultaneous optimization of the SVR kernel function and its parameters, formulated as a mixed integer optimization problem and solved using the recently proposed heuristic ‘extremal optimization (EO)’. We present the problem formulation for the optimization of the SVR kernel and parameters, the EO-SVR algorithm, and experimental tests with five benchmark regression problems. The results of comparison with other traditional approaches show that the proposed EO-SVR method provides better generalization performance by successfully identifying the optimal SVR kernel function and its parameters.

关键词: Support vector regression (SVR),  Extremal optimization (EO),  Parameter optimization,  Kernel function optimization 
[1] Lai TENG, Zhong-he JIN. A composite optimization method for separation parameters of large-eccentricity pico-satellites[J]. Front. Inform. Technol. Electron. Eng., 2018, 19(5): 685-698.
[2] Jin ZHANG , Zhao-hui TANG , Wei-hua GUI , Qing CHEN , Jin-ping LIU. Interactive image segmentation with a regression based ensemble learning paradigm[J]. Front. Inform. Technol. Electron. Eng., 2017, 18(7): 1002-1020.
[3] Alireza Askarzadeh, Alireza Rezazadeh. A new artificial bee swarm algorithm for optimization of proton exchange membrane fuel cell model parameters[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(8): 638-646.
[4] Guo-qiang Zeng, Yong-zai Lu, Wei-Jie Mao. Modified extremal optimization for the hard maximum satisfiability problem[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(7): 589-596.