Please wait a minute...
Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering)  2009, Vol. 10 Issue (2): 253-262    DOI: 10.1631/jzus.A0820122
Electrical & Electronic Engineering     
A multi-class large margin classifier
Liang TANG, Qi XUAN, Rong XIONG, Tie-jun WU, Jian CHU
Institute of Cyber-Systems and Control, Zhejiang University, Hangzhou 310027, China
Download:     PDF (0 KB)     
Export: BibTeX | EndNote (RIS)      

Abstract  Currently there are two approaches for a multi-class support vector classifier (SVC). One is to construct and combine several binary classifiers while the other is to directly consider all classes of data in one optimization formulation. For a K-class problem (K>2), the first approach has to construct at least K classifiers, and the second approach has to solve a much larger optimization problem proportional to K by the algorithms developed so far. In this paper, following the second approach, we present a novel multi-class large margin classifier (MLMC). This new machine can solve K-class problems in one optimization formulation without increasing the size of the quadratic programming (QP) problem proportional to K. This property allows us to construct just one classifier with as few variables in the QP problem as possible to classify multi-class data, and we can gain the advantage of speed from it especially when K is large. Our experiments indicate that MLMC almost works as well as (sometimes better than) many other multi-class SVCs for some benchmark data classification problems, and obtains a reasonable performance in face recognition application on the AR face database.

Key wordsMulti-classification      Support vector machine (SVM)      Quadratic programming (QP) problem      Large margin     
Received: 20 February 2008     
CLC:  TN911.7  
Cite this article:

Liang TANG, Qi XUAN, Rong XIONG, Tie-jun WU, Jian CHU. A multi-class large margin classifier. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(2): 253-262.

URL:

http://www.zjujournals.com/xueshu/zjus-a/10.1631/jzus.A0820122     OR     http://www.zjujournals.com/xueshu/zjus-a/Y2009/V10/I2/253

[1] She-rong Zhang, An-kui Hu, Chao Wang. Three-dimensional inversion analysis of an in situ stress field based on a two-stage optimization algorithm[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2016, 17(10): 782-802.
[2] LI Guo-qi, SHENG Huan-ye. Classification analysis of microarray data based on ontological engineering[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(4): 638-643.
[3] LENG Biao, QIN Zheng, LI Li-qun. Support Vector Machine active learning for 3D model retrieval[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(12): 1953-1961.
[4] Chan Siu-ping, Sun Ming-ting. A network condition classification scheme for supporting video delivery over wireless Internet[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7(5 ): 15-.
[5] Ru Xue-min, Zhuang Yue-ting, Wu Fei. Audio steganalysis based on “negative resonance phenomenon” caused by steganographic tools[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7(4 ): 15-.
[6] Xu Yun, Zhang Feng. Using SVM to construct a Chinese dependency parser[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7(2): 199-203.
[7] Wen Xiang-jun, Zhang Yu-nong, Yan Wei-wu, Xu Xiao-ming. Nonlinear decoupling controller design based on least squares support vector regression[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7(2): 275-284.
[8] ZHANG Ri-dong, WANG Shu-qing. Predictive control of a class of bilinear systems based on global off-line models[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7(12): 5-.
[9] SEETHALAKSHMI R., SREERANJANI T.R., BALACHANDAR T., Abnikant Singh, Markandey Singh, Ritwaj Ratan, Sarvesh Kumar. Optical Character Recognition for printed Tamil text using Unicode[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2005, 6(11): 1297-1305.
[10] JIANG Zhi-qiang, FU Han-guang, LI Ling-jun. Support Vector Machine for mechanical faults classification[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2005, 6( 5): 13-.