Please wait a minute...
Front. Inform. Technol. Electron. Eng.  2010, Vol. 11 Issue (8): 620-628    DOI: 10.1631/jzus.C0910500
    
A parallel and scalable digital architecture for training support vector machines
Kui-kang Cao1, Hai-bin Shen*,1, Hua-feng Chen2
1 Institute of VLSI Design, Zhejiang University, Hangzhou 310027, China 2 Zhejiang University of Media and Communications, Hangzhou 310027, China
Download:   PDF(0KB)
Export: BibTeX | EndNote (RIS)      

Abstract  To facilitate the application of support vector machines (SVMs) in embedded systems, we propose and test a parallel and scalable digital architecture based on the sequential minimal optimization (SMO) algorithm for training SVMs. By taking advantage of the mature and popular SMO algorithm, the numerical instability issues that may exist in traditional numerical algorithms are avoided. The error cache updating task, which dominates the computation time of the algorithm, is mapped into multiple processing units working in parallel. Experiment results show that using the proposed architecture, SVM training problems can be solved effectively with inexpensive fixed-point arithmetic and good scalability can be achieved. This architecture overcomes the drawbacks of the previously proposed SVM hardware that lacks the necessary flexibility for embedded applications, and thus is more suitable for embedded use, where scalability is an important concern.

Key wordsSupport vector machine (SVM)      Sequential minimal optimization (SMO)      Field-programmable gate array (FPGA)      Scalable architecture     
Received: 14 August 2009      Published: 02 August 2010
CLC:  TN79  
Fund:  Project (No. 60720106003) supported by the National Natural Science Foundation of China 
Cite this article:

Kui-kang Cao, Hai-bin Shen, Hua-feng Chen. A parallel and scalable digital architecture for training support vector machines. Front. Inform. Technol. Electron. Eng., 2010, 11(8): 620-628.

URL:

http://www.zjujournals.com/xueshu/fitee/10.1631/jzus.C0910500     OR     http://www.zjujournals.com/xueshu/fitee/Y2010/V11/I8/620


A parallel and scalable digital architecture for training support vector machines

To facilitate the application of support vector machines (SVMs) in embedded systems, we propose and test a parallel and scalable digital architecture based on the sequential minimal optimization (SMO) algorithm for training SVMs. By taking advantage of the mature and popular SMO algorithm, the numerical instability issues that may exist in traditional numerical algorithms are avoided. The error cache updating task, which dominates the computation time of the algorithm, is mapped into multiple processing units working in parallel. Experiment results show that using the proposed architecture, SVM training problems can be solved effectively with inexpensive fixed-point arithmetic and good scalability can be achieved. This architecture overcomes the drawbacks of the previously proposed SVM hardware that lacks the necessary flexibility for embedded applications, and thus is more suitable for embedded use, where scalability is an important concern.

关键词: Support vector machine (SVM),  Sequential minimal optimization (SMO),  Field-programmable gate array (FPGA),  Scalable architecture    
[1] Mohammad Mosleh, Hadi Latifpour, Mohammad Kheyrandish, Mahdi Mosleh, Najmeh Hosseinpour. A robust intelligent audio watermarking scheme using support vector machine[J]. Front. Inform. Technol. Electron. Eng., 2016, 17(12): 1320-1330.
[2] G. R. Brindha, P. Swaminathan, B. Santhi. Performance analysis of new word weighting procedures for opinion mining[J]. Front. Inform. Technol. Electron. Eng., 2016, 17(11): 1186-1198.
[3] Qi-rong Mao, Xin-yu Pan, Yong-zhao Zhan, Xiang-jun Shen. Using Kinect for real-time emotion recognition via facial expressions[J]. Front. Inform. Technol. Electron. Eng., 2015, 16(4): 272-282.
[4] Jian Shi, Shu-you Zhang, Le-miao Qiu. Credit scoring by feature-weighted support vector machines[J]. Front. Inform. Technol. Electron. Eng., 2013, 14(3): 197-204.
[5] Zhi-yong Yan, Cong-fu Xu, Yun-he Pan. Improving naive Bayes classifier by dividing its decision regions[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(8): 647-657.
[6] Wen-de Dong, Yue-ting Chen, Zhi-hai Xu, Hua-jun Feng, Qi Li. Image stabilization with support vector machine[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(6): 478-485.
[7] Hong-xia Pang, Wen-de Dong, Zhi-hai Xu, Hua-jun Feng, Qi Li, Yue-ting Chen. Novel linear search for support vector machine parameter selection[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(11): 885-896.
[8] Wei-dong Chen, Jian-hui Zhang, Ji-cai Zhang, Yi Li, Yu Qi, Yu Su, Bian Wu, Shao-min Zhang, Jian-hua Dai, Xiao-xiang Zheng, Dong-rong Xu. A P300 based online brain-computer interface system for virtual hand control[J]. Front. Inform. Technol. Electron. Eng., 2010, 11(8): 587-597.
[9] Hyeon Chang Lee, Byung Jun Kang, Eui Chul Lee, Kang Ryoung Park. Finger vein recognition using weighted local binary pattern code based on a support vector machine[J]. Front. Inform. Technol. Electron. Eng., 2010, 11(7): 514-524.