Please wait a minute...
Front. Inform. Technol. Electron. Eng.  2013, Vol. 14 Issue (9): 722-732    DOI: 10.1631/jzus.CIIP1301
    
Primal least squares twin support vector regression
Hua-juan Huang, Shi-fei Ding, Zhong-zhi Shi
School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, China; Key Lab of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100080, China
Download:   PDF(0KB)
Export: BibTeX | EndNote (RIS)      

Abstract  The training algorithm of classical twin support vector regression (TSVR) can be attributed to the solution of a pair of quadratic programming problems (QPPs) with inequality constraints in the dual space. However, this solution is affected by time and memory constraints when dealing with large datasets. In this paper, we present a least squares version for TSVR in the primal space, termed primal least squares TSVR (PLSTSVR). By introducing the least squares method, the inequality constraints of TSVR are transformed into equality constraints. Furthermore, we attempt to directly solve the two QPPs with equality constraints in the primal space instead of the dual space; thus, we need only to solve two systems of linear equations instead of two QPPs. Experimental results on artificial and benchmark datasets show that PLSTSVR has comparable accuracy to TSVR but with considerably less computational time. We further investigate its validity in predicting the opening price of stock.

Key wordsTwin support vector regression      Least squares method      Primal space      Stock prediction     
Received: 27 January 2013      Published: 05 September 2013
CLC:  TP18  
Cite this article:

Hua-juan Huang, Shi-fei Ding, Zhong-zhi Shi. Primal least squares twin support vector regression. Front. Inform. Technol. Electron. Eng., 2013, 14(9): 722-732.

URL:

http://www.zjujournals.com/xueshu/fitee/10.1631/jzus.CIIP1301     OR     http://www.zjujournals.com/xueshu/fitee/Y2013/V14/I9/722


Primal least squares twin support vector regression

The training algorithm of classical twin support vector regression (TSVR) can be attributed to the solution of a pair of quadratic programming problems (QPPs) with inequality constraints in the dual space. However, this solution is affected by time and memory constraints when dealing with large datasets. In this paper, we present a least squares version for TSVR in the primal space, termed primal least squares TSVR (PLSTSVR). By introducing the least squares method, the inequality constraints of TSVR are transformed into equality constraints. Furthermore, we attempt to directly solve the two QPPs with equality constraints in the primal space instead of the dual space; thus, we need only to solve two systems of linear equations instead of two QPPs. Experimental results on artificial and benchmark datasets show that PLSTSVR has comparable accuracy to TSVR but with considerably less computational time. We further investigate its validity in predicting the opening price of stock.

关键词: Twin support vector regression,  Least squares method,  Primal space,  Stock prediction 
[1] Jia-yin Song, Wen-long Song, Jian-ping Huang, Liang-kuan Zhu. Segmentation and focus-point location based on boundary analysis in forest canopy hemispherical photography[J]. Front. Inform. Technol. Electron. Eng., 2016, 17(8): 741-749.
[2] Rong Jiao, Lu-ping Xu, Hua Zhang, Cong Li. Orbit determination using incremental phase and TDOA of X-ray pulsar[J]. Front. Inform. Technol. Electron. Eng., 2016, 17(6): 543-552.