Please wait a minute...
Applied Mathematics-A Journal of Chinese Universities  2018, Vol. 33 Issue (2): 145-    DOI: 10.1007/s11766-018-3496-x
    
Large Variable selection via generalized SELO-penalized linear regression models
SHI Yue-yong$^{1,3}$ , CAO Yong-xiu$^{2}$ , YU Ji-chang$^{2}$  ,  JIAO Yu-ling$^{2,*}$
$^{1}$ School of Economics and Management,  China University of Geosciences, Wuhan 430074, China.
  $^{2}$ School of Statistics and Mathematics,  Zhongnan University of Economics and Law, Wuhan 430073, China.
$^{3}$ Center for Resources and Environmental Economic Research,  China University of Geosciences, Wuhan 430074, China.
 
Download: PDF 
Export: BibTeX | EndNote (RIS)      

Abstract  The seamless-$L_0$ (SELO) penalty is a smooth function on $[0,\wq)$ that very  closely resembles the $L_0$ penalty, which has been  demonstrated theoretically and practically to be effective in nonconvex penalization for  variable selection. In this paper, we first generalize SELO to a class of penalties  retaining good features of SELO, and then  propose variable selection and estimation in  linear models  using the proposed  eneralized SELO (GSELO)  penalized least squares (PLS) approach.
We show that the GSELO-PLS procedure possesses the oracle property  and consistently selects the true model under some regularity conditions
in the presence of a diverging number of variables.  The entire path of GSELO-PLS estimates can  be efficiently computed through a smoothing quasi-Newton (SQN) method.
A modified BIC coupled with a continuation  strategy is developed
to select the optimal tuning parameter.
Simulation studies and analysis of a clinical data
are carried out to evaluate the finite sample performance of the
proposed method. In addition, numerical experiments
involving simulation studies and analysis of a microarray data
are also conducted for GSELO-PLS in the high-dimensional settings.


Key wordscontinuation       coordinate descent        BIC       LLA       oracle property        SELO       smoothing quasi-Newton     
Published: 02 July 2018
CLC:  62F12  
  62J05  
  62J07  
Cite this article:

SHI Yue-yong , CAO Yong-xiu , YU Ji-chang , JIAO Yu-ling. Large Variable selection via generalized SELO-penalized linear regression models. Applied Mathematics-A Journal of Chinese Universities, 2018, 33(2): 145-.

URL:

http://www.zjujournals.com/amjcub/10.1007/s11766-018-3496-x     OR     http://www.zjujournals.com/amjcub/Y2018/V33/I2/145


Large Variable selection via generalized SELO-penalized linear regression models

The seamless-$L_0$ (SELO) penalty is a smooth function on $[0,\wq)$ that very  closely resembles the $L_0$ penalty, which has been  demonstrated theoretically and practically to be effective in nonconvex penalization for  variable selection. In this paper, we first generalize SELO to a class of penalties  retaining good features of SELO, and then  propose variable selection and estimation in  linear models  using the proposed  eneralized SELO (GSELO)  penalized least squares (PLS) approach.
We show that the GSELO-PLS procedure possesses the oracle property  and consistently selects the true model under some regularity conditions
in the presence of a diverging number of variables.  The entire path of GSELO-PLS estimates can  be efficiently computed through a smoothing quasi-Newton (SQN) method.
A modified BIC coupled with a continuation  strategy is developed
to select the optimal tuning parameter.
Simulation studies and analysis of a clinical data
are carried out to evaluate the finite sample performance of the
proposed method. In addition, numerical experiments
involving simulation studies and analysis of a microarray data
are also conducted for GSELO-PLS in the high-dimensional settings.


关键词: continuation ,  coordinate descent ,   BIC ,  LLA ,  oracle property ,   SELO ,  smoothing quasi-Newton 
[1] ZHENG Jing, TONG Chang-qing, ZHANG Gui-jun. Modeling stochastic mortality with O-U type processes[J]. Applied Mathematics-A Journal of Chinese Universities, 2018, 33(1): 48-58.