Please wait a minute...
Applied Mathematics-A Journal of Chinese Universities  2018, Vol. 33 Issue (2): 145-    DOI: 10.1007/s11766-018-3496-x
    
Large Variable selection via generalized SELO-penalized linear regression models
SHI Yue-yong$^{1,3}$ , CAO Yong-xiu$^{2}$ , YU Ji-chang$^{2}$  ,  JIAO Yu-ling$^{2,*}$
$^{1}$ School of Economics and Management,  China University of Geosciences, Wuhan 430074, China.
  $^{2}$ School of Statistics and Mathematics,  Zhongnan University of Economics and Law, Wuhan 430073, China.
$^{3}$ Center for Resources and Environmental Economic Research,  China University of Geosciences, Wuhan 430074, China.
 
Large Variable selection via generalized SELO-penalized linear regression models
SHI Yue-yong$^{1,3}$ , CAO Yong-xiu$^{2}$ , YU Ji-chang$^{2}$  ,  JIAO Yu-ling$^{2,*}$
$^{1}$ School of Economics and Management,  China University of Geosciences, Wuhan 430074, China.
  $^{2}$ School of Statistics and Mathematics,  Zhongnan University of Economics and Law, Wuhan 430073, China.
$^{3}$ Center for Resources and Environmental Economic Research,  China University of Geosciences, Wuhan 430074, China.
 
 全文: PDF 
摘要:

The seamless-$L_0$ (SELO) penalty is a smooth function on $[0,\wq)$ that very  closely resembles the $L_0$ penalty, which has been  demonstrated theoretically and practically to be effective in nonconvex penalization for  variable selection. In this paper, we first generalize SELO to a class of penalties  retaining good features of SELO, and then  propose variable selection and estimation in  linear models  using the proposed  eneralized SELO (GSELO)  penalized least squares (PLS) approach.
We show that the GSELO-PLS procedure possesses the oracle property  and consistently selects the true model under some regularity conditions
in the presence of a diverging number of variables.  The entire path of GSELO-PLS estimates can  be efficiently computed through a smoothing quasi-Newton (SQN) method.
A modified BIC coupled with a continuation  strategy is developed
to select the optimal tuning parameter.
Simulation studies and analysis of a clinical data
are carried out to evaluate the finite sample performance of the
proposed method. In addition, numerical experiments
involving simulation studies and analysis of a microarray data
are also conducted for GSELO-PLS in the high-dimensional settings.

关键词: continuation coordinate descent  BIC LLA  oracle property  SELO smoothing quasi-Newton    
Abstract: The seamless-$L_0$ (SELO) penalty is a smooth function on $[0,\wq)$ that very  closely resembles the $L_0$ penalty, which has been  demonstrated theoretically and practically to be effective in nonconvex penalization for  variable selection. In this paper, we first generalize SELO to a class of penalties  retaining good features of SELO, and then  propose variable selection and estimation in  linear models  using the proposed  eneralized SELO (GSELO)  penalized least squares (PLS) approach.
We show that the GSELO-PLS procedure possesses the oracle property  and consistently selects the true model under some regularity conditions
in the presence of a diverging number of variables.  The entire path of GSELO-PLS estimates can  be efficiently computed through a smoothing quasi-Newton (SQN) method.
A modified BIC coupled with a continuation  strategy is developed
to select the optimal tuning parameter.
Simulation studies and analysis of a clinical data
are carried out to evaluate the finite sample performance of the
proposed method. In addition, numerical experiments
involving simulation studies and analysis of a microarray data
are also conducted for GSELO-PLS in the high-dimensional settings.
Key words: continuation    coordinate descent     BIC    LLA     oracle property     SELO    smoothing quasi-Newton
出版日期: 2018-07-02
CLC:  62F12  
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章  
SHI Yue-yong
CAO Yong-xiu
YU Ji-chang
JIAO Yu-ling

引用本文:

SHI Yue-yong, CAO Yong-xiu, YU Ji-chang, JIAO Yu-ling. Large Variable selection via generalized SELO-penalized linear regression models[J]. Applied Mathematics-A Journal of Chinese Universities, 2018, 33(2): 145-.

SHI Yue-yong , CAO Yong-xiu , YU Ji-chang , JIAO Yu-ling. Large Variable selection via generalized SELO-penalized linear regression models. Applied Mathematics-A Journal of Chinese Universities, 2018, 33(2): 145-.

链接本文:

http://www.zjujournals.com/amjcub/CN/10.1007/s11766-018-3496-x        http://www.zjujournals.com/amjcub/CN/Y2018/V33/I2/145

[1] ZHENG Jing, TONG Chang-qing, ZHANG Gui-jun. Modeling stochastic mortality with O-U type processes[J]. Applied Mathematics-A Journal of Chinese Universities, 2018, 33(1): 48-58.