Please wait a minute...
Applied Mathematics-A Journal of Chinese Universities  2021, Vol. 36 Issue (1): 60-69    DOI:
    
Heteroscedastic Laplace mixture of experts regression models and applications
WU Liu-cang1,ZHANG Shu-yu2 LI Shuang-shuang3
1,2Faculty of Science, Kunming University of Science and Technology, Kunming 650093, China.
3College of Mathematics and Informatics, Fujian Normal University, Fuzhou 350117, China.

Download: PDF 
Export: BibTeX | EndNote (RIS)      

Abstract  Mixture of Experts (MoE) regression models are widely studied in statistics and
machine learning for modeling heterogeneity in data for regression, clustering and classification.
Laplace distribution is one of the most important statistical tools to analyze thick and tail
data. Laplace Mixture of Linear Experts (LMoLE) regression models are based on the Laplace
distribution which is more robust. Similar to modelling variance parameter in a homogeneous
population, we propose and study a new novel class of models: heteroscedastic Laplace mixture
of experts regression models to analyze the heteroscedastic data coming from a heterogeneous
population in this paper. The issues of maximum likelihood estimation are addressed. In
particular, Minorization-Maximization (MM) algorithm for estimating the regression parameters
is developed. Properties of the estimators of the regression coefficients are evaluated through
Monte Carlo simulations. Results from the analysis of two real data sets are presented.


Key words mixture of experts regression models      heteroscedastic mixture of experts regression models      Laplace distribution      MM algorithm     
Published: 01 March 2021
CLC:  62F10  
  62H12  
Cite this article:

WU Liu-cang, ZHANG Shu-yu LI Shuang-shuang. Heteroscedastic Laplace mixture of experts regression models and applications. Applied Mathematics-A Journal of Chinese Universities, 2021, 36(1): 60-69.

URL:

http://www.zjujournals.com/amjcub/     OR     http://www.zjujournals.com/amjcub/Y2021/V36/I1/60


Heteroscedastic Laplace mixture of experts regression models and applications

Mixture of Experts (MoE) regression models are widely studied in statistics and
machine learning for modeling heterogeneity in data for regression, clustering and classification.
Laplace distribution is one of the most important statistical tools to analyze thick and tail
data. Laplace Mixture of Linear Experts (LMoLE) regression models are based on the Laplace
distribution which is more robust. Similar to modelling variance parameter in a homogeneous
population, we propose and study a new novel class of models: heteroscedastic Laplace mixture
of experts regression models to analyze the heteroscedastic data coming from a heterogeneous
population in this paper. The issues of maximum likelihood estimation are addressed. In
particular, Minorization-Maximization (MM) algorithm for estimating the regression parameters
is developed. Properties of the estimators of the regression coefficients are evaluated through
Monte Carlo simulations. Results from the analysis of two real data sets are presented.

关键词:  mixture of experts regression models,  heteroscedastic mixture of experts regression models,  Laplace distribution,  MM algorithm
 
[1] S.M.T.K. MirMostafaee Morad Alizadeh Emrah Altun Saralees Nadarajah. The exponentiated generalized power Lindley distribution: Properties and applications[J]. Applied Mathematics-A Journal of Chinese Universities, 2019, 34(2): 127-.
[2] Hector J. Gomez, Neveka M. Olmos, Hector Varela, Heleno Bolfarine. Inference for a truncated positive normal distribution[J]. Applied Mathematics-A Journal of Chinese Universities, 2018, 33(2): 163-.