Please wait a minute...
J4  2013, Vol. 47 Issue (4): 638-643    DOI: 10.3785/j.issn.1008-973X.2013.04.011
Feature selection algorithm based on Levy flight
ZHU Xiao-en, HAO Xin, XIA Shun-ren
Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou 310027, China
Download:   PDF(0KB) HTML
Export: BibTeX | EndNote (RIS)      


A Levy flight random process based feature selection algorithm (LevyFS) was proposed in order to improve the speed of feature selection method. A multi-stages heuristic search strategy was defined during optimization process. Levy flight random process was introduced in local search behavior, and map between Levy flight distances and search operations was defined. During different search stages, map was used to change the probability of search behavior so as to control the direction and speed of local search behavior. Then local optimum was prevented. Experimental results show that LevyFS algorithm overcomes the limitation of heuristic methods and the average time cost of LevyFS algorithm is only one-third time cost of SFFS algorithm.

Published: 01 April 2013
CLC:  TP 391.41  
Cite this article:

ZHU Xiao-en, HAO Xin, XIA Shun-ren. Feature selection algorithm based on Levy flight. J4, 2013, 47(4): 638-643.

URL:     OR

基于Levy flight的特征选择算法

为了提高特征选择方法的计算速度,提出基于Levy flight随机过程的特征选择方法.该方法在寻优过程中定义基于启发式的分阶段搜索策略,在局部搜索行为中引入Levy flight随机过程,将Levy flight距离与搜索行为进行映射.在不同的搜索阶段,利用不同的映射区间改变搜索行为出现的概率,以该映射来控制局部搜索行为的方向和速度,从而避免了陷入局部最优的问题.实验结果表明,采用LevyFS算法克服了启发式特征选择方法的局限性,平均耗时仅为SFFS算法的1/3左右.

[1] GUYON I, ELISSEEFF A E. An introduction to variable and feature selection [J]. Journal of Machine Learning Research, 2003, 3(1): 1157-1182.

[2] AMALDI E, KANN V. On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems [J]. Theoretical Computer Science, 1998, 209(1/2): 237-260.

[3] 王娟,慈林林,姚康泽.特征选择方法综述[J].计算机工程与科学,2005,27(12): 68-71.

WANG Juan, CI Lin-lin, YAO Kang-ze. Review of feature selection method [J]. Computer Engineering and Science, 2005, 27(12): 68-71.

[4] IL-SEOK O, JIN-SEON L, BYUNG-RO M. Hybrid genetic algorithms for feature selection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(11): 1424-1437.

[5] WANG X, YANG J, TENG X, et al. Feature selection based on rough sets and particle swarm optimization [J]. Pattern Recognition Letters, 2007, 28(4): 459-471.

[6] REUNANEN J. Overfitting in making comparisons between variable selection methods [J]. Journal of Machine Learning Research, 2003, 3(1): 1371-1382.

[7] PAVLYUKEVICH I. Lévy flights, non-local search and simulated annealing [J]. Journal of Computational Physics, 2007, 226(2): 1830-1844.

[8] VISWANATHAN G M. Lévy flights and random searches [J]. Journal of Physics A: Mathematical and Theoretical, 2009, 42(43): 434003.

[9] BROWN C, LIEBOVITCH L, GLENDON R. Lévy flights in Dobe Ju/’hoansi foraging patterns [J]. Springer Netherlands, 2007, 35: 129-138.

[10] MANTEGNA R N, STANLEY H E. Stochastic process with ultraslow convergence to a Gaussian: the truncated Lévy flight [J]. Physical Review Letters, 1994, 73(22): 2946-2949.

[11] YANG X S. Nature-inspired metaheuristic algorithms [M]. 2nd ed. United Kingdom: Luniver Press, 2011: 1-6.

[12] ID P S A P. Introduction to feature selection toolbox 3: the C++ library for subset search, data modeling and classication [R]. Czech: University of Tennessee Institute of Agriculture, Czech Academy of Sciences, 2010.

[1] YANH Yu-ting, SHI Yu-hui, XIA Shun-ren. Discussion mechanism based brain storm optimization algorithm[J]. J4, 2013, 47(10): 1705-1711.
[2] SON Chang-il , ZHEN Shuai, XIA Shun-ren. Attractor range based affine registration of multi-modal
brain magnetic resonance images
[J]. J4, 2012, 46(9): 1722-1728.
[3] XIE Di, TONG Ruo-feng, TANG Min, FENG Yang. Distinguishable method for video fire detection[J]. J4, 2012, 46(4): 698-704.
[4] DAI Yuan-ming, WEI Wei, LIN Yi-ning. An improved Mean-shift tracking algorithm based on
color and texture feature
[J]. J4, 2012, 46(2): 212-217.
[5] Qi lei, JIN Wen-guang, GENG Wei-dong. Human motion capture using wireless inertial sensors[J]. J4, 2012, 46(2): 280-285.
[6] LIU Chen-bin, PAN Ying, ZHANG Hai-shi, HUANG Feng-ping, XIA Shun-ren. Detecting MGMT expression status of glioma with magnetic
resonance image
[J]. J4, 2012, 46(1): 170-176.
[7] QIAN Cheng, ZHANG San-yuan. Weighted incremental subspace learning algorithm
suitable for object tracking
[J]. J4, 2011, 45(12): 2240-2246.
[8] CAO Ying, HAO Xin, ZHU Xiao-en, XIA Shun-ren. Mammographic mass segmentation algorithm based on
automatic random walks
[J]. J4, 2011, 45(10): 1753-1760.
[9] LV Gu-lai,LI Jian-ping,LI Qiang,YU Li-xing,ZHU Song-ming,LOU Jian-zhong. Method for rootstock position recognition based on machine vision[J]. J4, 2011, 45(10): 1766-1770.
[10] LAI Xiao-bo , ZHU Shi-qiang. Mutual information based non-parametric
 transform stereo matching algorithm
[J]. J4, 2011, 45(9): 1636-1642.
[11] WANG Jin-de, SHOU Li-dan, LI Xiao-yan, CHEN Gang. Bundling features with multiple segmentations for
object-based image retrieval
[J]. J4, 2011, 45(2): 259-266.
[12] LIU Jian-ming, LU Dong-ming, GE Rong. Global optimization based image inpainting and
its implementation on GPU
[J]. J4, 2011, 45(2): 247-252.
[13] ZHAN Jiang-tao, LIU Qiang, CHAI Chun-lei. Facial feature tracking using three-dimensional model and
Gabor wavelet
[J]. J4, 2011, 45(1): 30-36.
[14] LIANG Wen-feng, XIANG Zhi-yu. Algorithm of robust object tracking using PTZ camera[J]. J4, 2011, 45(1): 59-63.
[15] SONG Kun-po, XIA Shun-ren, XU Qing. Algorithm considering correlation of wavelet coefficients for
ultrasound image denoising
[J]. J4, 2010, 44(11): 2203-2208.