Please wait a minute...
J4  2013, Vol. 47 Issue (4): 638-643    DOI: 10.3785/j.issn.1008-973X.2013.04.011
自动化技术、电信技术     
基于Levy flight的特征选择算法
朱晓恩, 郝欣, 夏顺仁
浙江大学 生物医学工程教育部重点实验室,浙江 杭州 310027
Feature selection algorithm based on Levy flight
ZHU Xiao-en, HAO Xin, XIA Shun-ren
Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou 310027, China
 全文: PDF 
摘要:

为了提高特征选择方法的计算速度,提出基于Levy flight随机过程的特征选择方法.该方法在寻优过程中定义基于启发式的分阶段搜索策略,在局部搜索行为中引入Levy flight随机过程,将Levy flight距离与搜索行为进行映射.在不同的搜索阶段,利用不同的映射区间改变搜索行为出现的概率,以该映射来控制局部搜索行为的方向和速度,从而避免了陷入局部最优的问题.实验结果表明,采用LevyFS算法克服了启发式特征选择方法的局限性,平均耗时仅为SFFS算法的1/3左右.

关键词: 特征选择Levy flight搜索策略模式识别    
Abstract:

A Levy flight random process based feature selection algorithm (LevyFS) was proposed in order to improve the speed of feature selection method. A multi-stages heuristic search strategy was defined during optimization process. Levy flight random process was introduced in local search behavior, and map between Levy flight distances and search operations was defined. During different search stages, map was used to change the probability of search behavior so as to control the direction and speed of local search behavior. Then local optimum was prevented. Experimental results show that LevyFS algorithm overcomes the limitation of heuristic methods and the average time cost of LevyFS algorithm is only one-third time cost of SFFS algorithm.

Key words: feature selection    Levy flight    search strategy    pattern recognition
出版日期: 2013-05-07
:  TP 391.41  
基金资助:

国家自然科学基金资助项目(60772092, 81101903).

通讯作者: 夏顺仁,男,教授,博导.     E-mail: srxia@zju.edu.cn
作者简介: 朱晓恩(1986—),男,硕士生,从事医学图像处理的研究. E-mail: zzdoo.zxe@gmail.com
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章  

引用本文:

朱晓恩, 郝欣, 夏顺仁. 基于Levy flight的特征选择算法[J]. J4, 2013, 47(4): 638-643.

ZHU Xiao-en, HAO Xin, XIA Shun-ren. Feature selection algorithm based on Levy flight. J4, 2013, 47(4): 638-643.

链接本文:

http://www.zjujournals.com/xueshu/eng/CN/10.3785/j.issn.1008-973X.2013.04.011        http://www.zjujournals.com/xueshu/eng/CN/Y2013/V47/I4/638

[1] GUYON I, ELISSEEFF A E. An introduction to variable and feature selection [J]. Journal of Machine Learning Research, 2003, 3(1): 1157-1182.

[2] AMALDI E, KANN V. On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems [J]. Theoretical Computer Science, 1998, 209(1/2): 237-260.

[3] 王娟,慈林林,姚康泽.特征选择方法综述[J].计算机工程与科学,2005,27(12): 68-71.

WANG Juan, CI Lin-lin, YAO Kang-ze. Review of feature selection method [J]. Computer Engineering and Science, 2005, 27(12): 68-71.

[4] IL-SEOK O, JIN-SEON L, BYUNG-RO M. Hybrid genetic algorithms for feature selection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(11): 1424-1437.

[5] WANG X, YANG J, TENG X, et al. Feature selection based on rough sets and particle swarm optimization [J]. Pattern Recognition Letters, 2007, 28(4): 459-471.

[6] REUNANEN J. Overfitting in making comparisons between variable selection methods [J]. Journal of Machine Learning Research, 2003, 3(1): 1371-1382.

[7] PAVLYUKEVICH I. Lévy flights, non-local search and simulated annealing [J]. Journal of Computational Physics, 2007, 226(2): 1830-1844.

[8] VISWANATHAN G M. Lévy flights and random searches [J]. Journal of Physics A: Mathematical and Theoretical, 2009, 42(43): 434003.

[9] BROWN C, LIEBOVITCH L, GLENDON R. Lévy flights in Dobe Ju/’hoansi foraging patterns [J]. Springer Netherlands, 2007, 35: 129-138.

[10] MANTEGNA R N, STANLEY H E. Stochastic process with ultraslow convergence to a Gaussian: the truncated Lévy flight [J]. Physical Review Letters, 1994, 73(22): 2946-2949.

[11] YANG X S. Nature-inspired metaheuristic algorithms [M]. 2nd ed. United Kingdom: Luniver Press, 2011: 1-6.

[12] ID P S A P. Introduction to feature selection toolbox 3: the C++ library for subset search, data modeling and classication [R]. Czech: University of Tennessee Institute of Agriculture, Czech Academy of Sciences, 2010.

[1] 廖苗, 赵于前, 曾业战, 黄忠朝, 张丙奎, 邹北骥. 基于支持向量机和椭圆拟合的细胞图像自动分割[J]. 浙江大学学报(工学版), 2017, 51(4): 722-728.
[2] 刘磊,杨鹏,刘作军. 基于多源信息和粒子群优化算法的下肢运动模式识别[J]. 浙江大学学报(工学版), 2015, 49(3): 439-447.
[3] 张成,吴慧,高博青,汪毅俊. 基于模糊聚类的网架结构动力失效模式识别[J]. J4, 2011, 45(7): 1276-1280.
[4] 张玉红, 胡学钢, 杨秋洁. 一种适用于数据流分类的特征选择方法[J]. J4, 2011, 45(12): 2247-2251.
[5] 汤健, 赵立杰, 岳恒, 柴天佑. 基于多源数据特征融合的球磨机负荷软测量[J]. J4, 2010, 44(7): 1406-1413.
[6] 周博, 王永维, 王俊, 陆秋君. 鸡蛋贮藏时间和新鲜度的电子鼻检测[J]. J4, 2010, 44(5): 863-869.
[7] 饶秀勤, 应义斌. 水果按表面颜色分级的方法[J]. J4, 2009, 43(5): 869-871.
[8] 叶建芳, 潘晓弘, 王正肖, 等. 基于免疫离散粒子群算法的调度属性选择[J]. J4, 2009, 43(12): 2203-2207.
[9] 周迅 向馗 俞小莉. D-Markov模型在疲劳裂纹扩展模式识别中的应用[J]. J4, 2008, 42(3): 549-552.
[10] 施振吴 李式巨 杨志敏. 调制模式识别中相位提取算法的精度分析[J]. J4, 2008, 42(11): 1931-1935.
[11] 罗志增 张清菊 蒋静坪. 表面肌电信号的小波消噪改进算法[J]. J4, 2007, 41(2): 213-216.
[12] 谢波 陈岭 陈根才 陈纯. 普通话语音情感识别的特征选择技术[J]. J4, 2007, 41(11): 1816-1822.
[13] 熊智新 路文初 胡上序. 小波变换和RBF网络用于模式法分解重叠色谱峰[J]. J4, 2005, 39(4): 516-521.
[14] 袁丁 傅一平 李志能. 基于小波变换的字符识别快速算法[J]. J4, 2004, 38(3): 317-321.