Please wait a minute...
浙江大学学报(工学版)  2023, Vol. 57 Issue (2): 267-276    DOI: 10.3785/j.issn.1008-973X.2023.02.007
计算机技术     
基于Gram矩阵的T-CNN时间序列分类方法
王俊陆(),李素,纪婉婷,姜天,宋宝燕*()
辽宁大学 信息学院,辽宁 沈阳 110036
T-CNN time series classification method based on Gram matrix
Jun-lu WANG(),Su LI,Wan-ting JI,Tian JIANG,Bao-yan SONG*()
School of Information, Liaoning University, Shenyang 110036, China
 全文: PDF(1308 KB)   HTML
摘要:

时间序列分类是流式数据事件分析和数据挖掘的基础. 针对现有方法损失时间属性、分类准确率低、效率低等问题,提出基于Gram矩阵的T-CNN时间序列分类方法. 该方法对时间序列进行小波阈值去噪,过滤正态曲线噪声,提出基于Gram矩阵的无损时间域图像转换方法,保留事件全部信息. 改进时间序列CNN分类方法,在卷积层计算引入Toeplitz卷积核矩阵,实现矩阵乘积替换卷积运算. 引入Triplet网络思想,构建T-CNN分类模型,通过计算同类事件与不同类事件间的相似度优化CNN的平方损失函数,提高T-CNN模型梯度下降的收敛速率及分类准确性. 实验表明,相比现有方法,T-CNN时间序列分类方法能够提高35%的分类准确率、35%的分类精确率及40%的分类效率.

关键词: Gram矩阵T-CNN模型Toeplitz损失函数Triplet网络    
Abstract:

Time series classification is the basis of streaming data event analysis and data mining. A T-CNN time series classification method based on Gram matrix was proposed, aiming at the problems of loss of time attribute, low classification accuracy and low efficiency of the existing methods. Specifically, the time series was denoised by wavelet threshold to filter out normal curve noise, and a lossless transformation method based on the Gram matrix was proposed to convert the time series into time-domain images and retain all event information. Then the CNN classification method of time series was improved, and the Toeplitz convolution kernel matrix was introduced into the convolutional layer calculation to realize the replacement of convolution operation with matrix product. The Triplet network was introduced to construct the T-CNN classification model, and the square loss function of CNN was optimized by calculating the similarities between similar events and different kinds of events, so as to improve the convergence rate of gradient descent and the classification accuracy of the T-CNN model. Experimental results show that compared with the existing methods, the proposed T-CNN time series classification method can improve the classification accuracy by 35%, the classification precision by 35% and the classification efficiency by 40%.

Key words: Gram matrix    T-CNN model    Toeplitz    loss function    Triplet network
收稿日期: 2022-07-28 出版日期: 2023-02-28
CLC:  TP 181  
基金资助: 国家重点研发计划资助项目
通讯作者: 宋宝燕     E-mail: wangjunlu@lnu.edu.cn;bysong@lnu.edu.cn
作者简介: 王俊陆(1988—),男,博士生,从事大规模图处理技术、大数据处理技术和流数据处理技术研究. orcid.org/0000-0001-5966-335X. E-mail: wangjunlu@lnu.edu.cn
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
作者相关文章  
王俊陆
李素
纪婉婷
姜天
宋宝燕

引用本文:

王俊陆,李素,纪婉婷,姜天,宋宝燕. 基于Gram矩阵的T-CNN时间序列分类方法[J]. 浙江大学学报(工学版), 2023, 57(2): 267-276.

Jun-lu WANG,Su LI,Wan-ting JI,Tian JIANG,Bao-yan SONG. T-CNN time series classification method based on Gram matrix. Journal of ZheJiang University (Engineering Science), 2023, 57(2): 267-276.

链接本文:

https://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2023.02.007        https://www.zjujournals.com/eng/CN/Y2023/V57/I2/267

图 1  时间序列示意图
图 2  时间序列极坐标示意图
图 3  时间域图像示意图
图 4  Toeplitz矩阵转换过程示意图
环境 配置
CPU Intel Core(TM)i7-7500U
内存 8 GB
硬盘容量 1 TB
操作系统 Windows 8.1 (64bit)
编程语言 Java
JDK版本 1.7.0_45
表 1  实验软硬件环境
图 5  T-CNN模型迭代次数结果图
图 6  不同分类模型分类准确率对比图
图 7  不同分类模型分类精确率对比图
图 8  不同分类模型分类查全率对比图
图 9  不同分类模型F1值对比图
图 10  不同分类模型分类效率对比图
图 11  Toeplitz卷积与传统卷积运行时间对比图
1 ANE B, ANGEL C, USUE M, et al A review on outlier/anomaly detection in time series data[J]. ACM Computing Surveys, 2021, 54 (3): 1- 33
2 杜晓昕, 王浩, 崔连和, 等 基于聚类和探测精英引导的蜻蜓算法[J]. 浙江大学学报:工学版, 2022, 56 (5): 977- 986
DU Xiao-qin, WANG Hao, CUI Lian-he, et al Dragonfly algorithm based on clustering and detection elite guidance[J]. Journal of Zhejiang University: Engineering Science, 2022, 56 (5): 977- 986
3 HOUSHANG D, GEORGIANA I, DIEGO F S, et al Guest editorial for special issue on time series classification[J]. IEEE/CAA Journal of Automatica Sinica, 2019, 6 (6): 1291- 1292
doi: 10.1109/JAS.2019.1911741
4 KABYLDA A Future of oil and gas trade of Kazakhstan in the European Union context: application of time series analysis[J]. Visegrad Journal on Bioeconomy and Sustainable Development, 2020, 9 (2): 55- 60
doi: 10.2478/vjbsd-2020-0011
5 LUO H, SUN K X, WANG J L, et al Multistage identification method for real-time abnormal events of streaming data[J]. International Journal of Distributed Sensor Networks, 2019, 15 (12): 12119- 12132
6 HAMDI Y, REEM A D A novel trend based SAX reduction technique for time series[J]. Expert Systems with Applications, 2019, 130: 113- 123
doi: 10.1016/j.eswa.2019.04.026
7 HUGUES T, MINA B, CHRISTIAN L, et al InterpretTime: a new approach for the systematic evaluation of neural-network interpretability in time series classification[J]. Computing Research Repository, 2022, 150: 150- 165
8 周飞燕, 金林鹏, 董军 卷积神经网络研究综述[J]. 计算机学报, 2017, 40 (6): 1229- 1251
ZHOU Fei-yan, JIN Lin-peng, DONG Jun Review of convolutional neural network[J]. Chinese Journal of Computers, 2017, 40 (6): 1229- 1251
doi: 10.11897/SP.J.1016.2017.01229
9 FERNAU H, KUPPUSAMY L, RAMAN I On the computational completeness of matrix simple semi-conditional grammars[J]. Information and Computation, 2021, 1 (2): 104688- 104705
10 WU B, DRIGNEI D Emulated order identification for models of big time series data[J]. Statistical Analysis and Data Mining:the ASA Data Science Journal, 2021, 14 (2): 201- 212
doi: 10.1002/sam.11504
11 ZHAO J P, GUO W W, ZHANG Z H, et al A coupled convolutional neural network for small and densely clustered ship detection in SAR images[J]. Science China, 2019, 62 (4): 111- 126
12 姜山, 丁治明, 朱美玲, 等 面向时空图建模的图小波卷积神经网络模型[J]. 软件学报, 2021, 32 (3): 726- 741
JIANG Shan, DING Zhi-ming, ZHU Mei-ling, et al Graph wavelet convolutional neural network for spatiotemporal graph modeling[J]. Journal of Software, 2021, 32 (3): 726- 741
doi: 10.13328/j.cnki.jos.006170
13 FERRARI P, BARAKITIS N, SERRA A Asymptotic spectra of large matrices coming from the symmetrization of Toeplitz structure functions and applications to preconditioning[J]. Numerical Linear Algebra with Applications, 2021, 28 (1): 13785- 13801
14 WANG Z, LIU T Two-stage method based on triplet margin loss for pig face recognition[J]. Computers and Electronics in Agriculture, 2022, 194: 106737- 106750
doi: 10.1016/j.compag.2022.106737
15 FANG H, WANG Y W, XIAO J W, et al A new mining framework with piecewise symbolic spatial clustering[J]. Applied Energy, 2021, 298 (6): 117226- 117235
16 EL-SHORBAGY M A, ESLAMI F, IBRAHIM M, et al Numerical investigation of mixed convection of nanofluid flow in a trapezoidal channel with different aspect ratios in the presence of porous medium[J]. Case Studies in Thermal Engineering, 2021, (3): 100977- 100992
17 VIANNA P, JUNIOR G M Time-domain distance protection of transmission lines based on the conic section general equation[J]. Electric Power Systems Research, 2022, 205: 107740- 107752
doi: 10.1016/j.jpgr.2021.107740
18 CHENG L F Sparse multi-output Gaussian processes for online medical time series prediction[J]. BMC Medical Informatics and Decision Making, 2020, 20 (1): 152- 157
doi: 10.1186/s12911-020-1069-4
19 赵超, 王腾江, 刘士军, 等 融合选择提取与子类聚类的快速Shapelet发现算法[J]. 软件学报, 2020, 31 (3): 763- 777
ZHAO Chao, WANG Teng-jiang, LIU Shi-jun, et al Fast Shapelet discovery algorithm combining selective extraction and subclass clustering[J]. Journal of Software, 2020, 31 (3): 763- 777
doi: 10.13328/j.cnki.jos.005912
20 汪建梅, 彭云, 余晨钰 融合时间序列与卷积神经网络的网络谣言检测[J]. 小型微型计算机系统, 2022, 43 (5): 1020- 1026
WANG Jian-mei, PENG Yun, YU Chen-yu Network rumor detection combining time series and convolutional neural network[J]. Journal of Chinese Computer Systems, 2022, 43 (5): 1020- 1026
21 KONG D, WANG S, PING P State-of-health estimation and remaining useful life for lithium-ion battery based on deep learning with Bayesian hyperparameter optimization[J]. International Journal of Energy Research, 2022, 46 (5): 6081- 6098
doi: 10.1002/er.7548
22 ZHOU K, WANG W, HU T, et al Time series forecasting and classification models based on recurrent with attention mechanism and generative adversarial networks[J]. Sensors, 2020, 20 (24): 7211- 7218
doi: 10.3390/s20247211
23 ANDAYANI F, THENG B L, TSUN M T, et al Hybrid LSTM-transformer model for emotion recognition from speech audio files[J]. IEEE Access, 2022, 10: 36018- 36027
doi: 10.1109/ACCESS.2022.3163856
24 MARION M, CATHERINE A, RICHARD K, et al Time-series averaging using constrained dynamic time warping with tolerance[J]. Pattern Recognition: the Journal of the Pattern Recognition Society, 2018, 74: 77- 89
doi: 10.1016/j.patcog.2017.08.015
25 FRANCISCO J B, JOSE M B Distributed fast Shapelet transform: a big data time series classification algorithm[J]. Information Sciences, 2019, 496: 451- 463
doi: 10.1016/j.ins.2018.10.028
26 CHEN W, SHI K A deep learning framework for time series classification using relative position matrix and convolutional neural network[J]. Neurocomputing, 2019, 359: 384- 394
doi: 10.1016/j.neucom.2019.06.032
27 闫贺, 黄佳, 李睿安, 等 基于改进快速区域卷积神经网络的视频SAR运动目标检测算法研究[J]. 电子与信息学报, 2021, 43 (3): 615- 622
YAN He, HUANG Jia, LI Rui-an, et al Research on video SAR moving target detection algorithm based on improved faster region-based CNN[J]. Journal of Electronics and Information Technology, 2021, 43 (3): 615- 622
doi: 10.11999/JEIT200630
[1] 张师林,郭红南,刘轩. 基于能量模型的行人与车辆再识别方法[J]. 浙江大学学报(工学版), 2022, 56(7): 1416-1424.
[2] 张师林,马思明,顾子谦. 基于大边距度量学习的车辆再识别方法[J]. 浙江大学学报(工学版), 2021, 55(5): 948-956.
[3] 刘芳,汪震,刘睿迪,王锴. 基于组合损失函数的BP神经网络风力发电短期预测方法[J]. 浙江大学学报(工学版), 2021, 55(3): 594-600.
[4] 王安定, 裘渔洋, 王秀萍, 余燕平, 李式巨. 基于Toeplitz降维子矩阵的空间多目标跟踪算法[J]. J4, 2012, 46(4): 739-743.