|
|
|
| Pedestrian trajectory prediction based on dual-attention spatial-temporal graph convolutional network |
Xiaoqian XIANG1( ),Jing CHEN1,2,*() |
1. School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi 214122, China
2. Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computing Intelligence, Jiangnan University, Wuxi 214122, China |
|
|
|
Abstract There are two major challenges in current research on pedestrian trajectory prediction: 1) how to effectively extract the spatial-temporal correlation between the front and back frames of pedestrians; 2) how to avoid performance degradation due to the influence of sampling bias in the trajectory sampling process. In response to the above two problems, a pedestrian trajectory prediction model was proposed based on the dual-attention spatial-temporal graph convolutional network and the purposive sampling network. Temporal attention was utilized to capture the correlation between the front and back frames, and spatial attention was utilized to capture the correlation between the surrounding pedestrians. Subsequently, the spatial-temporal correlations between pedestrians were further extracted by spatial-temporal graph convolution. Meanwhile, a learnable sampling network was introduced to resolve the problem of uneven distribution caused by random sampling. Extensive experiments showed that the accuracy of this method was comparable to that of the current state-of-the-art methods on the ETH and UCY datasets, but the number of model parameters and the inference time were reduced by 1.65×104 and 0.147 s, respectively; while the accuracy on the SDD dataset slightly decreased, but the amount of model parameters was reduced by 3.46×104, which showing a good performance balance. The proposed model can provide a new effective way for pedestrian trajectory prediction.
|
|
Received: 19 December 2023
Published: 25 November 2024
|
|
|
| Fund: 江苏省青年科学基金资助项目（BK20150159）. |
|
Corresponding Authors:
Jing CHEN
E-mail: 6213113031@stu.jiangnan.edu.cn;chenjing@jiangnan.edu.cn
|
基于双重注意力时空图卷积网络的行人轨迹预测
当前行人轨迹预测研究面临两大挑战：1）如何有效提取行人前后帧之间的时空相关性；2）如何避免在轨迹采样过程中受到采样偏差的影响而导致性能下降. 针对以上问题，提出基于双重注意力时空图卷积网络与目的抽样网络的行人轨迹预测模型. 利用时间注意力捕获行人前后帧的关联性，利用空间注意力获取周围行人之间的相关性，通过时空图卷积进一步提取行人之间的时空相关性. 引入可学习的抽样网络解决随机抽样导致的分布不均匀的问题. 大量实验表明，在ETH和UCY数据集上，新方法的精度与当前最先进的方法相当，且模型参数量减少1.65×104，推理时间缩短0.147 s；在SDD数据集上精度虽略有下降，但模型参数量减少了3.46×104，展现出良好的性能平衡，能为行人轨迹预测提供新的有效途径.
关键词：
轨迹预测,
深度学习,
图卷积网络,
时空图卷积,
时间注意力,
空间注意力,
轨迹采样
|
|
| [1] |
LUO Y, CAI P, BERA A, et al Porca: modeling and planning for autonomous driving among many pedestrians[J]. IEEE Robotics and Automation Letters, 2018, 3 (4): 3418- 3425
doi: 10.1109/LRA.2018.2852793
|
|
|
| [2] |
RUDENKO A, PALMIERI L, HERMAN M, et al Human motion trajectory prediction: a survey[J]. The International Journal of Robotics Research, 2020, 39 (8): 895- 935
doi: 10.1177/0278364920917446
|
|
|
| [3] |
ALAHI A, GOEL K, RAMANATHAN V, et al. Social LSTM: human trajectory prediction in crowded spaces [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Las Vegas: IEEE , 2016: 961–971.
|
|
|
| [4] |
XUE H, HUYNH D Q, REYNOLDS M. SS-LSTM: a hierarchical LSTM model for pedestrian trajectory prediction [C]// 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) . Lake Tahoe: IEEE, 2018: 1186–1194.
|
|
|
| [5] |
ZHANG P, OUYANG W L, ZHANG P F, et al. SR-LSTM: state refinement for LSTM towards pedestrian trajectory prediction [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Long Beach: IEEE, 2019: 12085–12094.
|
|
|
| [6] |
孔玮, 刘云, 李辉, 等 基于图卷积网络的行为识别方法综述[J]. 控制与决策, 2021, 36 (7): 1537- 1546
KONG Wei, LIU Yun, LI Hui, et al A survey of action recognition methods based on graph convolutional network[J]. Control and Decision, 2021, 36 (7): 1537- 1546
|
|
|
| [7] |
MOHAMED A, QIAN K, ELHOSEINY M, et al. Social-STGCNN: a social spatio-temporal graph convolutional neural network for human trajectory prediction [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle: IEEE, 2020: 14424–14432.
|
|
|
| [8] |
SHI L, WANG L, LONG C, et al. SGCN: sparse graph convolution network for pedestrian trajectory prediction [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Nashville: IEEE, 2021: 8994–9003.
|
|
|
| [9] |
WU Z, PAN S, CHEN F, et al A comprehensive survey on graph neural networks[J]. IEEE Transactions on Neural Networks and Learning Systems, 2020, 32 (1): 4- 24
|
|
|
| [10] |
GUPTA A, JOHNSON J, FEI-FEI L, et al. Social GAN: socially acceptable trajectories with generative adversarial networks [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Salt Lake: IEEE, 2018: 2255–2264.
|
|
|
| [11] |
BAE I, PARK J H, JEON H G. Non-probability sampling network for stochastic human trajectory prediction [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . New Orleans: IEEE, 2022: 6477–6487.
|
|
|
| [12] |
MA Y J, INALA J P, JAYARAMAN D, et al. Likelihood-based diverse sampling for trajectory forecasting [C]// Proceedings of the IEEE/CVF International Conference on Computer Vision . Montreal: IEEE, 2021: 13279–13288.
|
|
|
| [13] |
VEMULA A, MUELLING K, OH J. Social attention: modeling attention in human crowds [C]// 2018 IEEE International Conference on Robotics and Automation . Brisbane: IEEE, 2018: 4601–4607.
|
|
|
| [14] |
KOSARAJU V, SADEGHIAN A, MARTÍN-MARTÍN R, et al. Social-bigat: multimodal trajectory forecasting using bicycle-gan and graph attention networks [C]// Proceedings of the Annual Conference on Neural Information Processing Systems . Vancouver: NeurIPS, 2019: 1–10.
|
|
|
| [15] |
MANGALAM K, GIRASE H, AGARWAL S, et al. It is not the journey but the destination: endpoint conditioned trajectory prediction [C]// Computer Vision–ECCV 2020: 16th European Conference . Glasgow: Springer International Publishing, 2020: 759–776.
|
|
|
| [16] |
LIANG J, JIANG L, NIEBLES J C, et al. Peeking into the future: predicting future person activities and locations in videos [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach: IEEE, 2019: 5725–5734.
|
|
|
| [17] |
HUANG Y, BI H, LI Z, et al. Stgat: modeling spatial-temporal interactions for human trajectory prediction [C]// Proceedings of the IEEE/CVF International Conference on Computer Vision . Seoul: IEEE, 2019: 6272–6281.
|
|
|
| [18] |
YU C, MA X, REN J, et al. Spatio-temporal graph transformer networks for pedestrian trajectory prediction [C]// Computer Vision-ECCV 2020: 16th European Conference . Glasgow: Springer International Publishing, 2020: 507–523.
|
|
|
| [19] |
YUAN Y, WENG X, OU Y, et al. Agentformer: agent-aware transformers for socio-temporal multi-agent forecasting [C]// Proceedings of the IEEE/CVF International Conference on Computer Vision . Montreal: IEEE, 2021: 9813–9823.
|
|
|
| [20] |
SHI L, WANG L, LONG C, et al. Social interpretable tree for pedestrian trajectory prediction [C]// Proceedings of the AAAI Conference on Artificial Intelligence . [s.l.]: AAAI, 2022, 36(2): 2235–2243.
|
|
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|
