Spatiotemporal Distilled Dense-Connectivity Network for Video Action Recognition
Wangli Hao; Zhaoxiang Zhang
刊名Pattern Recognition
2019
卷号10期号:20页码:100-130
关键词Two-stream Action Recognition Dense-connectivity Knowledge Distillation
英文摘要

Two-stream convolutional neural networks show great promise for action recognition tasks. However, most two-stream based approaches train the appearance and motion subnetworks independently, which may lead to the decline in performance due to the lack of interactions among two streams. To overcome this limitation, we propose a Spatiotemporal Distilled Dense-Connectivity Network (STDDCN) for video action recognition. This network implements both knowledge distillation and dense-connectivity (adapted from DenseNet). Using this STDDCN architecture, we aim to explore interaction strategies between appearance and motion streams along different hierarchies. Specifically, block-level dense connections between appearance and motion pathways enable spatiotemporal interaction at the feature representation
layers. Moreover, knowledge distillation among two streams (each treated as a student) and their last fusion (treated as teacher) allows both streams to interact at the high level layers. The special architecture of STDDCN allows it to gradually obtain effective hierarchical spatiotemporal features. Moreover, it can be trained end-to-end. Finally, numerous ablation studies validate the effectiveness and generalization of our model on two benchmark datasets, including UCF101 and HMDB51. Simultaneously, our model achieves promising performances.

 

内容类型期刊论文
源URL[http://ir.ia.ac.cn/handle/173211/23347]  
专题自动化研究所_模式识别国家重点实验室
自动化研究所_智能感知与计算研究中心
通讯作者Zhaoxiang Zhang
作者单位1.Center of Research on Intelligent Perception and Computing (CRIPAC), National Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese
2.Center for Excellence in Brain Science and Intelligence Technology (CEBSIT)
3.University of Chinese Academy of Sciences (UCAS)
推荐引用方式
GB/T 7714
Wangli Hao,Zhaoxiang Zhang. Spatiotemporal Distilled Dense-Connectivity Network for Video Action Recognition[J]. Pattern Recognition,2019,10(20):100-130.
APA Wangli Hao,&Zhaoxiang Zhang.(2019).Spatiotemporal Distilled Dense-Connectivity Network for Video Action Recognition.Pattern Recognition,10(20),100-130.
MLA Wangli Hao,et al."Spatiotemporal Distilled Dense-Connectivity Network for Video Action Recognition".Pattern Recognition 10.20(2019):100-130.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace