摘要
为了在视频异常行为检测中更加充分地运用外观和动作信息,设计出了一种能同时捕捉外观和动作信息的孪生网络模型。该网络的两个分支采用相同的自编码器结构,其中的外观子网络以连续几帧RGB图作为输入来预测下一帧,而动作子网络则输入RGB帧差图来预测未来帧差图。此外,考虑到影响基于预测的方法的检测效果的原因之一,即正常样本的多样性以及自编码器网络强大的“生成”能力,即对部分异常样本也有很好的预测效果,因此在编码器与解码器之间加入一个学习并存储正常样本的“原型”特征的记忆增强模块,从而使异常样本能获得更大的预测误差。在Avenue、UCSD-ped2和ShanghaiTech三个公共的异常数据集上进行了广泛的实验。实验结果表明,相较于其他基于重建或预测的视频异常行为检测方法,所提方法取得了更优异的表现。具体来说,该方法在Avenue、UCSDped2和ShanghaiTech数据集上的平均曲线下面积(AUC)分别达到了88.2%、97.5%和73.0%。
In order to make full use of appearance and motion information in video abnormal behavior detection,a Siamese network model that can capture appearance and motion information at the same time was proposed.The two branches of the network were composed of the same autoencoder structure.Several consecutive frames of RGB images were used as the input of the appearance sub-network to predict the next frame,while RGB frame difference image was used as the input of the motion sub-network to predict the future frame difference.In addition,considering one of the reasons that affected the detection effect of the prediction-based method,that is the diversity of normal samples,and the powerful“generation”ability of the autoencoder network,that is it has a good prediction effect on some abnormal samples.Therefore,a memory enhancement module that learns and stores the“prototype”features of normal samples was added between the encoder and the decoder,so that the abnormal samples were able to obtain greater prediction error.Extensive experiments were conducted on three public anomaly detection datasets Avenue,UCSD-ped2 and ShanghaiTech.Experimental results show that,compared with other video abnormal behavior detection methods based on reconstruction or prediction,the proposed method achieves better performance.Specifically,the average Area Under Curve(AUC)of the proposed method on Avenue,UCSD-ped2 and ShanghaiTech datasets reach 88.2%,97.5%and 73.0%respectively.
作者
李自强
王正勇
陈洪刚
李林怡
何小海
LI Ziqiang;WANG Zhengyong;CHEN Honggang;LI Linyi;HE Xiaohai(College of Electronics and Information Engineering,Sichuan University,Chengdu Sichuan 610065,China;The Second Research Institute of Civil Aviation Administration of China,Chengdu Sichuan 610041,China)
出处
《计算机应用》
CSCD
北大核心
2021年第10期2997-3003,共7页
journal of Computer Applications
基金
国家自然科学基金资助项目(61871278)
四川省科技计划项目(2019YFH0034)。
关键词
异常行为检测
视频监控
自编码器
记忆增强
孪生网络
abnormal behavior detection
video surveillance
autoencoder
memory enhancement
Siamese network
