A Self-Reasoning Framework for Anomaly Detection Using Video-Level Labels

by   Muhammad Zaigham Zaheer, et al.

Anomalous event detection in surveillance videos is a challenging and practical research problem among image and video processing community. Compared to the frame-level annotations of anomalous events, obtaining video-level annotations is quite fast and cheap though such high-level labels may contain significant noise. More specifically, an anomalous labeled video may actually contain anomaly only in a short duration while the rest of the video frames may be normal. In the current work, we propose a weakly supervised anomaly detection framework based on deep neural networks which is trained in a self-reasoning fashion using only video-level labels. To carry out the self-reasoning based training, we generate pseudo labels by using binary clustering of spatio-temporal video features which helps in mitigating the noise present in the labels of anomalous videos. Our proposed formulation encourages both the main network and the clustering to complement each other in achieving the goal of more accurate anomaly detection. The proposed framework has been evaluated on publicly available real-world anomaly detection datasets including UCF-crime, ShanghaiTech and UCSD Ped2. The experiments demonstrate superiority of our proposed framework over the current state-of-the-art methods.


page 1

page 4


Cleaning Label Noise with Clusters for Minimally Supervised Anomaly Detection

Learning to detect real-world anomalous events using video-level annotat...

A Modular and Unified Framework for Detecting and Localizing Video Anomalies

Anomaly detection in videos has been attracting an increasing amount of ...

DyAnNet: A Scene Dynamicity Guided Self-Trained Video Anomaly Detection Network

Unsupervised approaches for video anomaly detection may not perform as g...

PNUNet: Anomaly Detection using Positive-and-Negative Noise based on Self-Training Procedure

We propose the novel framework for anomaly detection in images. Our new ...

A Hierarchical Spatio-Temporal Graph Convolutional Neural Network for Anomaly Detection in Videos

Deep learning models have been widely used for anomaly detection in surv...

Look at Adjacent Frames: Video Anomaly Detection without Offline Training

We propose a solution to detect anomalous events in videos without the n...

CHAD: Charlotte Anomaly Dataset

In recent years, we have seen a significant interest in data-driven deep...

Please sign up or login with your details

Forgot password? Click here to reset