White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Human and Group Activity Recognition from Video Sequences

Stephens, Kyle (2016) Human and Group Activity Recognition from Video Sequences. PhD thesis, University of York.

This is the latest version of this item.

human-group-activity (1).pdf - Examined Thesis (PDF)
Available under License Creative Commons Attribution-Noncommercial-No Derivative Works 2.0 UK: England & Wales.

Download (13Mb) | Preview


A good solution to human activity recognition enables the creation of a wide variety of useful applications such as applications in visual surveillance, vision-based Human-Computer-Interaction (HCI) and gesture recognition. In this thesis, a graph based approach to human activity recognition is proposed which models spatio-temporal features as contextual space-time graphs. In this method, spatio-temporal gradient cuboids were extracted at significant regions of activity, and feature graphs (gradient, space-time, local neighbours, immediate neighbours) are constructed using the similarity matrix. The Laplacian representation of the graph is utilised to reduce the computational complexity and to allow the use of traditional statistical classifiers. A second methodology is proposed to detect and localise abnormal activities in crowded scenes. This approach has two stages: training and identification. During the training stage, specific human activities are identified and characterised by employing modelling of medium-term movement flow through streaklines. Each streakline is formed by multiple optical flow vectors that represent and track locally the movement in the scene. A dictionary of activities is recorded for a given scene during the training stage. During the testing stage, the consistency of each observed activity with those from the dictionary is verified using the Kullback-Leibler (KL) divergence. The anomaly detection of the proposed methodology is compared to state of the art, producing state of the art results for localising anomalous activities. Finally, we propose an automatic group activity recognition approach by modelling the interdependencies of group activity features over time. We propose to model the group interdependences in both motion and location spaces. These spaces are extended to time-space and time-movement spaces and modelled using Kernel Density Estimation (KDE). The recognition performance of the proposed methodology shows an improvement in recognition performance over state of the art results on group activity datasets.

Item Type: Thesis (PhD)
Keywords: activity recognition, gaussian mixture models, kde, group activity, anomalous activity
Academic Units: The University of York > Computer Science (York)
Identification Number/EthosID: uk.bl.ethos.725029
Depositing User: Mr Kyle Stephens
Date Deposited: 16 Oct 2017 15:00
Last Modified: 24 Jul 2018 15:22
URI: http://etheses.whiterose.ac.uk/id/eprint/18347

Available Versions of this Item

  • Human and Group Activity Recognition from Video Sequences. (deposited 16 Oct 2017 15:00) [Currently Displayed]

You do not need to contact us to get a copy of this thesis. Please use the 'Download' link(s) above to get a copy.
You can contact us about this thesis. If you need to make a general enquiry, please see the Contact us page.

Actions (repository staff only: login required)