We present an application that demonstrates a proof of concept system for automated in-the-field monitoring of disease in wheat crops. Such in-situ applications are required to be robust in the presence of clutter, provide rapid and accurate analysis and are able to operate at scale. We propose a processing pipeline that detects key wheat diseases in cluttered field imagery. First, we describe and evaluate a high dimensional texture descriptor combined with a randomised forest approach for automated primary leaf recognition. Second, we show that a combined nearest neighbour classifier and voting system applied to segmented leaf regions can robustly determine the presence and type of disease. The system has been tested on a real-world database of images of wheat leaves captured in-the-field using a standard smart phone.

We present a method that is capable of tracking and estimating pose of articulated objects in real-time. This is achieved by using a bottom-up approach to detect instances of the object in each frame, these detections are then linked together using a high-level a priori motion model. Unlike other approaches that rely on appearance, our method is entirely dependent on motion; initial low-level part detection is based on how a region moves as opposed to its appearance. This work is best described as pictorial structures using motion. A sparse cloud of points extracted using a standard feature tracker are used as observational data, this data contains noise that is not Gaussian in nature but systematic due to tracking errors. Using a probabilistic framework we are able to overcome both corrupt and missing data whilst still inferring new poses from a generative model. Our approach requires no manual initialisation and we show results for a number of complex scenes and different classes of articulated object, this demonstrates both the robustness and versatility of the presented technique.

In order to represent large amounts of information in the form of a video key-frame summary, this paper studies narrative grammar of comics, and using its universal and intuitive rules, lays out visual summaries in an efficient and user centered way. The system ranks importance of key-frame sizes in the final layout by balancing the dominant visual representability and discovery of unanticipated content utilizing a specific cost function and an unsupervised robust spectral clustering technique. A final layout is created using an optimization algorithm based on dynamic programming. Algorithm efficiency and robustness are demonstrated by comparing the results with the optimal panelling solutions.

This paper describes a novel approach to detecting walking quadrupeds in unedited wildlife film footage. Variable lighting, moving backgrounds and camouflaged animals make traditional foreground extraction techniques such as optical flow and background subtraction unstable. We track a sparse set of points over a short film clip and interpolate dense flow, using normalized convolution. Principal component analysis (PCA) is applied to a set of dense flows, describing quadruped gait and other movements. The projection coefficients for relevant principal components are analysed as one dimensional time series. Projection coefficient variation reflects changes in the velocity and relative alignment of the components of the foreground object. These coefficients' relative phase differences are used to train a KNN classifier, which segments the training data with 93% success rate. By generating projection coefficients for unseen footage, the system has successfully located examples of quadruped gait previously missed by human observers.

We present a novel approach to motion synthesis. It is shown that by splitting sequences into segments new sequences can be created with a similar look and feel to the original. Copying segments of the original data generates a sequence which maintains detailed characteristics. By modelling each segment using an autoregressive process we can introduce new segments and therefore unseen motions. These statistical models allow a potentially infinite number of new segments to be generated. We show that this system can model complicated nonstationary sequences which a single ARP is unable to do

In this paper we propose a system that recognises gait and quadruped structure from a sparse set of tracked points. In this work the motion information is derived from dynamic wildlife film footage and is consequently extremely complex and noisy. The gait analysis is carried out on footage that contains quadrupeds, usually walking in profile to the camera, however, this part of the system is pose independent and useful for gait detection in general. The dominant motion is assumed to generate by the background and its relationship to the camera motion, enabling its removal as an initial step. Along with frequency analysis, an eigengait model is used as a template to synchronise clusters of points and to established an underlying spatio-temporal structure. Given this synchronised structure, further tracking observations are used to deform the structure to better fit the overall motion. We demonstrate that the use of an eigengait model enables the spatio-temporal localisation of walking animals and assists in overcoming difficulties caused by occlusion, tracking failure and noisy measurements.

We propose a novel method that uses simulated annealing to create an optimal surface mesh by selecting a subset of a 3D point cloud and a triangulation that reliably represents the actual topology of the scene. This method provides a number of advantages: it copes well with noisy data, it produces a simplified mesh, particularly for scenes that contain many planes and, unlike greedy search techniques, it is much more likely to converge to a global minimum.

We describe a system which is designed to assist animators in extracting high-level information from sequences of images. The system is not meant to replace animators, but to be a tool to assist them in creating the first `rough-cut' of a sequence quickly and easily. Using the system, short animations have been created in a very short space of time. We show that the method of principal components analysis followed by a neural network learning phase is capable of motion tracking (even through occlusion), feature-extraction and gait classification. We quantify the results, and demonstrate the system tracking horses, birds and actors in a film. We demonstrate a system that is powerful, flexible and, above all, easy for non-specialists to use.

We describe a system which is designed to assist in extracting high-level information from sets or sequences of images. We show that the method of principal components analysis followed by a neural network learning phase is capable of feature extraction or motion tracking, even through occlusion. Given a minimum amount of user direction for the learning phase, a wide range of features can be automatically extracted. Features discussed in this paper include information associated with human head motions and a birds wings during take-off. We have quantified the results, for instance showing that with only 25 out of 424 frames of hand labelled information a system to track a persons nose can be trained almost as accurately as a human attempting the same task. We demonstrate a system that is powerful, flexible and, above all, easy for nonspecialists to use.