In a recent work, the effectiveness of neighborhood supported model level fuzzy aggregation was shown under dynamic background conditions. The multi-feature fuzzy aggregation used in that approach uses real fuzzy similarity values, and is robust for low and medium-scale dynamic background conditions such as swaying vegetation, sprinkling water, etc. The technique, however, exhibited some limitations under heavily dynamic background conditions, as features have high uncertainty under such noisy conditions and these uncertainties were not captured by real fuzzy similarity values. Our proposed algorithm is particularly focused toward improving the detection under heavy dynamic background conditions by modeling uncertainties in the data by interval-valued fuzzy set. In this paper, real-valued fuzzy aggregation has been extended to interval-valued fuzzy aggregation by considering uncertainties over real similarity values. We build up a procedure to calculate the uncertainty that varies for each feature, at each pixel, and at each time instant. We adaptively determine membership values at each pixel by the Gaussian of uncertainty value instead of fixed membership values used in recent fuzzy approaches, thereby, giving importance to a feature based on its uncertainty. Interval-valued Choquet integral is evaluated using interval similarity values and the membership values in order to calculate interval-valued fuzzy similarity between model and current. Adequate qualitative and quantitative studies are carried out to illustrate the effectiveness of the proposed method in mitigating heavily dynamic background situations as compared to state-of-the-art.

Object tracking from video sequences, although well researched, still faces difficulties under certain challenging situations. We propose a new particle filter-based tracking, where the fuzzy observation model exploits spatial correlation in a rough set-theoretic framework. We further improved certain critical steps of the particle filter such as mean state estimation and resampling. In our approach, mean state of the object at each time step is estimated with an adaptive number of high-weighted samples. These high-weighted samples are propagated along with the fresh samples generated around the current mean state to maintain sample diversity and avoid sample impoverishment. We later extended our approach to multi-cues. Given the wide applicability of statistical texture in various vision applications due to its robustness under various challenging situations, we propose to use fuzzy statistical texture cues along with fuzzy roughness color cues, and the weight for each cue is adaptively determined using the discriminating ability of the cue. Results show that our proposed particle filtering approach has less error variance across simulations and can perform tracking under challenging situations better than the contemporary ones.

Facial expression recognition is one of the open problems in computer vision. Robust neutral face recognition in real time is a major challenge for various supervised learning-based facial expression recognition methods. This is due to the fact that supervised methods cannot accommodate all appearance variability across the faces with respect to race, pose, lighting, facial biases, and so on, in the limited amount of training data. Moreover, processing each and every frame to classify emotions is not required, as user stays neutral for majority of the time in usual applications like video chat or photo album/web browsing. Detecting neutral state at an early stage, thereby bypassing those frames from emotion classification would save the computational power. In this paper, we propose a light-weight neutral versus emotion classification engine, which acts as a pre-processer to the traditional supervised emotion classification approaches. It dynamically learns neutral appearance at key emotion (KE) points using a statistical texture model, constructed by a set of reference neutral frames for each user. The proposed method is made robust to various types of user head motions by accounting for affine distortions based on a statistical texture model. Robustness to dynamic shift of KE points is achieved by evaluating the similarities on a subset of neighborhood patches around each KE point using the prior information regarding the directionality of specific facial action units acting on the respective KE point. The proposed method, as a result, improves emotion recognition (ER) accuracy and simultaneously reduces computational complexity of the ER system, as validated on multiple databases.

In this paper, we examine the suitability of correlogram for background subtraction, as a step towards moving object detection. Correlogram captures inter-pixel relationships in a region and is seen to be effective for modeling the dynamic backgrounds. A multi-channel correlogram is proposed using inter-channel and intra-channel correlograms to exploit full color information and the inter-pixel relations on the same color planes and across the planes. We thereafter derive a novel feature, termed multi-channel kernel fuzzy correlogram, composed by applying a fuzzy membership transformation over multi-channel correlogram. Multi-channel kernel fuzzy correlogram maps multi-channel correlogram into a reduced dimensionality space and is less sensitivity to noise. The approach handles multimodal distributions without using multiple models per pixel unlike traditional approaches. The approach does not require ideal background frames for background model initialization and can be initialized with moving objects also. Effectiveness of the proposed method is illustrated on different video sequences.

We propose a new algorithm for moving object detection in the presence of challenging dynamic background conditions. We use a set of fuzzy aggregated multifeature similarity measures applied on multiple models corresponding to multimodal backgrounds. The algorithm is enriched with a neighborhood-supported model initialization strategy for faster convergence. A model level fuzzy aggregation measure driven background model maintenance ensures more robustness. Similarity functions are evaluated between the corresponding elements of the current feature vector and the model feature vectors. Concepts from Sugeno and Choquet integrals are incorporated in our algorithm to compute fuzzy similarities from the ordered similarity function values for each model. Model updating and the foreground/background classification decision is based on the set of fuzzy integrals. Our proposed algorithm is shown to outperform other multi-model background subtraction algorithms. The proposed approach completely avoids explicit offline training to initialize background model and can be initialized with moving objects also. The feature space uses a combination of intensity and statistical texture features for better object localization and robustness. Our qualitative and quantitative studies illustrate the mitigation of varieties of challenging situations by our approach.

Robust detection of moving objects in presence of dynamic backgrounds is yet a challenging problem. In this letter, we propose a fuzzy membership transformation to be applied on the co-occurrence vector to derive a rich fuzzy transformed co-occurrence vector with shared membership values in a reduced dimensionality vector space. Fuzzy statistical texture features, derived from this fuzzy transformed co-occurrence vector, are able to improve the robustness in detecting moving objects, as compared to the traditional statistical texture features and other contemporary moving object segmentation approaches.