In this study, we address the challenge of estimating 3D body pose, shape, and depth relationships from single RGB images in crowded scenes. The difficulty lies in the limited availability of in-the-wild training samples, which feature densely populated scenes. To mitigate this issue, we introduce a synthesis-based approach that fuses multiple human samples into a single composite scene. Our innovative scene-aware blending technique maintains human-scene consistency by positioning individuals within plausible locations and adjusting their scales to conform to 3D settings. Furthermore, our method enables flexible per-subject occlusion management during the blending process, bolstering the robustness of 3D human body representations through a novel de-occlusion training scheme. We present a one-stage model, CBD, designed to learn monocular regression of 3D people in crowds by leveraging blending and de-occlusion techniques. Our quantitative and qualitative evaluations on four benchmark datasets reveal that CBD surpasses existing state-of-the-art approaches in terms of 3D human pose and mesh regression accuracy, thereby establishing it as a promising solution for monocular 3D human mesh recovery in densely populated scenes.

In this paper, we focus on simultaneously recovering the 3D mesh of multiple body parts from a single RGB image. One of the main challenges is that available datasets with full-body 3D annotations are very limited. This results in poor generalization ability of existing learning-based methods. Existing optimization-based methods iteratively fit the 3D mesh to the 2d pose, which is very time-consuming. To address these limitations, we propose to integrate multiple 3D single-body-part datasets to create a highly diverse whole-body 3D motion space for learning from controllable synthetics. Compared with the learning-based approaches, the proposed method greatly alleviates the reliance on training data. Compared with the optimization-based approaches, the proposed method is a hundred times faster. Our proposed method also outperforms previous state-of-the-art methods on CMU Panoptic dataset.

Gesture recognition for myoelectric prosthesis control utilizing sparse multichannel surface Electromyography (sEMG) is a challenging task, and from a Muscle-Computer Interface (MCI) standpoint, the performance is still far from optimal. However, the design of a well-performed sEMG recognition system depends on the flexibility of the input-output function and the dataset's quality. To improve the performance of MCI, we proposed a novel gesture recognition framework that (i) Enrich the spectral information of the sparse sEMG signals by constructing a fused map image (denoted as sEMG-Map) that integrates a multiresolution decomposition (by means of orthogonal wavelets) through the raw signals then rely upon the Convolutional Neural Network (CNN) capacity to exploit the composite hierarchies in the constructed sEMG-Map input. (ii) Deals with the label noise by proposing a data-centric method (denoted as ALR-CNN) that synchronously refines the falsely labeled samples and optimizes the CNN model based on two basic assumptions. First, the deep model accuracy improves as the training progress. Second, a set of successive learnable max-activated outputs of a well-performed deep model is a reliable estimator for motion detection in the muscle activation pattern. Our proposed framework is evaluated on three large-scale public databases. The average classification accuracy is 95.50%, 95.85%, and 85.58% for NinaPro DB2, NinaPro DB7, and NinaPro DB3, respectively. The experimental results verify the effectuality of the proposed method and show high accuracy.

We describe an end-to-end method for recovering 3D human body mesh from single images and monocular videos. Different from the existing methods try to obtain all the complex 3D pose, shape, and camera parameters from one coupling feature, we propose a skeleton-disentangling based framework, which divides this task into multi-level spatial and temporal granularity in a decoupling manner. In spatial, we propose an effective and pluggable “disentangling the skeleton from the details” (DSD) module. It reduces the complexity and decouples the skeleton, which lays a good foundation for temporal modeling. In temporal, the self-attention based temporal convolution network is proposed to efficiently exploit the short and long-term temporal cues. Furthermore, an unsupervised adversarial training strategy, temporal shuffles and order recovery, is designed to promote the learning of motion dynamics. The proposed method outperforms the state-of-the-art 3D human mesh recovery methods by 15.4% MPJPE and 23.8% PA-MPJPE on Human3.6M. State-of-the-art results are also achieved on the 3D pose in the wild (3DPW) dataset without any fine-tuning. Especially, ablation studies demonstrate that skeleton-disentangled representation is crucial for better temporal modeling and generalization.

The existing differential approaches for localization of 3-D anatomic point landmarks in 3-D images are sensitive to noise and usually extract numerous spurious landmarks. The parametric model-based approaches are not practically usable for localization of landmarks that can not be modeled by simple parametric forms. Some dedicated methods using anatomic knowledge to identify particular landmarks are not general enough to cope with other landmarks. In this paper, we propose a model-based, semi-global segmentation approach to automatically localize 3-D point landmarks in neuroimages. To localize a landmark, the semi-global segmentation (meaning the segmentation of a part of the studied structure in a certain neighborhood of the landmark) is first achieved by an active surface model, and then the landmark is localized by analyzing the segmented part only. The joint use of global model-to-image registration, semi-global structure registration, active surface-based segmentation, and point-anchored surface registration makes our method robust to noise and shape variation. To evaluate the method, we apply it to the localization of ventricular landmarks including curvature extrema, centerline intersections, and terminal points. Experiments with 48 clinical and 18 simulated magnetic resonance (MR) volumetric images show that the proposed approach is able to localize these landmarks with an average accuracy of 1 mm (i.e., at the level of image resolution). We also illustrate the use of the proposed approach to cortical landmark identification and discuss its potential applications ranging from computer-aided radiology and surgery to atlas registration with scans.