Co-speech gestures are essential to non-verbal communication, enhancing both the naturalness and effectiveness of human interaction. Although recent methods have made progress in generating co-speech gesture videos, many rely on strong visual controls, such as pose images or TPS key-point movements, which often lead to artifacts like blurry hands and distorted fingers. In response to these challenges, we present the Implicit Motion-Audio Entanglement (IMAE) method for co-speech gesture video generation. IMAE strengthens audio control by entangling implicit motion parameters, including pose and expression, with audio inputs. Our method utilizes a two-branch framework that combines an audio-to-motion generation branch with a video diffusion branch, enabling realistic gesture generation without requiring additional inputs during inference. To improve training efficiency, we propose a two-stage slow-fast training strategy that balances memory constraints while facilitating the learning of meaningful gestures from long frame sequences. Extensive experimental results demonstrate that our method achieves state-of-the-art performance across multiple metrics. Project Page.

Abstract Multi-behavior recommendation systems exploit multi-type user–item interactions (e.g., clicking, adding to cart and collecting) as auxiliary behaviors for user modeling, which can alleviate the problem of data sparsity faced by traditional recommendation systems. The key point of multi-behavior recommendation systems is to make full use of the auxiliary behavior information for the learning of user preferences. However, there are two challenges in existing methods that need to be explored: (1) capturing personalized user preferences based on multiple auxiliary behaviors, especially for negative feedback signals; and (2) explicitly modeling the semantics between auxiliary and target behaviors, and learning the explicit interactions between multiple behaviors. To tackle the two problems described above, we propose a novel model, called explicit behavior interaction with heterogeneous graph for multi-behavior recommendation (MB-EBIH). In particular, we first construct a heterogeneous behavior graph, including both positive and negative behaviors. A pre-trained model based on graph neural network (GNN) is then used to generate explicit behavior interaction values as the edge weights for the heterogeneous behavior graph. These weights reflect the importance of each of the auxiliary behaviors in an explicit manner. Finally, the extracted explicit behavior interaction information is incorporated into the multi-behavior user–item bipartite graphs to learn better representations. Experimental results on four real-world datasets demonstrate the effectiveness of our model in terms of exploring multi-behavioral data; and ablation and analysis experiments further demonstrate the effectiveness of explicit behavior interaction information.