Sequential Recommendation predicts the next item based on users' past behaviors, but sparse interaction data makes user preferences hard to learn. Recently, contrastive learning has shown promise in this area. It augments data to form positive pairs and maximizing their similarity, allowing the model to learn more generalizable user interests. However, they mainly adopt uniform augmentation and alignment to all sequences, ignoring the challenges arising from their distinct interest structure, namely semantic discrepancy and semantic bias. In this paper, we first study the impact of augmentation on sequence's semantic through Interest Entropy, which measures the diversity and density of interest distribution. Our finding shows only a small fraction of sequences are stable under perturbation. These sequences mainly exhibit low or high entropy, reflecting focused or casual interests. This limits the effectiveness of contrastive learning, which relies on semantically consistent positive pairs. Furthermore, with spectral analysis, we show that positive alignment may cause low-entropy sequences to overlook niche interests, while high-entropy sequences may amplify interest-irrelevant signals, which we term semantic bias. Finally, based on Interest Entropy, we propose IERec, a simple yet effective mutual retrieval augmented contrastive learning method that mitigates the above issues in a unified manner. For each anchor sequence (those with low or high entropy), we retrieve semantically similar sequences with complementary entropy, and concatenate them to form a positive view. Sequences that are easily affected, mainly those with medium entropy, are excluded from augmentation. This approach can avoid harmful semantic discrepancy of positive pairs and reduce the effect of the semantic bias, leading to improved performance. Moreover, using interest entropy to guide contrastive learning can further improve existing CL-based SR methods.

Complex Query Answering (CQA) over Knowledge Graphs (KGs) is a challenging task. Given that KGs are usually incomplete, neural models are proposed to solve CQA by performing multi-hop logical reasoning. However, most of them cannot perform well on both one-hop and multi-hop queries simultaneously. Recent work proposes a logical message passing mechanism based on the pre-trained neural link predictors. While effective on both one-hop and multi-hop queries, it ignores the difference between the constant and variable nodes in a query graph. In addition, during the node embedding update stage, this mechanism cannot dynamically measure the importance of different messages, and whether it can capture the implicit logical dependencies related to a node and received messages remains unclear. In this paper, we propose Conditional Logical Message Passing Transformer (CLMPT), which considers the difference between constants and variables in the case of using pre-trained neural link predictors and performs message passing conditionally on the node type. We empirically verified that this approach can reduce computational costs without affecting performance. Furthermore, CLMPT uses the transformer to aggregate received messages and update the corresponding node embedding. Through the self-attention mechanism, CLMPT can assign adaptive weights to elements in an input set consisting of received messages and the corresponding node and explicitly model logical dependencies between various elements. Experimental results show that CLMPT is a new state-of-the-art neural CQA model. https://github.com/qianlima-lab/CLMPT.