Spurious correlations cause deep learning models to rely on predictive shortcuts that hold in the training data but break under distribution shifts, leading to large performance drops for minority groups. Existing strategies often rely on costly group annotations or employ unstable adversarial training. In this paper, we propose Prototype-guided debiasing using Robust Invariant Feature Transformations (PRIFT), a novel framework that mitigates spurious correlations by manipulating latent space geometry. Specifically, we introduce a prototype-guided modeling approach that leverages natural language prompts to represent confounders, transforming abstract biases into interpretable geometric anchors without auxiliary classifiers. Based on these anchors, we introduce a centered projection operator that adaptively purifies representations by removing confounding deviations specific to instances while preserving essential semantic structure. Furthermore, PRIFT can handle confounding factor information at different levels, ranging from true labels to unsupervised latent inference. Experiments on four text classification benchmarks demonstrate the superiority of our method; notably, PRIFT outperforms state-of-the-art baselines and improves worst-group accuracy by over 20% on the CivilComments dataset compared to standard empirical risk minimization.

Aspect-based sentiment analysis (ABSA) aims to extract fine-grained opinions from the text by discerning sentiments toward specific aspects. Although large language models (LLMs) perform well in-context learning (ICL), current ICL methodologies typically retrieve semantically similar but structurally redundant examples, failing to capture syntactic and aspect-level cues critical for ABSA. To overcome these limitations, we report Multi-perspective Sequential retrieval with Predictive Feedback (MSPF), a few-shot learning framework that enhances ICL through MSPF, which integrates three complementary perspectives: overall semantic, syntactic relevance, and aspect sentiment alignment. Evaluated on four benchmark datasets (Laptop14, Restaurant14, Books, and Clothing), MSPF achieved F1 scores of 67.03 % (Laptop14), 73.51 % (Restaurant14), 76.07 % (Books), and 81.96 % (Clothing), outperforming standard ICL by +7.06 %, +5.60 %, +25.61 %, and +18.38 %, respectively. These results validated the efficacy of MSPF in improving LLM reasoning for fine-grained sentiment tasks with limited annotations.