Bochuan Song

dblp:283/7908 · DBLP profile ↗
← Back
2ranked-venue papers in the field
1as first author
2since 2021 · last 2024
—ORCID · none

Domains — venue-derived; a paper can count in several

Big Data, Cloud & Distributed Data Systems · 2 (1 first)
YearPublicationVenuePosition
2024 Idempotence-Constrained Representation Learning: Balancing Sensitive Information Elimination and Feature Robustness
abstract
Machine learning models often inadvertently learn and perpetuate biases present in training data, particularly concerning sensitive attributes like gender and race. While existing fair representation learning approaches attempt to address this issue, they face challenges in balancing information preservation with bias elimination. This paper addresses the challenge of algorithmic bias in machine learning models by proposing a novel idempotence-constrained fair representation learning framework. We introduce a two-stage architecture that effectively eliminates both explicit and implicit bias while maintaining model performance. The first stage employs an idempotent encoder to remove explicit bias and enhance feature robustness through adaptive adversarial training, while the second stage utilizes a privacy filtering unit to eliminate implicit bias and task-irrelevant features. Our framework optimizes four key objectives: task performance, information preservation, sensitive information elimination, and representation stability. Theoretical analysis demonstrates convergence guarantees and representation stability of our approach. Extensive experiments on benchmark datasets, including UCI Adult and Heritage Health, show that our method achieves state-of-the-art performance in both fairness and accuracy metrics.
Xiaoxuan Fan, Bochuan Song, Yuxue Yang
IEEE Big Data2
2024 Structured Intention Generation with Multimodal Graph Transformers: The MMIntent-LLM Framework
abstract
In the task of answering questions related to electricity knowledge, accurately understanding user intentions is fundamental to building an effective reasoning process. Questions in this domain often cover complex issues such as troubleshooting, electricity bill consultation, and electricity safety. User queries frequently involve multiple aspects and varying levels of information. Traditional single-modal methods struggle to fully address these diverse needs. Intention understanding plays a crucial role in constructing a clear and logical reasoning chain by accurately identifying the user’s core requirements. Through in-depth analysis of user intentions, the system can better organize and reason with multimodal information such as text, voice, and images—leading to logically coherent and accurate responses. Intention understanding not only enhances the accuracy of the reasoning process but also significantly improves the response efficiency and service quality of the electricity knowledge question-and-answer system. Current approaches to intention analysis primarily rely on classification-based methods, which limit the flexibility and richness of intent understanding. To broaden the scope and depth of user intent recognition, we introduce MMIntent-LLM, a novel framework that combines T5 with a Graph Transformer to generate structured intent representations from multimodal social media content. Our approach introduces three key innovations: (1) a structured intention reasoning framework based on ATOMIC, which provides a systematic method for decomposing intent generation into interpretable components; (2) a graph-based alignment mechanism for multimodal data (text and images) that ensures semantic consistency across modalities; and (3) an adaptive fine-tuning strategy that effectively transfers knowledge from pre-trained language models to the specific intent generation task. Extensive experiments on our multimodal social intention dataset show that MMIntent-LLM achieves state-of-the-art performance, improving the average BERT score by 8.7% and human evaluation scores by 12.3% compared to baseline methods.
Bochuan Song, Xiaoxuan Fan, Quanye Jia
IEEE Big Data1