Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Shide Du

dblp:300/1481 · DBLP profile ↗
← Back
39ranked-venue papers
5as first author
39since 2021 · last 2026
0000-0002-6354-4705ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Graphics, computer vision, multimedia, augmented reality and games · 19 · 4 first-author · 19 since 2021Artificial intelligence and machine learning · 18 · 1 first-author · 18 since 2021Databases, data management, data science and information retrieval · 6 · 6 since 2021Applied, interdisciplinary, general and emerging computing · 3 · 1 first-author · 3 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
17 papers
Representation and self-supervised learning · 28% Trustworthy machine learning · 26% Graph learning · 24%
Databases, data mining, and information retrieval
3 papers
Data mining · 100%

Topics — the 30 heaviest of 47, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Graph learning › multi-graph learning
multi-view graph learning
3.642026
Graph Meets Deep Unfolding: An Interpretable Mutual-benefit Multi-view Learning Network · AAAI 2026
From Static to Active: Knowledge-Aware Node State Selection in Multi-view Graph Learning · AAAI 2026
MBGCN: Multi-View Block-Wise Graph Convolutional Networks on Large-Scale Graphs · IEEE Trans. Image Process. 2025
Machine learning › Representation and self-supervised learning
multi-view learning
3.542026
From Static to Active: Knowledge-Aware Node State Selection in Multi-view Graph Learning · AAAI 2026
MBGCN: Multi-View Block-Wise Graph Convolutional Networks on Large-Scale Graphs · IEEE Trans. Image Process. 2025
OpenViewer: Openness-Aware Multi-View Learning · AAAI 2025
Machine learning › Trustworthy machine learning
interpretability
3.442026
Interpretable Multi-View Representation Learning Towards Complex Scenes: From Homogeneity to Heterogeneity · IEEE Trans. Multim. 2026
OIMGC-Net: Optimization-inspired Interpretable Multi-view Graph Clustering Network · ACM Multimedia 2025
OpenViewer: Openness-Aware Multi-View Learning · AAAI 2025
Machine learning › Representation and self-supervised learning › multi-view learning
multi-view representation learning
2.232026
Interpretable Multi-View Representation Learning Towards Complex Scenes: From Homogeneity to Heterogeneity · IEEE Trans. Multim. 2026
DIN: Dual Impulse Network for Multi-view Representation Learning · AAAI 2026
Dual Fusion-Propagation Graph Neural Network for Multi-View Clustering · IEEE Trans. Multim. 2023
Machine learning › Trustworthy machine learning › interpretability
interpretable representation learning
2.022026
Interpretable Multi-View Representation Learning Towards Complex Scenes: From Homogeneity to Heterogeneity · IEEE Trans. Multim. 2026
SOI-Net: Structural Optimization-Inspired Interpretable Network for Incomplete Multi-View Clustering · IEEE Trans. Multim. 2026
Machine learning › Representation and self-supervised learning › multi-view learning
multi-view clustering
1.722026
SOI-Net: Structural Optimization-Inspired Interpretable Network for Incomplete Multi-View Clustering · IEEE Trans. Multim. 2026
Dual Fusion-Propagation Graph Neural Network for Multi-View Clustering · IEEE Trans. Multim. 2023
Data mining
clustering
1.332025
LargeMvC-Net: Anchor-based Deep Unfolding Network for Large-scale Multi-view Clustering · ACM Multimedia 2025
UMCGL: Universal Multi-View Consensus Graph Learning With Consistency and Diversity · IEEE Trans. Image Process. 2024
Learning Deep Sparse Regularizers With Applications to Multi-View Clustering and Semi-Supervised Classification · IEEE Trans. Pattern Anal. Mach. Intell. 2022
Data mining › clustering
multi-view clustering
1.332025
LargeMvC-Net: Anchor-based Deep Unfolding Network for Large-scale Multi-view Clustering · ACM Multimedia 2025
UMCGL: Universal Multi-View Consensus Graph Learning With Consistency and Diversity · IEEE Trans. Image Process. 2024
Learning Deep Sparse Regularizers With Applications to Multi-View Clustering and Semi-Supervised Classification · IEEE Trans. Pattern Anal. Mach. Intell. 2022
Machine learning › Graph learning
graph representation learning
1.122026
UMCGL: Universal Multi-View Consensus Graph Learning With Consistency and Diversity · IEEE Trans. Image Process. 2024
Graph Meets Deep Unfolding: An Interpretable Mutual-benefit Multi-view Learning Network · AAAI 2026
Machine learning › Deep learning architectures and training
attention mechanism
1.012026
DIN: Dual Impulse Network for Multi-view Representation Learning · AAAI 2026
Robotics › Motion planning and robot control
dynamic modeling
1.012026
From Static to Active: Knowledge-Aware Node State Selection in Multi-view Graph Learning · AAAI 2026
Machine learning › Representation and self-supervised learning › multi-view learning › multi-view clustering
incomplete multi-view clustering
1.012026
SOI-Net: Structural Optimization-Inspired Interpretable Network for Incomplete Multi-View Clustering · IEEE Trans. Multim. 2026
Machine learning › Deep learning architectures and training › model-based deep learning
deep unfolding
0.912025
OpenViewer: Openness-Aware Multi-View Learning · AAAI 2025
Machine learning › Graph learning
graph clustering
0.912025
OIMGC-Net: Optimization-inspired Interpretable Multi-view Graph Clustering Network · ACM Multimedia 2025
Machine learning › Graph learning › graph neural network
graph convolutional network
0.912025
MBGCN: Multi-View Block-Wise Graph Convolutional Networks on Large-Scale Graphs · IEEE Trans. Image Process. 2025
Computer vision › Image recognition and object detection
image retrieval
0.912025
Focus on Local: Finding Reliable Discriminative Regions for Visual Place Recognition · AAAI 2025
Machine learning › Graph learning › graph clustering
multi-view graph clustering
0.912025
OIMGC-Net: Optimization-inspired Interpretable Multi-view Graph Clustering Network · ACM Multimedia 2025
Machine learning › Trustworthy machine learning › open-world recognition
open-set recognition
0.912025
Enhancing Multi-view Open-set Learning via Ambiguity Uncertainty Calibration and View-wise Debiasing · ACM Multimedia 2025
Machine learning › Efficient and distributed learning
parameter-efficient fine-tuning
0.912025
HiTuner: Hierarchical Semantic Fusion Model Fine-Tuning on Text-Attributed Graphs · IJCAI 2025
Natural language and speech › Language models and text generation › large language model › large language model adaptation
pre-trained language model fine-tuning
0.912025
HiTuner: Hierarchical Semantic Fusion Model Fine-Tuning on Text-Attributed Graphs · IJCAI 2025
Natural language and speech › Language models and text generation
reranking
0.912025
Focus on Local: Finding Reliable Discriminative Regions for Visual Place Recognition · AAAI 2025
Machine learning › Graph learning › graph representation learning
text-attributed graph learning
0.912025
HiTuner: Hierarchical Semantic Fusion Model Fine-Tuning on Text-Attributed Graphs · IJCAI 2025
Machine learning › Trustworthy machine learning › uncertainty estimation
uncertainty calibration
0.912025
Enhancing Multi-view Open-set Learning via Ambiguity Uncertainty Calibration and View-wise Debiasing · ACM Multimedia 2025
Robotics › Robot navigation and mapping › place recognition
visual place recognition
0.912025
Focus on Local: Finding Reliable Discriminative Regions for Visual Place Recognition · AAAI 2025
Data mining › clustering › prototype-based clustering
anchor-based clustering
0.912025
LargeMvC-Net: Anchor-based Deep Unfolding Network for Large-scale Multi-view Clustering · ACM Multimedia 2025
Data mining › clustering › multi-view clustering
large-scale multi-view clustering
0.912025
LargeMvC-Net: Anchor-based Deep Unfolding Network for Large-scale Multi-view Clustering · ACM Multimedia 2025
Machine learning › Graph learning › graph structure learning
consensus graph learning
0.812024
UMCGL: Universal Multi-View Consensus Graph Learning With Consistency and Diversity · IEEE Trans. Image Process. 2024
Machine learning › Representation and self-supervised learning › contrastive learning
graph contrastive learning
0.812024
UMCGL: Universal Multi-View Consensus Graph Learning With Consistency and Diversity · IEEE Trans. Image Process. 2024
Machine learning › Trustworthy machine learning › neural network interpretability
interpretable network design
0.812024
Representation Learning Meets Optimization-Derived Networks: From Single-View to Multi-View · IEEE Trans. Multim. 2024
Machine learning › Representation and self-supervised learning › multi-view learning › multi-view clustering
deep multi-view clustering
0.712023
Dual Fusion-Propagation Graph Neural Network for Multi-View Clustering · IEEE Trans. Multim. 2023

Methods — techniques the papers use, named apart from their topics

contrastive learning · 5.2structural optimization · 2.0deep network unrolling · 2.0deep unfolding · 1.9state space model · 1.0mask-based attention · 1.0impulse network · 1.0diffusion equation · 1.0alternating direction method of multipliers · 1.0ADMM · 1.0unsupervised reconstruction loss · 0.9tensor low-rank constraint · 0.8generative graph learning · 0.8proximal gradient algorithm · 0.6deep learning · 0.6backpropagation · 0.6
YearPublicationVenuePosition
2026 From Static to Active: Knowledge-Aware Node State Selection in Multi-view Graph Learning
abstract
Multimedia technologies leverage multi-source to alleviate real-world data incompleteness, providing a versatile platform for multi-view learning. Among existing research, graph-based multi-view learning has achieved notable success. However, prior studies always immerse in comprehensive collaboration across all views and nodes to pursue consistency and complementary, which ignore the negative contribution of nodes from low-quality views. To overcome the above limitation, we explore node behavior selection in multi-view dynamic modeling and propose a knowledge-aware multi-view state space model. Specifically, nodes autonomously select either activation sequences or static sequences according to their current knowledge. In the former, we design the mask-based attention mechanism to capture the dynamics of node behaviors. In the latter, we construct a history pool and simulate synaptic signals to regulate the behavioral distribution of nodes. Moreover, the proposed model provides a directional inter-view diffusion equation that selectively propagates information to alleviate interference from low-quality nodes across views. Extensive experiments demonstrate that the proposed model outperforms baselines on multiple benchmarks and achieves significant performance improvement.
Weiran Liao, Jielong Lu, Shide Du, Hongrong Chen, Shiping Wang
AAAI4
2026 Graph Meets Deep Unfolding: An Interpretable Mutual-benefit Multi-view Learning Network
abstract
Significant efforts have been focused on enhancing the utilization of multiple node features and topological structures in multi-view graph learning through explicit model-driven and implicit deep learning-based methodologies. The former excels in embedding prior knowledge, thereby offering theoretical interpretability but is limited in application flexibility due to manual parameter selection. In contrast, the latter leverages automatic differentiation, providing greater flexibility but lacking theoretical interpretability due to their opaque nature. Motivated by these observations, we propose an interpretable deep unfolding network for mutual-benefit multi-view graph learning, aiming to combine the strengths of both approaches. Specifically, we employ the Alternating Direction Method of Multipliers (ADMM) to solve a multi-view graph learning model with sparse and low-rank constraints. This solution is then integrated into deep unfolding networks to enhance interpretability. Furthermore, we convert optimization conditions into implicit losses and utilize automatic differentiation to update parameters, reducing the need for manual tuning and increasing flexibility. This integration optimizes multi-view learning for a graph representation that balances interpretability and flexibility. Empirical evaluations on six diverse datasets demonstrate the effectiveness and superiority of the proposed method over state-of-the-art approaches.
Renjie Lin, Hongzhi He, Yilin Wu 0001, Shide Du, Le Zhang 0001
AAAI4
2026 DIN: Dual Impulse Network for Multi-view Representation Learning
abstract
Multi-view representation learning, which utilizes multiple channels to improve perceptual accuracy, is recognized for its effectiveness in the analysis of multi-view data. However, deploying these methods in real-world scenarios presents two primary challenges. 1) Lack of Variegation: Multi-view representation techniques commonly observe along a singular axis, i.e., the attribute axis; 2) Insufficient Relationship: Most multi-view models lack mechanisms for exploring potential relationships between attribute axis and channel axis. To mitigate these obstacles, we design a Dual Impulse Network framework for multi-view representation learning (DIN) to train a feature representation. In this framework, a strategy observed along the channel axis and attribute axis simultaneously is introduced, and two different representations are generated by two analogous impulse networks, which are capable of extracting information corresponding to different axes. Furthermore, we incorporate an integration network that analyzes the potential relationship between attribute axis and channel axis to generate two attention matrices. The final two feature representations derived from these attention matrices are aggregated to amplify the expression of internal information. Comprehensive experimental results support the efficacy and superiority of the proposed framework, demonstrating improvements in classification performance compared to state-of-the-art methods.
Yilin Wu 0001, Weihong Lin, Renjie Lin, Zihan Fang 0002, Shide Du, Shiping Wang
AAAI5
2026 Attention meets convolution: Dual-channel multi-view fusion network
Fu Zhao, Zihan Fang 0002, Shide Du, Zhiling Cai, Hongju Cheng, Shiping Wang
Inf. Sci.3
2026 Harnessing noisy LLM annotations: Confidence-calibrated node selection on text-attributed graphs
Zihan Fang 0002, Shide Du, Zhihao Wu 0003, Zhiling Cai, Yanchao Tan, Shiping Wang, Zhouchen Lin
Pattern Recognit.2
2026 SOI-Net: Structural Optimization-Inspired Interpretable Network for Incomplete Multi-View Clustering
abstract
Data missing is a common issue in real-world applications, posing significant challenges for incomplete data processing. Traditional incomplete multi-view clustering methods rely on manually-designed optimization problems based on prior interpretable knowledge, considering the full utilization of available data. However, their limited feature extraction capability may become a bottleneck. In contrast, deep optimization methods leverage learning-based nonlinear transformations for clustering. They primarily achieve data imputation through the generalization ability of deep models, but their model interpretability may be limited by the black-box nature. Moreover, most existing methods only explore the structure of each view independently, where these structures are fixed and cannot form a complete unified structure. To address these issues, we propose a Structural Optimization-inspired Interpretable Network (SOI-Net) for incomplete multi-view clustering. Specifically, we project the features of all views into a unified representation space with the un-missing information of the views as constraints. By optimizing consistent structural information, we preserve the structures of missing modalities in the unified representation space, thereby mitigating the impact of missing data. Meanwhile, we derive network components based on the optimization problem to guide the learning of structure and representation. The practical significance of these network components provides model design-level interpretability. Extensive experiments on six datasets validate the effectiveness of SOI-Net in handling incomplete multi-view clustering task.
Zihan Fang 0002, Zhiling Cai, Shide Du, Wei Huang 0037, Shiping Wang
IEEE Trans. Multim.4
2026 Interpretable Multi-View Representation Learning Towards Complex Scenes: From Homogeneity to Heterogeneity
abstract
Multi-view representation learning is recognized for its effectiveness in multi-source data analysis, yet it faces significant challenges: 1) Deep model structures remain opaque, lacking interpretability; 2) Research on compatibility models toward multi-feature and multi-relationship data is insufficient. In this paper, we introduce an interpretable multi-view representation learning framework specifically designed for the complex multi view scene. The barrier to achieving compatibility stems from the need to simultaneously process the homogeneous information inherent in multiple features and the heterogeneous characteristic of multi-relation data. To address this, we design an objective function solved by iterative methods to learn comprehensive relationships and the consistent representation. The introduction of comprehensive relationships aims to mitigate mutual interference among different data types while combining information abstracted from original features and relationships into a unified representation. We then convert iterative solutions into feed-forward network layers with embedded learnable modules, resulting in a deep network architecture that is interpretable at the design level. Extensive experimental results demonstrate the superior performance of the proposed method over state-of-the art approaches.
Ying Zou 0024, Zihan Fang 0002, Shide Du, Yilin Wu 0001, Hong Zhao 0002, Shiping Wang
IEEE Trans. Multim.3
2026 Be Reliable: An Interpretable Attribute-Oriented Representation Learning Framework
abstract
Representation learning techniques effectively unveil latent patterns within raw data. However, the learning process is often marred by uncertainties, such as variations in data quality and heterogeneous scenarios, which greatly affect the reliability of representation learning. In this article, we introduce a reliable representation learning framework to establish a connection between data attributes and modeling strategies, namely the interpretable attribute-oriented representation learning framework. First, by focusing on the inherent knowledge embedded in the data, we decouple it into four principal attributes: fidelity, topology, invariance, and discriminability. To explicitly address these attributes, we incorporate them into an optimization-derived framework using corresponding general loss terms. Furthermore, by treating the iterative solution process as a bridge, each derived network module possesses traceable interpretability, thus laying a reliable foundation. Ultimately, we extend the proposed framework to multisource heterogeneous scenarios, enabling it to adapt to complex environments while maintaining reliability. In essence, our work aims to seamlessly integrate deep representations with prior knowledge during the learning process, thereby creating a solid basis for dependable modeling. Networks derived from the proposed framework achieve promising results, particularly in complex multisource heterogeneous environments, demonstrating both their effectiveness and reliability. The code is available at https://github.com/ZihanFang11/2025_AORLNet_TNNLS.
Zihan Fang 0002, Shide Du, Ying Zou 0024, Yanchao Tan, Na Song, Shiping Wang
IEEE Trans. Neural Networks Learn. Syst.2
2025 Focus on Local: Finding Reliable Discriminative Regions for Visual Place Recognition
abstract
Visual Place Recognition (VPR) is aimed at predicting the location of a query image by referencing a database of geotagged images. For VPR task, often fewer discriminative local regions in an image produce important effects while mundane background regions do not contribute or even cause perceptual aliasing because of easy overlap. However, existing methods lack precisely modeling and full exploitation of these discriminative regions. In addition, the lack of pixel-level correspondence supervision in the VPR dataset hinders further improvement of the local feature matching capability in the re-ranking stage. In this paper, we propose the Focus on Local (FoL) approach to stimulate the performance of image retrieval and re-ranking in VPR simultaneously by mining and exploiting reliable discriminative local regions in images and introducing pseudo-correlation supervision. First, we design two losses, Extraction-Aggregation Spatial Alignment Loss (SAL) and Foreground-Background Contrast Enhancement Loss (CEL), to explicitly model reliable discriminative local regions and use them to guide the generation of global representations and efficient re-ranking. Second, we introduce a weakly-supervised local feature training strategy based on pseudo-correspondences obtained from aggregating global features to alleviate the lack of local correspondences ground truth for the VPR task. Third, we suggest an efficient re-ranking pipeline that is efficiently and precisely based on discriminative region guidance. Finally, experimental results show that our FoL achieves the state-of-the-art on multiple VPR benchmarks in both image retrieval and re-ranking stages and also significantly outperforms existing two-stage VPR methods in terms of computational efficiency.
Changwei Wang 0001, Shunpeng Chen, Rongtao Xu, Jiguang Zhang, Haoran Yang 0003, Yu Zhang 0133, Kexue Fu 0001, Shide Du, Zhiwei Xu 0005, Longxiang Gao, Li Guo 0004, Shibiao Xu
AAAI10
2025 OpenViewer: Openness-Aware Multi-View Learning
abstract
Multi-view learning methods leverage multiple data sources to enhance perception by mining correlations across views, typically relying on predefined categories. However, deploying these models in real-world scenarios presents two primary openness challenges. 1) Lack of Interpretability: The integration mechanisms of multi-view data in existing black-box models remain poorly explained; 2) Insufficient Generalization: Most models are not adapted to multi-view scenarios involving unknown categories. To address these challenges, we propose OpenViewer, an openness-aware multi-view learning framework with theoretical support. This framework begins with a Pseudo-Unknown Sample Generation Mechanism to efficiently simulate open multi-view environments and previously adapt to potential unknown samples. Subsequently, we introduce an Expression-Enhanced Deep Unfolding Network to intuitively promote interpretability by systematically constructing functional prior-mapping modules and effectively providing a more transparent integration mechanism for multi-view data. Additionally, we establish a Perception-Augmented Open-Set Training Regime to significantly enhance generalization by precisely boosting confidences for known categories and carefully suppressing inappropriate confidences for unknown ones. Experimental results demonstrate that OpenViewer effectively addresses openness challenges while ensuring recognition performance for both known and unknown samples.
Shide Du, Zihan Fang 0002, Yanchao Tan, Changwei Wang 0001, Shiping Wang, Wenzhong Guo
AAAI1
2025 Constraint-Aware Multi-View Clustering via Graph Contrastive Learning
Zhengnan Chen, Zihan Fang 0002, Shide Du, Shiping Wang
ADMA (2)4
2025 HiTuner: Hierarchical Semantic Fusion Model Fine-Tuning on Text-Attributed Graphs
abstract
Text-Attributed Graphs (TAGs) are vital for modeling entity relationships across various domains. Graph Neural Networks have become cornerstone for processing graph structures, while the integration of text attributes remains a prominent research. The development of Large Language Models (LLMs) provides new opportunities for advancing textual encoding in TAGs. However, LLMs face challenges in specialized domains due to their limited task-specific knowledge, and fine-tuning them for specific tasks demands significant resources. To cope with the above challenges, we propose HiTuner, a novel framework that leverages fine-tuned Pre-trained Language Models (PLMs) with domain expertise as tuner to enhance the hierarchical LLM contextualized representations for modeling TAGs. Specifically, we first strategically select hierarchical hidden states of LLM to form a set of diverse and complementary descriptions as input for the sparse projection operator. Concurrently, a hybrid representation learning is developed to amalgamate the broad linguistic comprehension of LLMs with task-specific insights of the fine-tuned PLMs. Finally, HiTuner employs a confidence network to adaptively fuse the semantically-augmented representations. Empirical results across benchmark datasets spanning various domains validate the effectiveness of the proposed framework. Our codes are available at: https://github.com/ZihanFang11/HiTuner
Zihan Fang 0002, Zhiling Cai, Yuxuan Zheng, Shide Du, Yanchao Tan, Shiping Wang
IJCAI4
2025 LargeMvC-Net: Anchor-based Deep Unfolding Network for Large-scale Multi-view Clustering
abstract
Deep anchor-based multi-view clustering methods enhance the scalability of neural networks by utilizing representative anchors to reduce the computational complexity of large-scale clustering. Despite their scalability advantages, existing approaches often incorporate anchor structures in a heuristic or task-agnostic manner, either through post-hoc graph construction or as auxiliary components for message passing. Such designs overlook the core structural demands of anchor-based clustering, neglecting key optimization principles. To bridge this gap, we revisit the underlying optimization problem of large-scale anchor-based multi-view clustering and unfold its iterative solution into a novel deep network architecture, termed LargeMvC-Net. The proposed model decomposes the anchor-based clustering process into three modules: RepresentModule, NoiseModule, and AnchorModule, corresponding to representation learning, noise suppression, and anchor estimation. Each module is derived by unfolding a step of the original optimization procedure into a dedicated network component, providing structural clarity and optimization traceability. In addition, an unsupervised reconstruction loss aligns each view with the anchor-induced latent space, encouraging consistent clustering structures across views. Extensive experiments on several large-scale multi-view benchmarks show that LargeMvC-Net consistently outperforms state-of-the-art methods in terms of both effectiveness and scalability. The source data, code. https://github.com/dushide/LargeMvC-Net_ACMMM_2025, and extended version http://arxiv.org/abs/2507.20980 are available.
Shide Du, Zihan Fang 0002, Wendi Zhao, Yilin Wu 0001, Changwei Wang 0001, Shiping Wang
ACM Multimedia1
2025 Enhancing Multi-view Open-set Learning via Ambiguity Uncertainty Calibration and View-wise Debiasing
abstract
Existing multi-view learning models struggle in open-set scenarios due to their implicit assumption of class completeness. Moreover, static view-induced biases, which arise from spurious view-label associations formed during training, further degrade their ability to recognize unknown categories. In this paper, we propose a multi-view open-set learning framework via ambiguity uncertainty calibration and view-wise debiasing. To simulate ambiguous samples, we design O-Mix, a novel synthesis strategy to generate virtual samples with calibrated open-set ambiguity uncertainty. These samples are further processed by an auxiliary ambiguity perception network that captures atypical patterns for improved open-set adaptation. Furthermore, we incorporate an HSIC-based contrastive debiasing module that enforces independence between view-specific ambiguous and view-consistent representations, encouraging the model to learn generalizable features. Extensive experiments on diverse multi-view benchmarks demonstrate that the proposed framework consistently enhances unknown-class recognition while preserving strong closed-set performance. The source code are available https://github.com/ZihanFang11/2025_MOCD_ACMMM
Zihan Fang 0002, Lan Du 0002, Shide Du, Zhiling Cai, Shiping Wang
ACM Multimedia4
2025 OIMGC-Net: Optimization-inspired Interpretable Multi-view Graph Clustering Network
abstract
Deep multi-view graph clustering seeks to integrate diverse graph feature sets and uncover consistent information across multiple views. While extensive prior research has utilized various neural network architectures to address multi-view graph clustering challenges, these approaches exhibit notable limitations: 1) The ''black-box'' nature of deep learning models, which obscures their internal mechanisms and impedes interpretability; 2) Insufficient efforts aim to capture low-dimensional representations through graphs that reflect intuitive clustering structures and reduce computational cost. To address these limitations, this paper introduces an interpretable multi-view graph clustering framework constructed with optimization-inspired modules. The proposed approach formulates low-dimensional clustering representation learning from graph matrices as an optimization problem, deriving an iterative solution rooted in this formulation. By seamlessly bridging this optimization process to a deep network architecture, the model learns a low-dimensional clustering representation for graph-structured data across multiple views while adhering to the iterative optimization principles and reducing computational costs. This transparent network design enhances the interpretability of multi-view clustering, enabling intuitive and human-understandable learning of clustering structures. Extensive experimental evaluations validate the proposed framework's superiority over state-of-the-art methods in multi-view clustering tasks while ensuring interpretability and reducing computational costs.
Renjie Lin, Shide Du, Shiping Wang, Le Zhang 0001
ACM Multimedia3
2025 Dual prototypes contrastive learning based semi-supervised segmentation method for intelligent medical applications
Tianai Yue, Rongtao Xu, Jingqian Wu, Wenjie Yang 0005, Shide Du, Changwei Wang 0001
Eng. Appl. Artif. Intell.5
2025 Optimization-oriented multi-view representation learning in implicit bi-topological spaces
Shiyang Lan, Shide Du, Zihan Fang 0002, Zhiling Cai, Wei Huang 0037, Shiping Wang
Inf. Sci.2
2025 MOAL: Multi-view Out-of-distribution Awareness Learning
Xuzheng Wang, Zihan Fang 0002, Shide Du, Wenzhong Guo, Shiping Wang
Neural Networks3
2025 Unsupervised Projected Sample Selector for Active Learning
abstract
Active learning, as a technique, aims to effectively label specific data points while operating within a designated query budget. Nevertheless, the majority of unsupervised active learning algorithms are based on shallow linear representation and lack sufficient interpretability. Furthermore, certain diversity-based methods face challenges in selecting samples that adequately represent the entire data distribution. Inspired by these reasons, in this paper, we propose an unsupervised active learning method on orthogonal projections to construct a deep neural network model. By optimizing the orthogonal projection process, we establish the connection between projection and active learning, consequently enhancing the interpretability of the proposed method. The proposed method can efficiently project the feature space onto a spanned subspace, deriving an indicator matrix while calculating the projection loss. Moreover, we consider the redundancy among samples to ensure both data point diversity and enhancement of clustering-based algorithms. Through extensive comparative experiments on six public datasets, the results demonstrate that the proposed method can effectively select more informative and representative samples and improve performance by up to 11%.
Yueyang Pi, Yiqing Shi, Shide Du, Shiping Wang
IEEE Trans. Big Data3
2025 A Universal Interpretable Multiview Clustering Framework: From Homogeneity to Heterogeneity
abstract
Traditional multiview clustering relies on manually-designed optimization problems based on prior interpretable knowledge to cluster objects with similar attributes, but it may be hindered by limited feature extraction capability. In contrast, deep multiview clustering overcomes this limitation by utilizing learning-based nonlinear transformations for clustering, but it may be restricted by model interpretability caused by blackbox networks. Besides, previous multiview clustering methods only consider homogeneous or heterogeneous situations, resulting in restricted scalability and generalizability. To address the aforementioned issues, we design a universal interpretable clustering framework that accommodates both homogeneous and heterogeneous multiview scenarios. To realize this purpose: 1) we revisit the interpretable knowledge-driven design architecture of traditional multiview methods and formulate clustering optimization problems on multiview data attributes in homogeneous scenarios; 2) the optimization problem is leveraged to derive network modules that learn shared and self-expressive representations for clustering, with the practical meaning of each network component providing model design-level interpretability; 3) the proposed method is extended from homogeneous to heterogeneous scenarios, enhancing its universality for a broader spectrum of multiview clustering tasks; and 4) tailored training loss for the clustering task is employed to inversely enhance the affinity between objects with similar attributes. Extensive experimental results on both homogeneous and heterogeneous multiview datasets demonstrate the superior effectiveness and adaptability of the proposed framework compared to state-of-the-art clustering methods.
Zihan Fang 0002, Shide Du, Shiping Wang
IEEE Trans. Comput. Soc. Syst.3
2025 MBGCN: Multi-View Block-Wise Graph Convolutional Networks on Large-Scale Graphs
abstract
Existing methods based on graph convolutional network often struggle with large-scale graphs due to their high computing consumption and inefficiency. Although strategies such as edge sparsification and node sampling can indeed decrease the complexity, they frequently result in information loss and local information bias. Furthermore, in multi-view scenarios, traditional multi-view fusion methods are unable to simultaneously account for both inter-view consistency and intra-view diversity, thus constraining model performance. In this paper, we propose a multi-view block-wise graph convolutional network that effectively addresses the challenges posed by large-scale graphs while exploiting the complementary nature of multi-view information. Specifically, we implement a node segmentation module to partition nodes into view-specific subsets, thereby diminishing computational complexity while preserving local structural information. To enhance feature extraction, plentiful subgraph representations are captured within blocks by alternating graph convolution with graph structure learning under a shared-weight strategy. Finally, the global fusion module introduces a cross-view inter-block loss that progressively aligns block representations across views, alleviates over-smoothing, and yields a consistent and comprehensive common representation. Extensive experiments on diverse large-scale graph datasets demonstrate that the proposed method not only outperforms state-of-the-art approaches in multi-view semi-supervised classification but also exhibits superior scalability and memory efficiency.
Ying Zou 0024, Shide Du, Yan Chen 0056, Shiping Wang
IEEE Trans. Image Process.4
2025 Learnable Graph Convolutional Network With Semisupervised Graph Information Bottleneck
abstract
Graph convolutional network (GCN) has gained widespread attention in semisupervised classification tasks. Recent studies show that GCN-based methods have achieved decent performance in numerous fields. However, most of the existing methods generally adopted a fixed graph that cannot dynamically capture both local and global relationships. This is because the hidden and important relationships may not be directed exhibited in the fixed structure, causing the degraded performance of semisupervised classification tasks. Moreover, the missing and noisy data yielded by the fixed graph may result in wrong connections, thereby disturbing the representation learning process. To cope with these issues, this article proposes a learnable GCN-based framework, aiming to obtain the optimal graph structures by jointly integrating graph learning and feature propagation in a unified network. Besides, to capture the optimal graph representations, this article designs dual-GCN-based meta-channels to simultaneously explore local and global relations during the training process. To minimize the interference of the noisy data, a semisupervised graph information bottleneck (SGIB) is introduced to conduct the graph structural learning (GSL) for acquiring the minimal sufficient representations. Concretely, SGIB aims to maximize the mutual information of both the same and different meta-channels by designing the constraints between them, thereby improving the node classification performance in the downstream tasks. Extensive experimental results on real-world datasets demonstrate the robustness of the proposed model, which outperforms state-of-the-art methods with fixed-structure graphs.
Luying Zhong, Zhaoliang Chen, Zhihao Wu 0003, Shide Du, Zheyi Chen, Shiping Wang
IEEE Trans. Neural Networks Learn. Syst.4
2024 Beyond the Known: Ambiguity-Aware Multi-view Learning
abstract
The inherent variability and unpredictability in open multi-view learning scenarios infuse considerable ambiguity into the learning and decision-making processes of predictors. This demands that predictors not only recognize familiar patterns but also adaptively interpret unknown ones out of training scope. To address this challenge, we propose an Ambiguity-Aware Multi-view Learning Framework, which integrates four synergistic modules into an end-to-end framework to achieve generalizability and reliability beyond the known. By introducing the mixed samples to broaden the learning sample space, accompanied by corresponding soft labels to encapsulate their inherent uncertainty, the proposed method adapts to the distribution of potentially unknown samples in advance. Furthermore, an instance-level sparse inference is implemented to learn sparse approximated points in the multiple view embedding space, and individual view representations are gated by view-level confidence mappings. Finally, a multi-view consistent representation is obtained by dynamically assigning weights based on the degree of cluster-level dispersion. Extensive experiments demonstrate that our approach is effective and stable compared with other state-of-the-art methods in open-world recognition situations.
Zihan Fang 0002, Shide Du, Shiping Wang
ACM Multimedia2
2024 Multi-view semi-supervised classification via auto-weighted submarkov random walk
Zhengyang Cai, Pengfei Lin 0003, Shide Du, Wenzhong Guo, Shiping Wang
Expert Syst. Appl.5
2024 GAF-Net: Graph attention fusion network for multi-view semi-supervised classification
Na Song, Shide Du, Zhihao Wu 0003, Luying Zhong, Laurence T. Yang, Jing Yang 0051, Shiping Wang
Expert Syst. Appl.2
2024 IMPRL-Net: interpretable multi-view proximity representation learning network
Shiyang Lan, Zihan Fang 0002, Shide Du, Zhiling Cai, Shiping Wang
Neural Comput. Appl.3
2024 Graph Convolutional Network with elastic topology
abstract
Graph Convolutional Network (GCN) has drawn widespread attention in data mining on graphs due to its outstanding performance and rigor theoretical guarantee. However, some recent studies have revealed that GCN-based methods may mine latent information insufficiently owing to the underutilization of the feature space . Besides, the unlearnable topology also significantly imperils the performance of GCN-based methods. In this paper, we conduct experiments to investigate these issues, finding that GCN does not fully consider the potential structure in the feature space, and a fixed topology deteriorates the robustness of GCN. Thus, it is desired to distill node features and establish a learnable graph. Motivated by this goal, we propose a framework dubbed G raph C onvolutional N etwork with e lastic t opology (GCNet 1 ). With the analysis of the optimization for the proposed flexible Laplacian embedding, GCNet is naturally constructed by alternative graph convolutional layers and adaptive topology learning layers. GCNet aims to deeply explore the feature space and employ the mined information to construct a learnable topology, which leads to a more robust graph representation. In addition, a set-level orthogonal loss is utilized to meet the orthogonal constraint required by the flexible Laplacian embedding and promote better class separability . Moreover, comprehensive experiments indicate that GCNet achieves remarkable performance and generalization on several real-world datasets.
Zhihao Wu 0003, Zhaoliang Chen, Shide Du, Sujia Huang, Shiping Wang
Pattern Recognit.3
2024 UMCGL: Universal Multi-View Consensus Graph Learning With Consistency and Diversity
abstract
Existing multi-view graph learning methods often rely on consistent information for similar nodes within and across views, however they may lack adaptability when facing diversity challenges from noise, varied views, and complex data distributions. These challenges can be mainly categorized into: 1) View-specific diversity within intra-view from noise and incomplete information; 2) Cross-view diversity within inter-view caused by various latent semantics; 3) Cross-group diversity within inter-group due to data distribution differences. To this end, we propose a universal multi-view consensus graph learning framework that considers both original and generative graphs to balance consistency and diversity. Specifically, the proposed framework can be divided into the following four modules: i) Multi-channel graph module to extract principal node information, ensuring view-specific and cross-view consistency while mitigating view-specific and cross-view diversity within original graphs; ii) Generative module to produce cleaner and more realistic graphs, enriching graph structure while maintaining view-specific consistency and suppressing view-specific diversity; iii) Contrastive module to collaborate on generative semantics to facilitate cross-view consistency and reducing cross-view diversity within generative graphs; iv) Consensus graph module to consolidate learning a consensual graph, pursuing cross-group consistency and cross-group diversity. Extensive experimental results on real-world datasets demonstrate its effectiveness and superiority.
Shide Du, Zhiling Cai, Zhihao Wu 0003, Yueyang Pi, Shiping Wang
IEEE Trans. Image Process.1
2024 Representation Learning Meets Optimization-Derived Networks: From Single-View to Multi-View
abstract
Existing representation learning approaches lie predominantly in designing models empirically without rigorous mathematical guidelines, neglecting interpretation in terms of modeling. In this work, we propose an optimization-derived representation learning network that embraces both interpretation and extensibility. To ensure interpretability at the design level, we adopt a transparent approach in customizing the representation learning network from an optimization perspective. This involves modularly stitching together components to meet specific requirements, enhancing flexibility and generality. Then, we convert the iterative solution of the convex optimization objective into the corresponding feed-forward network layers by embedding learnable modules. These above optimization-derived layers are seamlessly integrated into a deep neural network architecture, allowing for training in an end-to-end fashion. Furthermore, extra view-wise weights are introduced for multi-view learning to discriminate the contributions of representations from different views. The proposed method outperforms several advanced approaches on semi-supervised classification tasks, demonstrating its feasibility and effectiveness.
Zihan Fang 0002, Shide Du, Zhiling Cai, Shiyang Lan, Yanchao Tan, Shiping Wang
IEEE Trans. Multim.2
2023 DMRL-Net: Differentiable Multi-view Representation Learning Network
abstract
In recent years, deep multi-view representation learning has made considerable achievements due to its excellent nonlinear mapping capability. Yet its development is limited by the challenge of interpreting the underlying structure. For this reason, we propose a differentiable multi-view representation learning network to address the aforementioned issue, which is equipped with the interpretable working mechanism of sparse low-rank decomposition and outstanding representation ability of neural networks. The network is constructed by stacking multiple differentiable blocks that are explicitly reformulated from the optimization objective exhibiting interpretability. Benefiting from end-to-end optimization of deep networks, it can efficiently learn an interpretable deep representation of high-dimensional features from multi-view data. Extensive experimental results on several benchmark multi-view datasets demonstrate the effectiveness of the learned representation in comparison to several state-of-the-art algorithms.
Zihan Fang 0002, Shide Du, Shiping Wang
ICME2
2023 Bridging Trustworthiness and Open-World Learning: An Exploratory Neural Approach for Enhancing Interpretability, Generalization, and Robustness
abstract
As researchers strive to narrow the gap between machine intelligence and human through the development of artificial intelligence multimedia technologies, it is imperative that we recognize the critical importance of trustworthiness in open-world, which has become ubiquitous in all aspects of daily life for everyone. However, several challenges may create a crisis of trust in current open-world artificial multimedia systems that need to be bridged: 1) Insufficient explanation of predictive results; 2) Inadequate generalization for learning models; 3) Poor adaptability to uncertain environments. Consequently, we explore a neural program to bridge trustworthiness and open-world learning, extending from single-modal to multi-modal scenarios for readers.1) To enhance design-level interpretability, we first customize trustworthy networks with specific physical meanings; 2) We then design environmental well-being task-interfaces via flexible learning regularizers for improving the generalization of trustworthy learning; 3) We propose to increase the robustness of trustworthy learning by integrating open-world recognition losses with agent mechanisms. Eventually, we enhance various trustworthy properties through the establishment of design-level explainability, environmental well-being task-interfaces and open-world recognition programs. As a result, these designed open-world protocols are applicable across a wide range of surroundings, under open-world multimedia recognition scenarios with significant performance improvements observed.
Shide Du, Zihan Fang 0002, Shiyang Lan, Yanchao Tan, Manuel Günther, Shiping Wang, Wenzhong Guo
ACM Multimedia1
2023 DBO-Net: Differentiable bi-level optimization network for multi-view clustering
Zihan Fang 0002, Shide Du, Xincan Lin, Jinbin Yang, Shiping Wang, Yiqing Shi
Inf. Sci.2
2023 Consistent graph embedding network with optimal transport for incomplete multi-view clustering
Renjie Lin, Shide Du, Shiping Wang, Wenzhong Guo
Inf. Sci.2
2023 CCR-Net: Consistent contrastive representation network for multi-view clustering
Renjie Lin, Yongkun Lin, Zhenghong Lin, Shide Du, Shiping Wang
Inf. Sci.4
2023 Multi-view clustering via optimal transport algorithm
Renjie Lin, Shide Du, Shiping Wang, Wenzhong Guo
Knowl. Based Syst.2
2023 Dual Fusion-Propagation Graph Neural Network for Multi-View Clustering
abstract
Deep multi-view representation learning focuses on training a unified low-dimensional representation for data with multiple sources or modalities. With the rapidly growing attention of graph neural networks, more and more researchers have introduced various graph models into multi-view learning. Although considerable achievements have been made, most existing methods usually propagate information in a single view and fuse multiple information only from the perspective of attributes or relationships. To solve the aforementioned problems, we propose an efficient model termed Dual Fusion-Propagation Graph Neural Network (DFP-GNN) and apply it to deep multi-view clustering tasks. The proposed method is designed with three submodules and has the following merits: a) The proposed view-specific and cross-view propagation modules can capture the consistency and complementarity information among multiple views; b) The designed fusion module performs multi-view information fusion with the attributes of nodes and the relationships among them simultaneously. Experiments on popular databases show that DFP-GNN achieves significant results compared with several state-of-the-art algorithms.
Shunxin Xiao, Shide Du, Zhaoliang Chen, Yunhe Zhang 0001, Shiping Wang
IEEE Trans. Multim.2
2022 Learning Deep Sparse Regularizers With Applications to Multi-View Clustering and Semi-Supervised Classification
abstract
Sparsity-constrained optimization problems are common in machine learning, such as sparse coding, low-rank minimization and compressive sensing. However, most of previous studies focused on constructing various hand-crafted sparse regularizers, while little work was devoted to learning adaptive sparse regularizers from given input data for specific tasks. In this paper, we propose a deep sparse regularizer learning model that learns data-driven sparse regularizers adaptively. Via the proximal gradient algorithm, we find that the sparse regularizer learning is equivalent to learning a parameterized activation function. This encourages us to learn sparse regularizers in the deep learning framework. Therefore, we build a neural network composed of multiple blocks, each being differentiable and reusable. All blocks contain learnable piecewise linear activation functions which correspond to the sparse regularizer to be learned. Furthermore, the proposed model is trained with back propagation, and all parameters in this model are learned end-to-end. We apply our framework to multi-view clustering and semi-supervised classification tasks to learn a latent compact representation. Experimental results demonstrate the superiority of the proposed framework over state-of-the-art multi-view learning models.
Shiping Wang, Zhaoliang Chen, Shide Du, Zhouchen Lin
IEEE Trans. Pattern Anal. Mach. Intell.3
2022 An Overview of Correlation-Filter-Based Object Tracking
abstract
In the last two decades, object tracking has been one of the prevalent fields in social media. Object tracking uses a dynamic model to track the same target, aiming to analyze the same social object and its behavior in a set of consecutive video frames. In this article, we provide a comprehensive survey on some representative and latest correlation-filter-based object tracking methods and compare their respective strengths and weaknesses under the theoretical and experimental analyses. First of all, we divide these correlation-filter-based object tracking methods into four categories according to their characteristics, including categorized features, space weight factors, scale factors, and expert strategies. Second, extensive experiments on benchmark datasets with 11 tracking challenges are performed and discussed. Finally, this article also attempts to provide some insights for the readers to comprehend and improve the involved tracking algorithms. It is expected that the overview would present a detailed framework and some enlightenments of object tracking to readers who are new in this area.
Shide Du, Shiping Wang
IEEE Trans. Comput. Soc. Syst.1
2021 FMixAugment for Semi-supervised Learning with Consistency Regularization
Huibin Lin, Shiping Wang, Zhanghui Liu, Shunxin Xiao, Shide Du, Wenzhong Guo
PRCV (2)5